climateprediction.net home page
Task 12734191

Task 12734191

Name hadcm3n_o0wn_1900_40_007196506_1
Workunit 7394786
Created 28 Mar 2011, 13:58:30 UTC
Sent 2 Apr 2011, 13:17:02 UTC
Report deadline 2 Jul 2011, 20:44:13 UTC
Received 2 May 2011, 18:39:01 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1139444
Run time 5 days 6 hours 2 min 33 sec
CPU time 4 days 18 hours 44 min 25 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 3.71 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:53:11 (2390): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:53:12 (2390): No heartbeat from core client for 30 sec - exiting
15:53:13 (2390): No heartbeat from core client for 30 sec - exiting
15:53:14 (2390): No heartbeat from core client for 30 sec - exiting
15:53:15 (2390): No heartbeat from core client for 30 sec - exiting
15:53:16 (2390): No heartbeat from core client for 30 sec - exiting
15:53:17 (2390): No heartbeat from core client for 30 sec - exiting
15:53:18 (2390): No heartbeat from core client for 30 sec - exiting
15:53:19 (2390): No heartbeat from core client for 30 sec - exiting
15:53:20 (2390): No heartbeat from core client for 30 sec - exiting
15:53:21 (2390): No heartbeat from core client for 30 sec - exiting
15:53:22 (2390): No heartbeat from core client for 30 sec - exiting
15:53:23 (2390): No heartbeat from core client for 30 sec - exiting
15:53:24 (2390): No heartbeat from core client for 30 sec - exiting
15:53:25 (2390): No heartbeat from core client for 30 sec - exiting
15:53:26 (2390): No heartbeat from core client for 30 sec - exiting
15:53:27 (2390): No heartbeat from core client for 30 sec - exiting
15:53:28 (2390): No heartbeat from core client for 30 sec - exiting
15:53:29 (2390): No heartbeat from core client for 30 sec - exiting
15:53:30 (2390): No heartbeat from core client for 30 sec - exiting
15:53:31 (2390): No heartbeat from core client for 30 sec - exiting
15:53:32 (2390): No heartbeat from core client for 30 sec - exiting
15:53:33 (2390): No heartbeat from core client for 30 sec - exiting
15:53:34 (2390): No heartbeat from core client for 30 sec - exiting
15:53:35 (2390): No heartbeat from core client for 30 sec - exiting
15:53:36 (2390): No heartbeat from core client for 30 sec - exiting
15:53:37 (2390): No heartbeat from core client for 30 sec - exiting
15:53:38 (2390): No heartbeat from core client for 30 sec - exiting
15:53:39 (2390): No heartbeat from core client for 30 sec - exiting
15:53:40 (2390): No heartbeat from core client for 30 sec - exiting
15:53:41 (2390): No heartbeat from core client for 30 sec - exiting
15:53:42 (2390): No heartbeat from core client for 30 sec - exiting
15:53:43 (2390): No heartbeat from core client for 30 sec - exiting
15:53:44 (2390): No heartbeat from core client for 30 sec - exiting
15:53:45 (2390): No heartbeat from core client for 30 sec - exiting
15:53:46 (2390): No heartbeat from core client for 30 sec - exiting
15:53:47 (2390): No heartbeat from core client for 30 sec - exiting
15:53:48 (2390): No heartbeat from core client for 30 sec - exiting
15:53:49 (2390): No heartbeat from core client for 30 sec - exiting
15:53:50 (2390): No heartbeat from core client for 30 sec - exiting
15:53:51 (2390): No heartbeat from core client for 30 sec - exiting
15:53:52 (2390): No heartbeat from core client for 30 sec - exiting
15:53:53 (2390): No heartbeat from core client for 30 sec - exiting
15:53:54 (2390): No heartbeat from core client for 30 sec - exiting
15:53:55 (2390): No heartbeat from core client for 30 sec - exiting
15:53:56 (2390): No heartbeat from core client for 30 sec - exiting
15:53:57 (2390): No heartbeat from core client for 30 sec - exiting
15:53:58 (2390): No heartbeat from core client for 30 sec - exiting
15:53:59 (2390): No heartbeat from core client for 30 sec - exiting
15:54:00 (2390): No heartbeat from core client for 30 sec - exiting
15:54:01 (2390): No heartbeat from core client for 30 sec - exiting
15:54:02 (2390): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x5001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x5001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1010e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1010e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1010e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1010e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1012804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x1020e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x102f404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3778,0xa0ae5540) malloc: *** error for object 0x102f400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2109,0xa041d540) malloc: *** error for object 0x834e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2111, selfPID=2111, iMonCtr=1
hadcm3n_6.07_i686-apple-darwin(3087,0xa041d540) malloc: *** error for object 0x202de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3087,0xa041d540) malloc: *** error for object 0x202de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3087,0xa041d540) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(367,0xa041d540) malloc: *** error for object 0x1004e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(367,0xa041d540) malloc: *** error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(367,0xa041d540) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(367,0xa041d540) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(367,0xa041d540) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(829,0xa041d540) malloc: *** error for object 0x823004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(829,0xa041d540) malloc: *** error for object 0x823000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(829,0xa041d540) malloc: *** error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J3250
Mon May  2 14:37:58 2011

Thread 0 Crashed:
atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
0   libSystem.B.dylib                   0x939590cf small_free_list_remove_ptr + 246
1   libSystem.B.dylib                   0x93955b8c szone_free_definite_size + 3457
2   libSystem.B.dylib                   0x93954ba8 free + 244
3   hadcm3n_6.07_i686-apple-darwin      0x0000ba58 annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const*, char const*, int, int) + 3482
4   hadcm3n_6.07_i686-apple-darwin      0x0000d36b decadalMeans(int, char const*) + 957
5   hadcm3n_6.07_i686-apple-darwin      0x000067ff doCM3Proc() + 185
6   hadcm3n_6.07_i686-apple-darwin      0x0000876a worker() + 2896
7   hadcm3n_6.07_i686-apple-darwin      0x00008aa9 main + 491
8   hadcm3n_6.07_i686-apple-darwin      0x00002676 start + 54

Thread 1:
0   libSystem.B.dylib                   0x9394e1ce mach_wait_until + 10
1   libSystem.B.dylib                   0x939d5839 nanosleep + 345
2   libSystem.B.dylib                   0x939d56da usleep + 61
3   hadcm3n_6.07_i686-apple-darwin      0x00071a7c boinc_sleep(double) + 188
4   hadcm3n_6.07_i686-apple-darwin      0x00067282 timer_thread(void*) + 78
5   libSystem.B.dylib                   0x9397b819 _pthread_start + 345
6   libSystem.B.dylib                   0x9397b69e thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f898 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/0/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x906a7000 - 0x906aafff /usr/lib/system/libmathCommon.A.dylib
0x9394d000 - 0x93af4fff /usr/lib/libSystem.B.dylib
0x93af5000 - 0x93b5ffff /usr/lib/libstdc++.6.dylib
0x9814d000 - 0x9815bfff /usr/lib/libz.1.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Apr 2011 17:19:30 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 518,400 409,682 0.7903
28 Apr 2011 14:06:22 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 492,480 389,185 0.7903
26 Apr 2011 21:06:36 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 466,560 368,141 0.7891
25 Apr 2011 19:08:00 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 440,640 347,890 0.7895
21 Apr 2011 20:13:04 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 414,720 327,590 0.7899
21 Apr 2011 03:04:37 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 388,800 306,363 0.7880
20 Apr 2011 18:58:20 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 362,880 285,830 0.7877
20 Apr 2011 18:25:13 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 336,960 264,969 0.7864
20 Apr 2011 18:25:13 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 311,040 244,566 0.7863
20 Apr 2011 18:25:13 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 285,120 224,126 0.7861
20 Apr 2011 18:25:13 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 259,200 203,859 0.7865
13 Apr 2011 07:41:05 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 233,280 183,493 0.7866
12 Apr 2011 20:03:32 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 207,360 162,896 0.7856
11 Apr 2011 06:02:01 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 181,440 142,746 0.7867
07 Apr 2011 21:25:58 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 155,520 122,449 0.7874
06 Apr 2011 20:01:23 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 129,600 101,962 0.7867
05 Apr 2011 19:15:52 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 103,680 80,996 0.7812
05 Apr 2011 06:34:09 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 77,760 60,758 0.7814
04 Apr 2011 11:38:39 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 51,840 40,656 0.7843
03 Apr 2011 20:32:59 1139444 12734191 hadcm3n_o0wn_1900_40_007196506_1 25,920 20,646 0.7965


©2024 cpdn.org