Task 15499114

Name	hadcm3n_zdfv_1920_40_008256695_1
Workunit	8411819
Created	22 Dec 2012, 10:39:45 UTC
Sent	22 Dec 2012, 10:55:23 UTC
Report deadline	23 Mar 2013, 18:22:34 UTC
Received	13 Jan 2013, 22:26:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1101528
Run time	11 days 9 hours 26 min 54 sec
CPU time	10 days 4 hours 16 min 35 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:35:24 (48128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(73373,0xa0032540) malloc: * error for object 0x2804e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73373,0xa0032540) malloc: * error for object 0x3805e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Sun Jan 13 13:23:36 2013 Thread 0 Crashed: 0 libSystem.B.dylib 0x902fbb03 _small_free_list_remove_ptr + 234 1 libSystem.B.dylib 0x902f85cc _szone_free_definite_size + 3457 2 libSystem.B.dylib 0x902f75e8 _free + 244 3 hadcm3n_6.07_i686-apple-darwin 0x0000ba58 __Z12annual_cyclePKSt6vectorISsSaISsEEPKcii + 3482 4 hadcm3n_6.07_i686-apple-darwin 0x0000d36b __Z12decadalMeansiPKc + 957 5 hadcm3n_6.07_i686-apple-darwin 0x000067ff __Z9doCM3Procv + 185 6 hadcm3n_6.07_i686-apple-darwin 0x0000791c __Z8mainLoopv + 410 7 hadcm3n_6.07_i686-apple-darwin 0x000087c7 __Z6workerv + 2989 8 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 _main + 491 9 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: 0 libSystem.B.dylib 0x902f0c0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90378429 _nanosleep + 345 2 libSystem.B.dylib 0x903782ca _usleep + 61 3 hadcm3n_6.07_i686-apple-darwin 0x00071a7c __Z11boinc_sleepd + 188 4 hadcm3n_6.07_i686-apple-darwin 0x00067282 __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x9031e259 __pthread_start + 345 6 libSystem.B.dylib 0x9031e0de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f678 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/11/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90003000 - 0x9006dfff /usr/lib/libstdc++.6.dylib 0x902f0000 - 0x90497fff /usr/lib/libSystem.B.dylib 0x9156a000 - 0x9156dfff /usr/lib/system/libmathCommon.A.dylib 0x9a0e4000 - 0x9a0f2fff /usr/lib/libz.1.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Jan 2013 18:26:13	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	518,400	879,389	1.6964
12 Jan 2013 22:27:26	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	492,480	838,792	1.7032
11 Jan 2013 23:32:34	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	466,560	797,675	1.7097
11 Jan 2013 02:18:12	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	440,640	756,888	1.7177
10 Jan 2013 03:27:45	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	414,720	716,358	1.7273
09 Jan 2013 03:04:02	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	388,800	675,438	1.7372
08 Jan 2013 00:45:15	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	362,880	633,459	1.7456
06 Jan 2013 20:11:27	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	336,960	589,039	1.7481
05 Jan 2013 18:49:55	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	311,040	544,248	1.7498
04 Jan 2013 05:09:34	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	285,120	501,127	1.7576
01 Jan 2013 01:09:44	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	259,200	456,433	1.7609
30 Dec 2012 23:16:19	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	233,280	411,451	1.7638
30 Dec 2012 09:04:28	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	207,360	365,182	1.7611
29 Dec 2012 18:43:22	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	181,440	319,186	1.7592
29 Dec 2012 04:24:24	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	155,520	273,309	1.7574
28 Dec 2012 13:45:31	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	129,600	227,718	1.7571
27 Dec 2012 23:32:15	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	103,680	181,387	1.7495
27 Dec 2012 08:19:17	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	77,760	134,796	1.7335
26 Dec 2012 17:31:06	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	51,840	88,622	1.7095
25 Dec 2012 18:44:32	1101528	15499114	hadcm3n_zdfv_1920_40_008256695_1	25,920	43,600	1.6821