Task 15997627

Name	hadcm3n_3kul_2020_40_008335764_3
Workunit	8486625
Created	31 Aug 2013, 3:59:43 UTC
Sent	31 Aug 2013, 4:26:23 UTC
Report deadline	30 Nov 2013, 11:53:34 UTC
Received	15 Sep 2013, 21:27:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1172598
Run time	13 days 1 hours 52 min 33 sec
CPU time	11 days 7 hours 2 min 30 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa839204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(43633,0xa09ad540) malloc: * error for object 0xa83a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(31681,0xa09ad540) malloc: * error for object 0x1011e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Sun Sep 15 07:20:00 2013 hadcm3n_6.07_i686-apple-darwin(34850,0xa09ad540) malloc: * error for object 0x5836200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Sun Sep 15 12:01:10 2013 Thread 0 Crashed: 0 libSystem.B.dylib 0x97e84b0f _small_free_list_remove_ptr + 246 1 libSystem.B.dylib 0x97e815cc _szone_free_definite_size + 3457 2 libSystem.B.dylib 0x97e805e8 _free + 244 3 hadcm3n_6.07_i686-apple-darwin 0x0000ba58 __Z12annual_cyclePKSt6vectorISsSaISsEEPKcii + 3482 4 hadcm3n_6.07_i686-apple-darwin 0x0000d36b __Z12decadalMeansiPKc + 957 5 hadcm3n_6.07_i686-apple-darwin 0x000067ff __Z9doCM3Procv + 185 6 hadcm3n_6.07_i686-apple-darwin 0x0000876a __Z6workerv + 2896 7 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 _main + 491 8 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: 0 libSystem.B.dylib 0x97e79c0e _mach_wait_until + 10 1 libSystem.B.dylib 0x97f01429 _nanosleep + 345 2 libSystem.B.dylib 0x97f012ca _usleep + 61 3 hadcm3n_6.07_i686-apple-darwin 0x00071a7c __Z11boinc_sleepd + 188 4 hadcm3n_6.07_i686-apple-darwin 0x00067282 __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x97ea7259 __pthread_start + 345 6 libSystem.B.dylib 0x97ea70de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f958 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/12/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x93c0e000 - 0x93c1cfff /usr/lib/libz.1.dylib 0x9414e000 - 0x941b8fff /usr/lib/libstdc++.6.dylib 0x96bd6000 - 0x96bd9fff /usr/lib/system/libmathCommon.A.dylib 0x97e79000 - 0x98020fff /usr/lib/libSystem.B.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Sep 2013 11:24:51	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	518,400	963,960	1.8595
14 Sep 2013 18:35:24	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	492,480	917,495	1.8630
14 Sep 2013 01:05:00	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	466,560	870,774	1.8664
13 Sep 2013 08:31:01	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	440,640	822,443	1.8665
12 Sep 2013 15:26:45	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	414,720	772,861	1.8636
11 Sep 2013 21:40:21	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	388,800	724,692	1.8639
11 Sep 2013 05:35:20	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	362,880	676,204	1.8634
10 Sep 2013 13:20:46	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	336,960	627,034	1.8609
09 Sep 2013 18:28:22	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	311,040	578,851	1.8610
08 Sep 2013 17:49:33	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	285,120	531,064	1.8626
08 Sep 2013 02:14:43	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	259,200	483,499	1.8654
07 Sep 2013 05:53:18	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	233,280	435,600	1.8673
06 Sep 2013 14:23:47	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	207,360	387,591	1.8692
05 Sep 2013 19:47:10	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	181,440	339,137	1.8691
05 Sep 2013 03:26:53	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	155,520	291,044	1.8714
04 Sep 2013 03:39:28	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	129,600	242,657	1.8724
03 Sep 2013 12:01:46	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	103,680	194,669	1.8776
02 Sep 2013 19:09:36	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	77,760	145,611	1.8726
02 Sep 2013 00:10:36	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	51,840	98,022	1.8909
01 Sep 2013 04:32:48	1172598	15997627	hadcm3n_3kul_2020_40_008335764_3	25,920	48,820	1.8835