Task 16050564

Name	hadcm3n_n37f_1880_40_008376659_3
Workunit	8527518
Created	30 Sep 2013, 9:05:55 UTC
Sent	30 Sep 2013, 9:09:03 UTC
Report deadline	30 Dec 2013, 16:36:14 UTC
Received	13 Oct 2013, 5:43:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1110299
Run time	8 days 3 hours 25 min 2 sec
CPU time	6 days 1 hours 0 min 38 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> 23:11:12 (84588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:13:23 (99244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:08:44 (1602): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:58:12 (8054): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:17:02 (51139): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:08:35 (75771): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:45 (5474): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:43:14 (13192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:14:43 (19947): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:27:49 (27654): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:12:54 (421): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:15 (1756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:18 (9944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:02:36 (13687): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x5341e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x5341e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x7341004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x7341000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x7341004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x7341000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x7341004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x7341000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x7341004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x7341000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(47174,0xacb492c0) malloc: * error for object 0x1341004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sat Oct 12 23:10:46 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc6d8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/29/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x908a6000 - 0x908aefff /usr/lib/system/libcopyfile.dylib 0x91cbf000 - 0x91cc7fff /usr/lib/system/liblaunch.dylib 0x91f2f000 - 0x91f30fff /usr/lib/system/libremovefile.dylib 0x927d1000 - 0x927d4fff /usr/lib/system/libmathCommon.A.dylib 0x9317d000 - 0x9317efff /usr/lib/system/libunc.dylib 0x9371f000 - 0x9374efff /usr/lib/system/libsystem_info.dylib 0x94b8f000 - 0x94b92fff /usr/lib/system/libcompiler_rt.dylib 0x94cd8000 - 0x94ceefff /usr/lib/system/libxpc.dylib 0x9500b000 - 0x9500dfff /usr/lib/system/libdyld.dylib 0x9501a000 - 0x95022fff /usr/lib/system/libunwind.dylib 0x95b49000 - 0x95b49fff /usr/lib/system/libkeymgr.dylib 0x95b4a000 - 0x95b51fff /usr/lib/system/libsystem_notify.dylib 0x95bd4000 - 0x95bf2fff /usr/lib/system/libsystem_kernel.dylib 0x973d0000 - 0x973d1fff /usr/lib/system/libquarantine.dylib 0x97487000 - 0x9748cfff /usr/lib/system/libmacho.dylib 0x9748d000 - 0x9748dfff /usr/lib/system/libdnsinfo.dylib 0x9905a000 - 0x99088fff /usr/lib/libSystem.B.dylib 0x99089000 - 0x99097fff /usr/lib/system/libdispatch.dylib 0x9944e000 - 0x99519fff /usr/lib/system/libsystem_c.dylib 0x99c9f000 - 0x99ce2fff /usr/lib/system/libcommonCrypto.dylib 0x99dc0000 - 0x99dc9fff /usr/lib/libc++abi.dylib 0x99dca000 - 0x99dcbfff /usr/lib/system/libsystem_sandbox.dylib 0x99dcc000 - 0x99ddafff /usr/lib/libz.1.dylib 0x9a2c7000 - 0x9a2cefff /usr/lib/system/libsystem_dnssd.dylib 0x9a5d4000 - 0x9a5d5fff /usr/lib/system/libsystem_blocks.dylib 0x9a692000 - 0x9a696fff /usr/lib/system/libcache.dylib 0x9ab21000 - 0x9ab25fff /usr/lib/system/libsystem_network.dylib 0x9cae1000 - 0x9cb43fff /usr/lib/libstdc++.6.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Oct 2013 22:09:41	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	259,200	521,795	2.0131
11 Oct 2013 01:31:21	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	233,280	472,778	2.0267
10 Oct 2013 06:09:30	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	207,360	425,262	2.0508
09 Oct 2013 11:44:25	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	181,440	376,284	2.0739
08 Oct 2013 16:49:15	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	155,520	323,343	2.0791
07 Oct 2013 21:16:43	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	129,600	270,401	2.0864
06 Oct 2013 23:38:49	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	103,680	216,774	2.0908
06 Oct 2013 03:16:42	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	77,760	162,352	2.0879
02 Oct 2013 03:51:44	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	51,840	107,413	2.0720
01 Oct 2013 04:08:42	1110299	16050564	hadcm3n_n37f_1880_40_008376659_3	25,920	50,943	1.9654