Task 16697118

Name	hadcm3n_8bfq_1980_40_008724241_3
Workunit	8870219
Created	29 Jun 2014, 23:36:52 UTC
Sent	29 Jun 2014, 23:36:53 UTC
Report deadline	29 Sep 2014, 7:04:04 UTC
Received	1 Aug 2014, 12:50:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1110299
Run time	21 days 23 hours 57 min 14 sec
CPU time	21 days 2 hours 51 min 28 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:22:50 (471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:44:39 (465): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:44:40 (465): No heartbeat from core client for 30 sec - exiting 08:44:41 (465): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4070,0xad2172c0) malloc: * error for object 0x23a9e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(3966,0xad2172c0) malloc: * error for object 0xc18c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 hadcm3n_6.07_i686-apple-darwin(3966,0xad2172c0) malloc: * error for object 0x640a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3966,0xad2172c0) malloc: * error for object 0x640a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Fri Aug 1 13:48:27 2014 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/20/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90168000 - 0x9016ffff /usr/lib/system/libsystem_notify.dylib 0x93d04000 - 0x93d05fff /usr/lib/system/libsystem_blocks.dylib 0x93d0b000 - 0x93d0dfff /usr/lib/system/libdyld.dylib 0x95721000 - 0x95750fff /usr/lib/system/libsystem_info.dylib 0x95752000 - 0x95756fff /usr/lib/system/libcache.dylib 0x95b80000 - 0x95b9efff /usr/lib/system/libsystem_kernel.dylib 0x9626e000 - 0x96276fff /usr/lib/system/libcopyfile.dylib 0x966b5000 - 0x966befff /usr/lib/libc++abi.dylib 0x96b66000 - 0x96b67fff /usr/lib/system/libremovefile.dylib 0x96b68000 - 0x96b76fff /usr/lib/libz.1.dylib 0x98c55000 - 0x98c83fff /usr/lib/libSystem.B.dylib 0x98ead000 - 0x98eb1fff /usr/lib/system/libsystem_network.dylib 0x98eb2000 - 0x98ef5fff /usr/lib/system/libcommonCrypto.dylib 0x9932a000 - 0x99332fff /usr/lib/system/libunwind.dylib 0x99453000 - 0x99456fff /usr/lib/system/libmathCommon.A.dylib 0x995b7000 - 0x995bcfff /usr/lib/system/libmacho.dylib 0x9a4cf000 - 0x9a4cffff /usr/lib/system/libkeymgr.dylib 0x9a806000 - 0x9a807fff /usr/lib/system/libquarantine.dylib 0x9ac4c000 - 0x9ac62fff /usr/lib/system/libxpc.dylib 0x9aca8000 - 0x9acaffff /usr/lib/system/libsystem_dnssd.dylib 0x9acb2000 - 0x9acb3fff /usr/lib/system/libunc.dylib 0x9b007000 - 0x9b015fff /usr/lib/system/libdispatch.dylib 0x9ca47000 - 0x9cb12fff /usr/lib/system/libsystem_c.dylib 0x9ccb0000 - 0x9ccb8fff /usr/lib/system/liblaunch.dylib 0x9ccbe000 - 0x9ccc1fff /usr/lib/system/libcompiler_rt.dylib 0x9cd3b000 - 0x9cd9dfff /usr/lib/libstdc++.6.dylib 0x9cefd000 - 0x9cefdfff /usr/lib/system/libdnsinfo.dylib 0x9cf4d000 - 0x9cf4efff /usr/lib/system/libsystem_sandbox.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Aug 2014 12:51:20	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	1,036,800	1,824,685	1.7599
31 Jul 2014 09:01:08	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	1,010,880	1,779,152	1.7600
30 Jul 2014 18:16:19	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	984,960	1,735,314	1.7618
29 Jul 2014 15:48:49	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	959,040	1,687,348	1.7594
29 Jul 2014 01:02:57	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	933,120	1,637,641	1.7550
28 Jul 2014 10:51:20	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	907,200	1,588,357	1.7508
26 Jul 2014 08:33:28	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	881,280	1,542,378	1.7502
24 Jul 2014 11:40:45	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	855,360	1,494,752	1.7475
23 Jul 2014 12:40:28	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	829,440	1,448,567	1.7464
22 Jul 2014 14:21:21	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	803,520	1,401,330	1.7440
22 Jul 2014 13:21:30	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	777,600	1,354,430	1.7418
16 Jul 2014 20:36:55	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	751,680	1,308,539	1.7408
16 Jul 2014 07:57:47	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	725,760	1,263,558	1.7410
15 Jul 2014 18:35:38	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	699,840	1,217,345	1.7395
14 Jul 2014 17:56:54	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	673,920	1,167,312	1.7321
14 Jul 2014 03:04:02	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	648,000	1,117,043	1.7238
13 Jul 2014 12:57:59	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	622,080	1,066,927	1.7151
12 Jul 2014 14:26:10	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	596,160	1,014,963	1.7025
11 Jul 2014 22:43:56	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	570,240	964,969	1.6922
11 Jul 2014 09:04:26	1110299	16697118	hadcm3n_8bfq_1980_40_008724241_3	544,320	916,485	1.6837