Task 15278617

Name	hadcm3n_za31_1880_40_008200126_1
Workunit	8355250
Created	13 Sep 2012, 4:59:02 UTC
Sent	13 Sep 2012, 5:11:38 UTC
Report deadline	13 Dec 2012, 12:38:49 UTC
Received	5 Oct 2012, 1:42:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1197259
Run time	20 days 5 hours 51 min 11 sec
CPU time	17 days 1 hours 15 min 56 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x9f5604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x9f5600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10050,0xac3a62c0) malloc: * error for object 0x51fec00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(58982,0xac3a62c0) malloc: * error for object 0x917d804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58982,0xac3a62c0) malloc: * error for object 0x917d800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58982,0xac3a62c0) malloc: * error for object 0x697e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58982,0xac3a62c0) malloc: * error for object 0x697e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58982,0xac3a62c0) malloc: * error for object 0x697e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(91513,0xac3a62c0) malloc: * error for object 0x2975604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G56 Thu Oct 4 19:42:39 2012 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd68 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/3/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x902f2000 - 0x902f3fff /usr/lib/system/libsystem_sandbox.dylib 0x903fa000 - 0x903fbfff /usr/lib/system/libremovefile.dylib 0x90446000 - 0x90447fff /usr/lib/system/libsystem_blocks.dylib 0x91c7e000 - 0x91c94fff /usr/lib/system/libxpc.dylib 0x91fe8000 - 0x92017fff /usr/lib/system/libsystem_info.dylib 0x92bc3000 - 0x92c8efff /usr/lib/system/libsystem_c.dylib 0x92c8f000 - 0x92c96fff /usr/lib/system/libsystem_dnssd.dylib 0x930a5000 - 0x930aafff /usr/lib/system/libmacho.dylib 0x930bc000 - 0x930c4fff /usr/lib/system/libunwind.dylib 0x930c5000 - 0x930e3fff /usr/lib/system/libsystem_kernel.dylib 0x94130000 - 0x94192fff /usr/lib/libstdc++.6.dylib 0x94848000 - 0x94848fff /usr/lib/system/libdnsinfo.dylib 0x9484e000 - 0x94852fff /usr/lib/system/libsystem_network.dylib 0x94f44000 - 0x94f4dfff /usr/lib/libc++abi.dylib 0x962e2000 - 0x96310fff /usr/lib/libSystem.B.dylib 0x9669f000 - 0x966adfff /usr/lib/libz.1.dylib 0x973cb000 - 0x973d3fff /usr/lib/system/liblaunch.dylib 0x989f6000 - 0x989f9fff /usr/lib/system/libmathCommon.A.dylib 0x989fa000 - 0x98a01fff /usr/lib/system/libsystem_notify.dylib 0x9947a000 - 0x9947cfff /usr/lib/system/libdyld.dylib 0x9947d000 - 0x9948bfff /usr/lib/system/libdispatch.dylib 0x994bc000 - 0x994bffff /usr/lib/system/libcompiler_rt.dylib 0x9966b000 - 0x9966ffff /usr/lib/system/libcache.dylib 0x9979e000 - 0x997e1fff /usr/lib/system/libcommonCrypto.dylib 0x997e2000 - 0x997e3fff /usr/lib/system/libquarantine.dylib 0x9b115000 - 0x9b115fff /usr/lib/system/libkeymgr.dylib 0x9c48a000 - 0x9c492fff /usr/lib/system/libcopyfile.dylib 0x9c9bb000 - 0x9c9bcfff /usr/lib/system/libunc.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Oct 2012 05:47:24	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	777,600	1,428,260	1.8368
03 Oct 2012 09:46:40	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	751,680	1,380,737	1.8369
02 Oct 2012 15:43:28	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	725,760	1,336,287	1.8412
01 Oct 2012 23:09:28	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	699,840	1,290,070	1.8434
01 Oct 2012 06:09:50	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	673,920	1,241,915	1.8428
30 Sep 2012 10:46:55	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	648,000	1,193,846	1.8424
29 Sep 2012 17:28:31	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	622,080	1,145,821	1.8419
28 Sep 2012 23:08:45	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	596,160	1,097,679	1.8412
28 Sep 2012 02:44:56	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	570,240	1,050,103	1.8415
27 Sep 2012 10:14:27	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	544,320	1,002,270	1.8413
26 Sep 2012 19:22:27	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	518,400	955,009	1.8422
26 Sep 2012 03:11:22	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	492,480	908,343	1.8444
25 Sep 2012 15:14:20	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	466,560	860,446	1.8442
24 Sep 2012 18:41:16	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	440,640	812,464	1.8438
24 Sep 2012 03:33:45	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	414,720	764,192	1.8427
23 Sep 2012 11:16:46	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	388,800	716,122	1.8419
22 Sep 2012 18:38:59	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	362,880	668,009	1.8409
22 Sep 2012 03:31:52	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	336,960	620,101	1.8403
21 Sep 2012 11:03:20	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	311,040	571,856	1.8385
20 Sep 2012 18:33:43	1197259	15278617	hadcm3n_za31_1880_40_008200126_1	285,120	523,805	1.8371