Task 14368234

Name	hadcm3n_o1rs_2020_40_007857876_2
Workunit	8012988
Created	6 Apr 2012, 0:15:14 UTC
Sent	6 Apr 2012, 0:15:30 UTC
Report deadline	6 Jul 2012, 7:42:41 UTC
Received	19 Apr 2012, 5:20:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1208255
Run time	5 days 22 hours 9 min 35 sec
CPU time	5 days 12 hours 31 min 13 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20360,0xac2932c0) malloc: * error for object 0xa00600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x939004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x939000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x112da04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x112da00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x112da04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x112da00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x112da04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x112da00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x112da04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x112da00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34005,0xac2932c0) malloc: * error for object 0x91fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.3 build 11D50 Thu Apr 19 00:20:07 2012 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90249000 - 0x9024afff /usr/lib/system/libremovefile.dylib 0x91b8e000 - 0x91bd1fff /usr/lib/system/libcommonCrypto.dylib 0x91d59000 - 0x91e24fff /usr/lib/system/libsystem_c.dylib 0x91e80000 - 0x91e9efff /usr/lib/system/libsystem_kernel.dylib 0x93d34000 - 0x93d96fff /usr/lib/libstdc++.6.dylib 0x946dd000 - 0x946defff /usr/lib/system/libsystem_sandbox.dylib 0x955af000 - 0x955affff /usr/lib/system/libdnsinfo.dylib 0x95893000 - 0x958c1fff /usr/lib/libSystem.B.dylib 0x958c2000 - 0x958c3fff /usr/lib/system/libquarantine.dylib 0x96389000 - 0x9638dfff /usr/lib/system/libsystem_network.dylib 0x96390000 - 0x96390fff /usr/lib/system/libkeymgr.dylib 0x96b50000 - 0x96b53fff /usr/lib/system/libcompiler_rt.dylib 0x982da000 - 0x982e2fff /usr/lib/system/libunwind.dylib 0x9a07f000 - 0x9a095fff /usr/lib/system/libxpc.dylib 0x9aa92000 - 0x9aa97fff /usr/lib/system/libmacho.dylib 0x9abd8000 - 0x9abdcfff /usr/lib/system/libcache.dylib 0x9b467000 - 0x9b468fff /usr/lib/system/libunc.dylib 0x9b8c3000 - 0x9b8cbfff /usr/lib/system/libcopyfile.dylib 0x9b9ff000 - 0x9ba0dfff /usr/lib/libz.1.dylib 0x9bb33000 - 0x9bb3afff /usr/lib/system/libsystem_dnssd.dylib 0x9cbb0000 - 0x9cbbefff /usr/lib/system/libdispatch.dylib 0x9cc0f000 - 0x9cc16fff /usr/lib/system/libsystem_notify.dylib 0x9cda8000 - 0x9cda9fff /usr/lib/system/libsystem_blocks.dylib 0x9cdaa000 - 0x9cdd9fff /usr/lib/system/libsystem_info.dylib 0x9cdda000 - 0x9cde3fff /usr/lib/libc++abi.dylib 0x9cde4000 - 0x9cde6fff /usr/lib/system/libdyld.dylib 0x9ce87000 - 0x9ce8ffff /usr/lib/system/liblaunch.dylib 0x9ced3000 - 0x9ced6fff /usr/lib/system/libmathCommon.A.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Apr 2012 04:23:23	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	518,400	477,069	0.9203
18 Apr 2012 19:26:43	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	492,480	453,294	0.9204
18 Apr 2012 05:54:00	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	466,560	429,473	0.9205
17 Apr 2012 20:31:47	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	440,640	405,476	0.9202
17 Apr 2012 11:59:22	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	414,720	381,123	0.9190
17 Apr 2012 02:57:50	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	388,800	356,933	0.9180
16 Apr 2012 15:48:05	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	362,880	332,931	0.9175
16 Apr 2012 08:18:03	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	336,960	309,220	0.9177
16 Apr 2012 01:04:44	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	311,040	285,518	0.9179
15 Apr 2012 17:14:50	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	285,120	261,992	0.9189
15 Apr 2012 00:09:25	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	259,200	238,046	0.9184
14 Apr 2012 13:21:13	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	233,280	214,287	0.9186
14 Apr 2012 04:42:13	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	207,360	190,676	0.9195
13 Apr 2012 19:03:23	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	181,440	167,032	0.9206
13 Apr 2012 05:13:09	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	155,520	143,346	0.9217
11 Apr 2012 21:10:28	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	129,600	119,508	0.9221
11 Apr 2012 02:34:44	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	103,680	95,789	0.9239
10 Apr 2012 16:23:39	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	77,760	71,815	0.9235
10 Apr 2012 07:46:27	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	51,840	47,770	0.9215
09 Apr 2012 21:54:45	1208255	14368234	hadcm3n_o1rs_2020_40_007857876_2	25,920	23,792	0.9179