Task 16592248

Name	hadcm3n_8du7_1980_40_008727354_0
Workunit	8873332
Created	23 Apr 2014, 13:53:22 UTC
Sent	28 Apr 2014, 1:36:59 UTC
Report deadline	28 Jul 2014, 9:04:10 UTC
Received	18 May 2014, 1:09:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1110299
Run time	13 days 6 hours 15 min 36 sec
CPU time	12 days 10 hours 32 min 26 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x520f404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x520f400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x71f5e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x7211404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x7211400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x4a11804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x4a11800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x9faa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0xa16004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0xa16000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x81fde04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x71f5e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x7211404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x7211400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x11f7204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x11f7200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sun May 18 02:07:24 2014 Thread 0 Crashed: Thread 1: hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x49f6204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23637,0xacd4b2c0) malloc: * error for object 0x49f6200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/13/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9000c000 - 0x90022fff /usr/lib/system/libxpc.dylib 0x90270000 - 0x90275fff /usr/lib/system/libmacho.dylib 0x90276000 - 0x90276fff /usr/lib/system/libdnsinfo.dylib 0x90b1e000 - 0x90b1ffff /usr/lib/system/libsystem_sandbox.dylib 0x91459000 - 0x914bbfff /usr/lib/libstdc++.6.dylib 0x92054000 - 0x92097fff /usr/lib/system/libcommonCrypto.dylib 0x9442c000 - 0x9442efff /usr/lib/system/libdyld.dylib 0x94470000 - 0x94478fff /usr/lib/system/libunwind.dylib 0x94480000 - 0x94481fff /usr/lib/system/libremovefile.dylib 0x946fb000 - 0x946fcfff /usr/lib/system/libunc.dylib 0x94848000 - 0x94848fff /usr/lib/system/libkeymgr.dylib 0x94992000 - 0x949c0fff /usr/lib/libSystem.B.dylib 0x96484000 - 0x964a2fff /usr/lib/system/libsystem_kernel.dylib 0x964d2000 - 0x964d9fff /usr/lib/system/libsystem_dnssd.dylib 0x97140000 - 0x9716ffff /usr/lib/system/libsystem_info.dylib 0x9756e000 - 0x97576fff /usr/lib/system/liblaunch.dylib 0x98b66000 - 0x98b69fff /usr/lib/system/libmathCommon.A.dylib 0x98b85000 - 0x98b8efff /usr/lib/libc++abi.dylib 0x98f02000 - 0x98fcdfff /usr/lib/system/libsystem_c.dylib 0x99235000 - 0x9923dfff /usr/lib/system/libcopyfile.dylib 0x9ab71000 - 0x9ab72fff /usr/lib/system/libquarantine.dylib 0x9aded000 - 0x9adf0fff /usr/lib/system/libcompiler_rt.dylib 0x9be9e000 - 0x9bea5fff /usr/lib/system/libsystem_notify.dylib 0x9bea6000 - 0x9beb4fff /usr/lib/libz.1.dylib 0x9beb5000 - 0x9beb6fff /usr/lib/system/libsystem_blocks.dylib 0x9c679000 - 0x9c67dfff /usr/lib/system/libsystem_network.dylib 0x9cb37000 - 0x9cb45fff /usr/lib/system/libdispatch.dylib 0x9ce83000 - 0x9ce87fff /usr/lib/system/libcache.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 May 2014 01:12:51	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	518,400	1,074,743	2.0732
17 May 2014 08:58:58	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	492,480	1,021,402	2.0740
16 May 2014 16:47:40	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	466,560	965,272	2.0689
15 May 2014 22:52:33	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	440,640	909,034	2.0630
15 May 2014 05:42:53	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	414,720	852,875	2.0565
14 May 2014 13:00:55	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	388,800	795,094	2.0450
13 May 2014 19:38:08	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	362,880	737,444	2.0322
13 May 2014 04:30:49	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	336,960	679,831	2.0175
12 May 2014 10:03:14	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	311,040	624,076	2.0064
11 May 2014 08:32:53	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	285,120	570,872	2.0022
10 May 2014 12:10:49	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	259,200	516,966	1.9945
09 May 2014 21:30:33	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	233,280	467,308	2.0032
08 May 2014 19:37:37	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	207,360	417,463	2.0132
07 May 2014 15:31:37	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	181,440	368,636	2.0317
06 May 2014 19:40:53	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	155,520	319,402	2.0538
05 May 2014 14:05:35	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	129,600	269,325	2.0781
04 May 2014 10:26:06	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	103,680	217,697	2.0997
30 Apr 2014 21:23:27	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	77,760	165,664	2.1305
29 Apr 2014 16:25:29	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	51,840	110,494	2.1314
29 Apr 2014 00:24:13	1110299	16592248	hadcm3n_8du7_1980_40_008727354_0	25,920	55,278	2.1326