Task 17352362

Name	hadcm3n_x0pp_1940_40_009148192_0
Workunit	9278528
Created	6 Nov 2014, 12:30:07 UTC
Sent	9 Nov 2014, 6:11:13 UTC
Report deadline	8 Feb 2015, 13:38:24 UTC
Received	28 Dec 2014, 5:06:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1123890
Run time	28 days 12 hours 25 min 2 sec
CPU time	27 days 16 hours 17 min 43 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.17 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:32:22 (2483): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:29:55 (2774): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:41:54 (1209): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:14:25 (427): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:09 (27954): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(20643,0xa0c4f1d4) malloc: * error for object 0x812804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20643,0xa0c4f1d4) malloc: * error for object 0x812800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20643,0xa0c4f1d4) malloc: * error for object 0x812804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20643,0xa0c4f1d4) malloc: * error for object 0x812800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20643,0xa0c4f1d4) malloc: * error for object 0x812800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.1 build 14B25 hadcm3n_6.07_i686-apple-darwin(20643,0xa0c4f1d4) malloc: * error for object 0xb000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20643,0xa0c4f1d4) malloc: * error for object 0xb000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Sun Dec 28 00:05:14 2014 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f988 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/6/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90008000 - 0x90008fff /usr/lib/system/liblaunch.dylib 0x906eb000 - 0x906ecfff /usr/lib/system/libsystem_blocks.dylib 0x906ed000 - 0x906f2fff /usr/lib/system/libmacho.dylib 0x90b39000 - 0x90b5ffff /usr/lib/system/libxpc.dylib 0x91c22000 - 0x91c28fff /usr/lib/system/libsystem_trace.dylib 0x91c29000 - 0x91c2ffff /usr/lib/system/libsystem_platform.dylib 0x92242000 - 0x92242fff /usr/lib/system/libunc.dylib 0x930e7000 - 0x930f0fff /usr/lib/system/libcopyfile.dylib 0x93a5e000 - 0x93a61fff /usr/lib/system/libdyld.dylib 0x93c80000 - 0x93ca9fff /usr/lib/system/libsystem_info.dylib 0x94657000 - 0x94663fff /usr/lib/system/libcommonCrypto.dylib 0x94677000 - 0x94680fff /usr/lib/system/libsystem_notify.dylib 0x94a29000 - 0x94a50fff /usr/lib/system/libdispatch.dylib 0x94a55000 - 0x94a57fff /usr/lib/system/libsystem_coreservices.dylib 0x954fa000 - 0x9558ffff /usr/lib/system/libsystem_c.dylib 0x95b0a000 - 0x95b0cfff /usr/lib/system/libquarantine.dylib 0x95fe7000 - 0x95febfff /usr/lib/system/libcache.dylib 0x96f36000 - 0x96f3efff /usr/lib/system/libsystem_dnssd.dylib 0x96fa3000 - 0x96fbafff /usr/lib/system/libsystem_asl.dylib 0x96fcf000 - 0x97038fff /usr/lib/system/libcorecrypto.dylib 0x97039000 - 0x9705ffff /usr/lib/libc++abi.dylib 0x972b8000 - 0x972bafff /usr/lib/system/libsystem_configuration.dylib 0x972bb000 - 0x972bcfff /usr/lib/system/libremovefile.dylib 0x9819c000 - 0x981a4fff /usr/lib/system/libsystem_pthread.dylib 0x981fb000 - 0x98201fff /usr/lib/system/libsystem_networkextension.dylib 0x98256000 - 0x9826ffff /usr/lib/system/libsystem_malloc.dylib 0x98479000 - 0x9847afff /usr/lib/libSystem.B.dylib 0x98e0a000 - 0x98e1bfff /usr/lib/system/libsystem_coretls.dylib 0x98e1c000 - 0x98e2afff /usr/lib/libz.1.dylib 0x98f5d000 - 0x98f5dfff /usr/lib/system/libkeymgr.dylib 0x99036000 - 0x99073fff /usr/lib/system/libsystem_network.dylib 0x9918d000 - 0x991c0fff /usr/lib/system/libsystem_m.dylib 0x9af24000 - 0x9af43fff /usr/lib/system/libsystem_kernel.dylib 0x9b2c7000 - 0x9b2c9fff /usr/lib/system/libsystem_secinit.dylib 0x9b64a000 - 0x9b64cfff /usr/lib/system/libsystem_sandbox.dylib 0x9ba75000 - 0x9ba7afff /usr/lib/system/libcompiler_rt.dylib 0x9c043000 - 0x9c096fff /usr/lib/libstdc++.6.dylib 0x9c349000 - 0x9c350fff /usr/lib/system/libunwind.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Dec 2014 05:09:30	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	518,400	2,391,453	4.6131
26 Dec 2014 16:09:27	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	492,480	2,265,578	4.6003
25 Dec 2014 04:07:12	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	466,560	2,140,281	4.5874
15 Dec 2014 16:55:50	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	440,640	2,015,619	4.5743
14 Dec 2014 04:29:00	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	414,720	1,891,249	4.5603
10 Dec 2014 17:32:45	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	388,800	1,767,091	4.5450
02 Dec 2014 00:32:09	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	362,880	1,642,245	4.5256
30 Nov 2014 12:56:58	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	336,960	1,522,905	4.5195
29 Nov 2014 02:49:49	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	311,040	1,409,210	4.5306
27 Nov 2014 16:02:17	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	285,120	1,292,040	4.5316
26 Nov 2014 05:17:19	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	259,200	1,171,712	4.5205
23 Nov 2014 11:45:10	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	233,280	1,050,517	4.5032
21 Nov 2014 23:16:27	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	207,360	930,253	4.4862
20 Nov 2014 11:57:31	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	181,440	808,895	4.4582
19 Nov 2014 00:59:25	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	155,520	686,871	4.4166
17 Nov 2014 08:39:42	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	129,600	567,312	4.3774
15 Nov 2014 23:24:24	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	103,680	453,681	4.3758
14 Nov 2014 13:37:44	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	77,760	340,824	4.3830
13 Nov 2014 05:35:22	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	51,840	227,332	4.3853
11 Nov 2014 21:28:54	1123890	17352362	hadcm3n_x0pp_1940_40_009148192_0	25,920	113,671	4.3855