Task 19133158

Name	hadcm3n_ldhk_198012_480_010219845_1
Workunit	10219845
Created	4 Dec 2015, 19:21:14 UTC
Sent	5 Dec 2015, 3:02:20 UTC
Report deadline	16 Nov 2016, 8:22:20 UTC
Received	12 Dec 2015, 1:49:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1350286
Run time	4 days 22 hours 44 min 40 sec
CPU time	4 days 7 hours 57 min 50 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.47 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:19:53 (2629): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:32:30 (20815): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:50 (1258): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:38:34 (12882): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:46:47 (16815): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:12:51 (26219): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:53:35 (34839): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:13:25 (47161): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(72361,0xa3f01000) malloc: * error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(72361,0xa3f01000) malloc: * error for object 0x2800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(72361,0xa3f01000) malloc: * error for object 0x1817e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(72361,0xa3f01000) malloc: * error for object 0x1817e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(72361,0xa3f01000) malloc: * error for object 0x1817e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(11246,0xa3f01000) malloc: * error for object 0x101e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11246,0xa3f01000) malloc: * error for object 0x101e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11246,0xa3f01000) malloc: * error for object 0x101e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation SIGSEGV: segmentation violation SIGSEGV: segmentation violation SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(14316,0xa3f01000) malloc: * error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14316,0xa3f01000) malloc: * error for object 0x1011e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14316,0xa3f01000) malloc: * error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation SIGSEGV: segmentation violation SIGSEGV: segmentation violation SIGSEGV: segmentation violation SIGSEGV: segmentation violation SIGSEGV: segmentation violation SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.1 build 15B42 Fri Dec 11 16:35:04 2015 SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.1 build 15B42 Fri Dec 11 16:49:22 2015 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd18 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/4/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x905b6000 - 0x905b7fff /usr/lib/system/libremovefile.dylib 0x905b9000 - 0x905befff /usr/lib/system/libcompiler_rt.dylib 0x909b8000 - 0x90a4dfff /usr/lib/system/libsystem_c.dylib 0x90b84000 - 0x90b8afff /usr/lib/system/libunwind.dylib 0x90b8b000 - 0x90b8dfff /usr/lib/system/libquarantine.dylib 0x90fde000 - 0x90fe6fff /usr/lib/system/libsystem_dnssd.dylib 0x91992000 - 0x9199cfff /usr/lib/system/libsystem_notify.dylib 0x91dd7000 - 0x91dd7fff /usr/lib/system/libunc.dylib 0x92f35000 - 0x92f3efff /usr/lib/system/libsystem_networkextension.dylib 0x92f5d000 - 0x92f60fff /usr/lib/system/libsystem_sandbox.dylib 0x93564000 - 0x9357dfff /usr/lib/system/libsystem_asl.dylib 0x93f8a000 - 0x93fadfff /usr/lib/libc++abi.dylib 0x951ee000 - 0x951f4fff /usr/lib/system/libsystem_platform.dylib 0x951fe000 - 0x9520cfff /usr/lib/libz.1.dylib 0x95b88000 - 0x95bdbfff /usr/lib/libstdc++.6.dylib 0x95bdc000 - 0x95bdefff /usr/lib/system/libsystem_coreservices.dylib 0x968d5000 - 0x968d7fff /usr/lib/system/libsystem_secinit.dylib 0x96912000 - 0x96927fff /usr/lib/system/libsystem_coretls.dylib 0x96928000 - 0x9692dfff /usr/lib/system/libmacho.dylib 0x96b93000 - 0x96b93fff /usr/lib/system/libkeymgr.dylib 0x96fda000 - 0x97004fff /usr/lib/system/libdispatch.dylib 0x9763d000 - 0x97666fff /usr/lib/system/libsystem_info.dylib 0x97a45000 - 0x97a6dfff /usr/lib/system/libxpc.dylib 0x988be000 - 0x98925fff /usr/lib/system/libcorecrypto.dylib 0x995f8000 - 0x99618fff /usr/lib/system/libsystem_kernel.dylib 0x99619000 - 0x99624fff /usr/lib/system/libcommonCrypto.dylib 0x9968d000 - 0x9969efff /usr/lib/system/libsystem_trace.dylib 0x9a0f0000 - 0x9a0f3fff /usr/lib/system/libdyld.dylib 0x9a0f4000 - 0x9a0fcfff /usr/lib/system/libsystem_pthread.dylib 0x9ae72000 - 0x9ae73fff /usr/lib/libSystem.B.dylib 0x9bc26000 - 0x9bc2afff /usr/lib/system/libcache.dylib 0x9bd99000 - 0x9bd9bfff /usr/lib/system/libsystem_configuration.dylib 0x9be34000 - 0x9be9afff /usr/lib/system/libsystem_network.dylib 0x9cc06000 - 0x9cc06fff /usr/lib/system/liblaunch.dylib 0x9cc62000 - 0x9cc95fff /usr/lib/system/libsystem_m.dylib 0x9df41000 - 0x9df41fff /usr/lib/system/libsystem_blocks.dylib 0x9e571000 - 0x9e58afff /usr/lib/system/libsystem_malloc.dylib 0x9ebd1000 - 0x9ebdafff /usr/lib/system/libcopyfile.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Dec 2015 16:08:28	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	259,200	370,489	1.4294
10 Dec 2015 22:26:16	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	233,280	333,495	1.4296
10 Dec 2015 10:48:09	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	207,360	296,432	1.4296
09 Dec 2015 05:33:25	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	181,440	258,212	1.4231
08 Dec 2015 12:00:59	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	155,520	221,675	1.4254
07 Dec 2015 20:18:38	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	129,600	185,145	1.4286
07 Dec 2015 07:03:38	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	103,680	148,102	1.4285
06 Dec 2015 16:33:11	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	77,760	111,354	1.4320
06 Dec 2015 04:35:46	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	51,840	74,105	1.4295
05 Dec 2015 14:52:54	1350286	19133158	hadcm3n_ldhk_198012_480_010219845_1	25,920	37,415	1.4435