Task 19132384

Name	hadcm3n_xacs_198012_480_010221355_0
Workunit	10221355
Created	4 Dec 2015, 15:09:02 UTC
Sent	4 Dec 2015, 15:14:22 UTC
Report deadline	15 Nov 2016, 20:34:22 UTC
Received	14 Dec 2015, 1:46:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1381327
Run time	3 days 17 hours 38 min 56 sec
CPU time	3 days 9 hours 0 min 33 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	4.60 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(19526,0xa05211d4) malloc: * error for object 0x81a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(19526,0xa05211d4) malloc: * error for object 0x2069a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26380,0xa05211d4) malloc: * error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26380,0xa05211d4) malloc: * error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26380,0xa05211d4) malloc: * error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(31654,0xa05211d4) malloc: * error for object 0x3829c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31654,0xa05211d4) malloc: * error for object 0x3829c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31654,0xa05211d4) malloc: * error for object 0x3005c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1505 Fri Dec 11 07:03:01 2015 atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. hadcm3n_6.07_i686-apple-darwin(32736,0xa05211d4) malloc: * error for object 0x202de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32736,0xa05211d4) malloc: * error for object 0x202de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32736,0xa05211d4) malloc: * error for object 0x202de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(39721,0xa05211d4) malloc: * error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39721,0xa05211d4) malloc: * error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39721,0xa05211d4) malloc: * error for object 0x1005e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1505 Fri Dec 11 15:06:55 2015 hadcm3n_6.07_i686-apple-darwin(70389,0xa05211d4) malloc: * error for object 0x1029e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(70389,0xa05211d4) malloc: * error for object 0x1029e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(70389,0xa05211d4) malloc: * error for object 0x4801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(75881,0xa05211d4) malloc: * error for object 0x2801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75881,0xa05211d4) malloc: * error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75881,0xa05211d4) malloc: * error for object 0x3805e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1505 Sun Dec 13 13:01:21 2015 hadcm3n_6.07_i686-apple-darwin(76052,0xa05211d4) malloc: * error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76052,0xa05211d4) malloc: * error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76052,0xa05211d4) malloc: * error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(81724,0xa05211d4) malloc: * error for object 0x4801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(81724,0xa05211d4) malloc: * error for object 0x2824404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81724,0xa05211d4) malloc: * error for object 0x2824400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1505 Sun Dec 13 18:45:59 2015 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/11/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x908b1000 - 0x908b3fff /usr/lib/system/libsystem_configuration.dylib 0x908b7000 - 0x908befff /usr/lib/system/libunwind.dylib 0x90b7f000 - 0x90b87fff /usr/lib/system/libsystem_pthread.dylib 0x90bc1000 - 0x90bf4fff /usr/lib/system/libsystem_m.dylib 0x91073000 - 0x91078fff /usr/lib/system/libcompiler_rt.dylib 0x91079000 - 0x9107bfff /usr/lib/system/libsystem_sandbox.dylib 0x92512000 - 0x92515fff /usr/lib/system/libdyld.dylib 0x92ad1000 - 0x92af8fff /usr/lib/system/libdispatch.dylib 0x933b3000 - 0x933b5fff /usr/lib/system/libquarantine.dylib 0x94127000 - 0x9412dfff /usr/lib/system/libsystem_networkextension.dylib 0x94138000 - 0x94151fff /usr/lib/system/libsystem_malloc.dylib 0x94152000 - 0x94157fff /usr/lib/system/libmacho.dylib 0x94194000 - 0x94195fff /usr/lib/system/libremovefile.dylib 0x96050000 - 0x96076fff /usr/lib/system/libxpc.dylib 0x96557000 - 0x965ecfff /usr/lib/system/libsystem_c.dylib 0x97d65000 - 0x97d65fff /usr/lib/system/libunc.dylib 0x97ed6000 - 0x97efcfff /usr/lib/libc++abi.dylib 0x98436000 - 0x9843cfff /usr/lib/system/libsystem_platform.dylib 0x98445000 - 0x9845cfff /usr/lib/system/libsystem_asl.dylib 0x98995000 - 0x989befff /usr/lib/system/libsystem_info.dylib 0x989c3000 - 0x989c5fff /usr/lib/system/libsystem_secinit.dylib 0x98cd1000 - 0x98cdafff /usr/lib/system/libsystem_notify.dylib 0x98e65000 - 0x98e67fff /usr/lib/system/libsystem_coreservices.dylib 0x99b9b000 - 0x99bbafff /usr/lib/system/libsystem_kernel.dylib 0x99bde000 - 0x99becfff /usr/lib/libz.1.dylib 0x99bed000 - 0x99bedfff /usr/lib/system/liblaunch.dylib 0x99c8b000 - 0x99c8bfff /usr/lib/system/libkeymgr.dylib 0x9aa5d000 - 0x9aa61fff /usr/lib/system/libcache.dylib 0x9aa62000 - 0x9aab5fff /usr/lib/libstdc++.6.dylib 0x9ae0c000 - 0x9ae15fff /usr/lib/system/libcopyfile.dylib 0x9af1c000 - 0x9af59fff /usr/lib/system/libsystem_network.dylib 0x9b518000 - 0x9b520fff /usr/lib/system/libsystem_dnssd.dylib 0x9b521000 - 0x9b532fff /usr/lib/system/libsystem_coretls.dylib 0x9b61f000 - 0x9b68bfff /usr/lib/system/libcorecrypto.dylib 0x9bcef000 - 0x9bcf0fff /usr/lib/libSystem.B.dylib 0x9bd0f000 - 0x9bd15fff /usr/lib/system/libsystem_trace.dylib 0x9bd16000 - 0x9bd17fff /usr/lib/system/libsystem_blocks.dylib 0x9beaa000 - 0x9beb6fff /usr/lib/system/libcommonCrypto.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Dec 2015 05:35:44	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	259,200	282,787	1.0910
10 Dec 2015 18:45:16	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	233,280	254,401	1.0905
10 Dec 2015 13:01:50	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	207,360	225,854	1.0892
10 Dec 2015 13:01:50	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	181,440	197,501	1.0885
08 Dec 2015 23:04:05	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	155,520	169,085	1.0872
07 Dec 2015 07:18:47	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	129,600	140,560	1.0846
06 Dec 2015 20:44:29	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	103,680	111,976	1.0800
06 Dec 2015 07:02:54	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	77,760	83,917	1.0792
05 Dec 2015 22:25:49	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	51,840	55,403	1.0687
05 Dec 2015 02:47:37	1381327	19132384	hadcm3n_xacs_198012_480_010221355_0	25,920	27,315	1.0538