Task 19418105

Name	hadcm3n_xd9n_198012_480_374_010412561_0
Workunit	10412561
Created	21 Mar 2016, 15:12:37 UTC
Sent	23 Mar 2016, 11:13:03 UTC
Report deadline	5 Mar 2017, 16:33:03 UTC
Received	29 Apr 2016, 15:57:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1363620
Run time	9 days 21 hours 49 min 51 sec
CPU time	9 days 16 hours 57 min 53 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	5.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(49312,0xa395b000) malloc: * error for object 0x3000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49312,0xa395b000) malloc: * error for object 0x3001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(55256,0xa395b000) malloc: * error for object 0x3001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(55256,0xa395b000) malloc: * error for object 0x2001204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55256,0xa395b000) malloc: * error for object 0x2001200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Sat Apr 23 22:31:56 2016 hadcm3n_6.07_i686-apple-darwin(61992,0xa395b000) malloc: * error for object 0x5001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(65757,0xa395b000) malloc: * error for object 0x3000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(98738,0xa395b000) malloc: * error for object 0x280de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(98738,0xa395b000) malloc: * error for object 0x1808e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(98738,0xa395b000) malloc: * error for object 0x1808e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) hadcm3n_6.07_i686-apple-darwin(724,0xa395b000) malloc: * error for object 0x3800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(724,0xa395b000) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(6923,0xa395b000) malloc: * error for object 0x202e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6923,0xa395b000) malloc: * error for object 0x202e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6923,0xa395b000) malloc: * error for object 0x202e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(19383,0xa395b000) malloc: * error for object 0x182de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19383,0xa395b000) malloc: * error for object 0x182de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19383,0xa395b000) malloc: * error for object 0x182de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(21184,0xa395b000) malloc: * error for object 0x2819c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(21184,0xa395b000) malloc: * error for object 0x2819c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(21184,0xa395b000) malloc: * error for object 0x3001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Fri Apr 29 17:13:28 2016 hadcm3n_6.07_i686-apple-darwin(22221,0xa395b000) malloc: * error for object 0x202a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22221,0xa395b000) malloc: * error for object 0x202a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22221,0xa395b000) malloc: * error for object 0x202a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(23825,0xa395b000) malloc: * error for object 0x282dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23825,0xa395b000) malloc: * error for object 0x282dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23825,0xa395b000) malloc: * error for object 0x812600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(25028,0xa395b000) malloc: * error for object 0x82b004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(25028,0xa395b000) malloc: * error for object 0x82b000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(25028,0xa395b000) malloc: * error for object 0x82b000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Sat Apr 30 01:59:19 2016 hadcm3n_6.07_i686-apple-darwin(25432,0xa395b000) malloc: * error for object 0x3839204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(25432,0xa395b000) malloc: * error for object 0x3839200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(25432,0xa395b000) malloc: * error for object 0x3839200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Sat Apr 30 02:56:50 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd88 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/9/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90429000 - 0x9042cfff /usr/lib/system/libsystem_sandbox.dylib 0x9089c000 - 0x908a1fff /usr/lib/system/libmacho.dylib 0x91ac0000 - 0x91ac2fff /usr/lib/system/libsystem_coreservices.dylib 0x91b3a000 - 0x91b48fff /usr/lib/libz.1.dylib 0x91c47000 - 0x91c52fff /usr/lib/system/libcommonCrypto.dylib 0x92702000 - 0x9272cfff /usr/lib/system/libdispatch.dylib 0x92cae000 - 0x92cc7fff /usr/lib/system/libsystem_asl.dylib 0x92fa1000 - 0x92fc9fff /usr/lib/system/libxpc.dylib 0x92fca000 - 0x92fd0fff /usr/lib/system/libunwind.dylib 0x92fda000 - 0x92fdffff /usr/lib/system/libcompiler_rt.dylib 0x930ec000 - 0x930eefff /usr/lib/system/libsystem_configuration.dylib 0x934bd000 - 0x934bdfff /usr/lib/system/libkeymgr.dylib 0x93893000 - 0x9389dfff /usr/lib/system/libsystem_notify.dylib 0x93e58000 - 0x93e5afff /usr/lib/system/libquarantine.dylib 0x94102000 - 0x94197fff /usr/lib/system/libsystem_c.dylib 0x941b0000 - 0x941d3fff /usr/lib/libc++abi.dylib 0x945ce000 - 0x945d7fff /usr/lib/system/libcopyfile.dylib 0x95041000 - 0x95042fff /usr/lib/system/libremovefile.dylib 0x95991000 - 0x95999fff /usr/lib/system/libsystem_pthread.dylib 0x95ce1000 - 0x95d02fff /usr/lib/system/libsystem_kernel.dylib 0x95e55000 - 0x95e66fff /usr/lib/system/libsystem_trace.dylib 0x95e67000 - 0x95e91fff /usr/lib/system/libsystem_info.dylib 0x960f1000 - 0x96158fff /usr/lib/system/libcorecrypto.dylib 0x961d9000 - 0x961ddfff /usr/lib/system/libcache.dylib 0x973b7000 - 0x973bffff /usr/lib/system/libsystem_dnssd.dylib 0x97cba000 - 0x97cbcfff /usr/lib/system/libsystem_secinit.dylib 0x97e19000 - 0x97e32fff /usr/lib/system/libsystem_malloc.dylib 0x97e33000 - 0x97e66fff /usr/lib/system/libsystem_m.dylib 0x98edc000 - 0x98eddfff /usr/lib/libSystem.B.dylib 0x9928c000 - 0x99295fff /usr/lib/system/libsystem_networkextension.dylib 0x99296000 - 0x99304fff /usr/lib/system/libsystem_network.dylib 0x9a263000 - 0x9a269fff /usr/lib/system/libsystem_platform.dylib 0x9b1e9000 - 0x9b1ecfff /usr/lib/system/libdyld.dylib 0x9d793000 - 0x9d7aafff /usr/lib/system/libsystem_coretls.dylib 0x9dece000 - 0x9df21fff /usr/lib/libstdc++.6.dylib 0x9e5fd000 - 0x9e5fdfff /usr/lib/system/liblaunch.dylib 0x9e6ff000 - 0x9e6fffff /usr/lib/system/libsystem_blocks.dylib 0x9e905000 - 0x9e905fff /usr/lib/system/libunc.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Apr 2016 22:49:03	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	777,600	824,545	1.0604
22 Apr 2016 10:51:08	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	751,680	794,838	1.0574
22 Apr 2016 00:26:58	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	725,760	761,625	1.0494
15 Apr 2016 16:19:20	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	699,840	731,934	1.0459
15 Apr 2016 12:16:06	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	673,920	702,599	1.0426
15 Apr 2016 12:15:24	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	648,000	676,606	1.0441
15 Apr 2016 12:14:17	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	622,080	650,795	1.0462
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	596,160	625,136	1.0486
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	570,240	594,464	1.0425
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	544,320	564,792	1.0376
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	518,400	538,378	1.0385
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	492,480	511,945	1.0395
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	466,560	485,365	1.0403
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	440,640	458,747	1.0411
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	414,720	432,060	1.0418
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	388,800	405,499	1.0430
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	362,880	377,011	1.0389
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	336,960	346,362	1.0279
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	311,040	315,874	1.0155
07 Apr 2016 05:31:40	1363620	19418105	hadcm3n_xd9n_198012_480_374_010412561_0	285,120	285,732	1.0021