Task 19525038

Name	hadcm3n_xdis_198012_480_374_010412484_1
Workunit	10412484
Created	8 Apr 2016, 15:40:31 UTC
Sent	8 Apr 2016, 15:40:43 UTC
Report deadline	21 Mar 2017, 21:00:43 UTC
Received	24 Apr 2016, 4:18:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1323852
Run time	10 days 1 hours 51 min 20 sec
CPU time	9 days 11 hours 16 min 45 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	4.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x4027604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x4027600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x302f004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x4027604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x830a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x4027604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x302f004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x4027604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x830a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x182c604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x182c600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x4000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35146,0xa31e6000) malloc: * error for object 0x4001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(48580,0xa31e6000) malloc: * error for object 0x858204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48580,0xa31e6000) malloc: * error for object 0x83a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(60854,0xa31e6000) malloc: * error for object 0x2000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(60854,0xa31e6000) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(60854,0xa31e6000) malloc: * error for object 0x804e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(69345,0xa31e6000) malloc: * error for object 0x282e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(71493,0xa31e6000) malloc: * error for object 0x382de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(63350,0xa31e6000) malloc: * error for object 0x203ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(63350,0xa31e6000) malloc: * error for object 0x203ac00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(63350,0xa31e6000) malloc: * error for object 0x201f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(63350,0xa31e6000) malloc: * error for object 0x203ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(63350,0xa31e6000) malloc: * error for object 0x203ac00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(63350,0xa31e6000) malloc: * error for object 0x203ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(63350,0xa31e6000) malloc: * error for object 0x203ac00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 hadcm3n_6.07_i686-apple-darwin(63350,0xa31e6000) malloc: * error for object 0x282ce04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(63350,0xa31e6000) malloc: * error for object 0x282ce00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Sun Apr 24 00:16:48 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f9f8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x127000 - 0x17afff /usr/lib/libstdc++.6.dylib 0x903df000 - 0x903e1fff /usr/lib/system/libsystem_coreservices.dylib 0x918b9000 - 0x918dafff /usr/lib/system/libsystem_kernel.dylib 0x927ac000 - 0x927dffff /usr/lib/system/libsystem_m.dylib 0x928f6000 - 0x928f6fff /usr/lib/system/libsystem_blocks.dylib 0x92a63000 - 0x92a68fff /usr/lib/system/libmacho.dylib 0x92b6a000 - 0x92b73fff /usr/lib/system/libcopyfile.dylib 0x92b7d000 - 0x92b85fff /usr/lib/system/libsystem_pthread.dylib 0x92c8c000 - 0x92d21fff /usr/lib/system/libsystem_c.dylib 0x92d22000 - 0x92d24fff /usr/lib/system/libsystem_secinit.dylib 0x930b8000 - 0x930e2fff /usr/lib/system/libsystem_info.dylib 0x935c2000 - 0x935c3fff /usr/lib/system/libremovefile.dylib 0x945be000 - 0x94625fff /usr/lib/system/libcorecrypto.dylib 0x9606e000 - 0x96070fff /usr/lib/system/libsystem_configuration.dylib 0x961c3000 - 0x961c7fff /usr/lib/system/libcache.dylib 0x964ad000 - 0x964bbfff /usr/lib/libz.1.dylib 0x9657a000 - 0x9657ffff /usr/lib/system/libcompiler_rt.dylib 0x96582000 - 0x96585fff /usr/lib/system/libdyld.dylib 0x96782000 - 0x9678cfff /usr/lib/system/libsystem_notify.dylib 0x9678d000 - 0x967b7fff /usr/lib/system/libdispatch.dylib 0x97ece000 - 0x97ecefff /usr/lib/system/liblaunch.dylib 0x97ecf000 - 0x97ee0fff /usr/lib/system/libsystem_trace.dylib 0x97f0d000 - 0x97f35fff /usr/lib/system/libxpc.dylib 0x99fd6000 - 0x99feffff /usr/lib/system/libsystem_asl.dylib 0x9a036000 - 0x9a059fff /usr/lib/libc++abi.dylib 0x9c0c0000 - 0x9c0d7fff /usr/lib/system/libsystem_coretls.dylib 0x9c3e0000 - 0x9c3e6fff /usr/lib/system/libsystem_platform.dylib 0x9d466000 - 0x9d467fff /usr/lib/libSystem.B.dylib 0x9d91f000 - 0x9d925fff /usr/lib/system/libunwind.dylib 0x9d9dd000 - 0x9da4bfff /usr/lib/system/libsystem_network.dylib 0x9da4c000 - 0x9da4ffff /usr/lib/system/libsystem_sandbox.dylib 0x9da54000 - 0x9da6dfff /usr/lib/system/libsystem_malloc.dylib 0x9ea72000 - 0x9ea7afff /usr/lib/system/libsystem_dnssd.dylib 0x9ea7b000 - 0x9ea86fff /usr/lib/system/libcommonCrypto.dylib 0x9eaec000 - 0x9eaecfff /usr/lib/system/libunc.dylib 0x9eaed000 - 0x9eaf6fff /usr/lib/system/libsystem_networkextension.dylib 0x9ebf2000 - 0x9ebf4fff /usr/lib/system/libquarantine.dylib 0x9ebfc000 - 0x9ebfcfff /usr/lib/system/libkeymgr.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Apr 2016 04:21:19	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	777,600	818,203	1.0522
23 Apr 2016 11:39:48	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	751,680	792,698	1.0546
23 Apr 2016 00:49:21	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	725,760	767,110	1.0570
22 Apr 2016 07:28:32	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	699,840	741,178	1.0591
21 Apr 2016 21:19:11	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	673,920	715,807	1.0622
21 Apr 2016 07:28:10	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	648,000	692,015	1.0679
20 Apr 2016 22:31:35	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	622,080	668,160	1.0741
20 Apr 2016 10:05:08	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	596,160	644,267	1.0807
20 Apr 2016 01:58:39	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	570,240	622,191	1.0911
19 Apr 2016 12:45:01	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	544,320	599,636	1.1016
18 Apr 2016 13:05:55	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	518,400	568,869	1.0974
18 Apr 2016 01:35:31	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	492,480	535,827	1.0880
17 Apr 2016 15:40:42	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	466,560	506,017	1.0846
17 Apr 2016 04:36:48	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	440,640	475,469	1.0790
16 Apr 2016 19:59:05	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	414,720	447,325	1.0786
16 Apr 2016 12:00:33	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	388,800	420,560	1.0817
16 Apr 2016 00:50:27	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	362,880	393,237	1.0837
15 Apr 2016 15:18:39	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	336,960	366,514	1.0877
15 Apr 2016 12:16:38	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	311,040	342,443	1.1010
15 Apr 2016 12:15:30	1323852	19525038	hadcm3n_xdis_198012_480_374_010412484_1	285,120	316,335	1.1095