Task 19134226

Name	hadcm3n_sab8_198012_480_010222789_0
Workunit	10222789
Created	4 Dec 2015, 19:44:38 UTC
Sent	4 Dec 2015, 23:39:52 UTC
Report deadline	16 Nov 2016, 4:59:52 UTC
Received	19 Dec 2015, 22:03:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1371139
Run time	12 days 20 hours 23 min 21 sec
CPU time	11 days 8 hours 25 min 30 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	4.13 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x180dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x301c404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36211,0xa389c000) malloc: * error for object 0x301c400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(90703,0xa3556000) malloc: * error for object 0x2000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.2 build 15C50 Sat Dec 19 17:01:26 2015 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8faa8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/7/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x127000 - 0x17afff /usr/lib/libstdc++.6.dylib 0x90027000 - 0x90028fff /usr/lib/system/libremovefile.dylib 0x909dd000 - 0x909dffff /usr/lib/system/libquarantine.dylib 0x90d1f000 - 0x90d30fff /usr/lib/system/libsystem_trace.dylib 0x923ba000 - 0x9244ffff /usr/lib/system/libsystem_c.dylib 0x92936000 - 0x92960fff /usr/lib/system/libsystem_info.dylib 0x92961000 - 0x92981fff /usr/lib/system/libsystem_kernel.dylib 0x92987000 - 0x92989fff /usr/lib/system/libsystem_configuration.dylib 0x92cb7000 - 0x92cdffff /usr/lib/system/libxpc.dylib 0x9335e000 - 0x93391fff /usr/lib/system/libsystem_m.dylib 0x94aad000 - 0x94aadfff /usr/lib/system/libsystem_blocks.dylib 0x9578b000 - 0x9578bfff /usr/lib/system/libunc.dylib 0x957ee000 - 0x957f6fff /usr/lib/system/libsystem_pthread.dylib 0x96a7e000 - 0x96a7efff /usr/lib/system/libkeymgr.dylib 0x9718e000 - 0x97193fff /usr/lib/system/libmacho.dylib 0x97194000 - 0x97198fff /usr/lib/system/libcache.dylib 0x97680000 - 0x97680fff /usr/lib/system/liblaunch.dylib 0x9772f000 - 0x97739fff /usr/lib/system/libsystem_notify.dylib 0x98438000 - 0x98462fff /usr/lib/system/libdispatch.dylib 0x98e9e000 - 0x98ea1fff /usr/lib/system/libsystem_sandbox.dylib 0x99b27000 - 0x99b90fff /usr/lib/system/libsystem_network.dylib 0x99b91000 - 0x99b97fff /usr/lib/system/libunwind.dylib 0x99ce3000 - 0x99cfcfff /usr/lib/system/libsystem_asl.dylib 0x99cfd000 - 0x99d16fff /usr/lib/system/libsystem_malloc.dylib 0x9b933000 - 0x9b93efff /usr/lib/system/libcommonCrypto.dylib 0x9bae7000 - 0x9bae9fff /usr/lib/system/libsystem_coreservices.dylib 0x9bc8a000 - 0x9bc92fff /usr/lib/system/libsystem_dnssd.dylib 0x9bd01000 - 0x9bd0ffff /usr/lib/libz.1.dylib 0x9bdcc000 - 0x9bde3fff /usr/lib/system/libsystem_coretls.dylib 0x9ca7e000 - 0x9ca80fff /usr/lib/system/libsystem_secinit.dylib 0x9d10d000 - 0x9d130fff /usr/lib/libc++abi.dylib 0x9d6ba000 - 0x9d6bbfff /usr/lib/libSystem.B.dylib 0x9d993000 - 0x9d99cfff /usr/lib/system/libcopyfile.dylib 0x9da97000 - 0x9da9dfff /usr/lib/system/libsystem_platform.dylib 0x9daf2000 - 0x9dafbfff /usr/lib/system/libsystem_networkextension.dylib 0x9df09000 - 0x9df0cfff /usr/lib/system/libdyld.dylib 0x9e2bf000 - 0x9e2c4fff /usr/lib/system/libcompiler_rt.dylib 0x9e3db000 - 0x9e442fff /usr/lib/system/libcorecrypto.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Dec 2015 22:04:32	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	1,036,800	980,727	0.9459
19 Dec 2015 14:18:10	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	1,010,880	961,438	0.9511
19 Dec 2015 07:26:05	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	984,960	942,166	0.9566
19 Dec 2015 01:31:03	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	959,040	922,975	0.9624
18 Dec 2015 19:15:00	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	933,120	903,709	0.9685
18 Dec 2015 14:24:04	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	907,200	884,435	0.9749
18 Dec 2015 08:07:28	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	881,280	865,169	0.9817
18 Dec 2015 00:38:27	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	855,360	845,857	0.9889
17 Dec 2015 18:22:22	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	829,440	826,538	0.9965
17 Dec 2015 12:21:13	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	803,520	807,293	1.0047
17 Dec 2015 06:44:06	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	777,600	786,036	1.0108
16 Dec 2015 22:37:49	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	751,680	763,421	1.0156
16 Dec 2015 14:31:10	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	725,760	740,885	1.0208
16 Dec 2015 06:48:14	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	699,840	718,180	1.0262
15 Dec 2015 23:17:23	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	673,920	695,504	1.0320
15 Dec 2015 16:05:48	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	648,000	673,170	1.0388
15 Dec 2015 09:58:31	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	622,080	650,862	1.0463
15 Dec 2015 03:25:16	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	596,160	628,522	1.0543
14 Dec 2015 19:19:06	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	570,240	606,085	1.0629
13 Dec 2015 12:27:51	1371139	19134226	hadcm3n_sab8_198012_480_010222789_0	544,320	583,589	1.0721