Task 19526804

Name	hadcm3n_sabm_198012_480_375_010415150_1
Workunit	10415150
Created	9 Apr 2016, 16:25:26 UTC
Sent	9 Apr 2016, 16:26:20 UTC
Report deadline	22 Mar 2017, 21:46:20 UTC
Received	6 May 2016, 20:05:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1317052
Run time	20 days 4 hours 25 min 38 sec
CPU time	19 days 7 hours 19 min 10 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x702fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x704b204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x704b200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x6821004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x403c604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x6821004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x683c604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x683c600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x830604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(37464,0xa0fbf1d4) malloc: * error for object 0x2024604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1713 Mon May 2 16:33:32 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa48 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/10/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90008000 - 0x90045fff /usr/lib/system/libsystem_network.dylib 0x90671000 - 0x90672fff /usr/lib/system/libremovefile.dylib 0x90df7000 - 0x90e00fff /usr/lib/system/libcopyfile.dylib 0x90f21000 - 0x90f4afff /usr/lib/system/libsystem_info.dylib 0x90f4b000 - 0x90f4dfff /usr/lib/system/libsystem_secinit.dylib 0x9181f000 - 0x91821fff /usr/lib/system/libquarantine.dylib 0x91925000 - 0x9192afff /usr/lib/system/libmacho.dylib 0x925e1000 - 0x925e8fff /usr/lib/system/libunwind.dylib 0x92d59000 - 0x92d67fff /usr/lib/libz.1.dylib 0x92d6d000 - 0x92d93fff /usr/lib/system/libxpc.dylib 0x93347000 - 0x93348fff /usr/lib/system/libsystem_blocks.dylib 0x936dc000 - 0x93748fff /usr/lib/system/libcorecrypto.dylib 0x943b2000 - 0x943b4fff /usr/lib/system/libsystem_sandbox.dylib 0x947d4000 - 0x94807fff /usr/lib/system/libsystem_m.dylib 0x94d6a000 - 0x94d89fff /usr/lib/system/libsystem_kernel.dylib 0x94e8b000 - 0x94e90fff /usr/lib/system/libcompiler_rt.dylib 0x94ea7000 - 0x94ea8fff /usr/lib/libSystem.B.dylib 0x95b7f000 - 0x95b83fff /usr/lib/system/libcache.dylib 0x96287000 - 0x9628ffff /usr/lib/system/libsystem_dnssd.dylib 0x9669c000 - 0x966c3fff /usr/lib/system/libdispatch.dylib 0x968f9000 - 0x968f9fff /usr/lib/system/libkeymgr.dylib 0x9782c000 - 0x97845fff /usr/lib/system/libsystem_malloc.dylib 0x97846000 - 0x9786cfff /usr/lib/libc++abi.dylib 0x97abe000 - 0x97ac0fff /usr/lib/system/libsystem_coreservices.dylib 0x97b45000 - 0x97b45fff /usr/lib/system/libunc.dylib 0x97e26000 - 0x97e3dfff /usr/lib/system/libsystem_asl.dylib 0x98df9000 - 0x98e0afff /usr/lib/system/libsystem_coretls.dylib 0x98e25000 - 0x98e2bfff /usr/lib/system/libsystem_networkextension.dylib 0x996d5000 - 0x996dbfff /usr/lib/system/libsystem_trace.dylib 0x9a2e5000 - 0x9a2f1fff /usr/lib/system/libcommonCrypto.dylib 0x9a32d000 - 0x9a32ffff /usr/lib/system/libsystem_configuration.dylib 0x9a330000 - 0x9a338fff /usr/lib/system/libsystem_pthread.dylib 0x9afd2000 - 0x9b025fff /usr/lib/libstdc++.6.dylib 0x9b718000 - 0x9b718fff /usr/lib/system/liblaunch.dylib 0x9b88c000 - 0x9b88ffff /usr/lib/system/libdyld.dylib 0x9bd10000 - 0x9bda5fff /usr/lib/system/libsystem_c.dylib 0x9c489000 - 0x9c48ffff /usr/lib/system/libsystem_platform.dylib 0x9c490000 - 0x9c499fff /usr/lib/system/libsystem_notify.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 May 2016 20:10:32	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	1,036,800	1,667,947	1.6087
02 May 2016 06:06:01	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	1,010,880	1,621,218	1.6038
01 May 2016 16:06:03	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	984,960	1,577,546	1.6016
30 Apr 2016 19:12:38	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	959,040	1,534,803	1.6004
30 Apr 2016 02:31:18	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	933,120	1,491,816	1.5987
29 Apr 2016 11:57:48	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	907,200	1,450,002	1.5983
28 Apr 2016 21:56:17	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	881,280	1,407,048	1.5966
28 Apr 2016 07:48:54	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	855,360	1,363,274	1.5938
27 Apr 2016 17:57:59	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	829,440	1,320,591	1.5921
27 Apr 2016 02:55:38	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	803,520	1,278,869	1.5916
26 Apr 2016 15:56:40	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	777,600	1,229,103	1.5806
25 Apr 2016 23:37:51	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	751,680	1,188,022	1.5805
25 Apr 2016 11:05:50	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	725,760	1,148,195	1.5821
24 Apr 2016 21:56:15	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	699,840	1,107,823	1.5830
24 Apr 2016 08:38:19	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	673,920	1,066,759	1.5829
23 Apr 2016 20:20:14	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	648,000	1,025,827	1.5831
23 Apr 2016 07:28:49	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	622,080	984,843	1.5831
22 Apr 2016 17:59:58	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	596,160	944,140	1.5837
22 Apr 2016 04:45:31	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	570,240	903,188	1.5839
21 Apr 2016 19:24:30	1317052	19526804	hadcm3n_sabm_198012_480_375_010415150_1	544,320	862,778	1.5851