Task 16142236

Name	hadcm3n_82gr_1980_40_008461134_3
Workunit	8611990
Created	11 Dec 2013, 23:18:55 UTC
Sent	11 Dec 2013, 23:18:57 UTC
Report deadline	13 Mar 2014, 6:46:08 UTC
Received	24 Jan 2014, 16:33:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1267789
Run time	7 days 8 hours 33 min 13 sec
CPU time	7 days 3 hours 38 min 53 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.71 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(1099,0xa03f41a8) malloc: * error for object 0x38bea04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1099,0xa03f41a8) malloc: * error for object 0x38bea00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1099,0xa03f41a8) malloc: * error for object 0x38bea04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1099,0xa03f41a8) malloc: * error for object 0x38bea00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1099,0xa03f41a8) malloc: * error for object 0x209e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(4925,0xa03f41a8) malloc: * error for object 0x498ae04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4925,0xa03f41a8) malloc: * error for object 0x498ae00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4925,0xa03f41a8) malloc: * error for object 0x1956804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.1 build 13B42 Fri Jan 24 04:55:57 2014 Thread 0 Crashed: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fe08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/8/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90235000 - 0x902c7fff /usr/lib/system/libsystem_c.dylib 0x902fe000 - 0x90301fff /usr/lib/system/libdyld.dylib 0x9048f000 - 0x9049dfff /usr/lib/libz.1.dylib 0x9054d000 - 0x90578fff /usr/lib/system/libsystem_network.dylib 0x90886000 - 0x908d6fff /usr/lib/system/libcorecrypto.dylib 0x90b7f000 - 0x90b8afff /usr/lib/system/libcommonCrypto.dylib 0x90bc1000 - 0x90bc8fff /usr/lib/system/libsystem_pthread.dylib 0x90bc9000 - 0x90bedfff /usr/lib/system/libxpc.dylib 0x90cd5000 - 0x90cdafff /usr/lib/system/libsystem_platform.dylib 0x912c8000 - 0x912d1fff /usr/lib/system/libsystem_notify.dylib 0x919a5000 - 0x919aafff /usr/lib/system/libcompiler_rt.dylib 0x91f19000 - 0x91f36fff /usr/lib/system/libsystem_kernel.dylib 0x931b9000 - 0x931dcfff /usr/lib/libc++abi.dylib 0x9324d000 - 0x9324efff /usr/lib/system/libsystem_blocks.dylib 0x9388b000 - 0x93893fff /usr/lib/system/libcopyfile.dylib 0x94a1d000 - 0x94a1dfff /usr/lib/system/libkeymgr.dylib 0x94af4000 - 0x94af5fff /usr/lib/system/libremovefile.dylib 0x94ec1000 - 0x94ec2fff /usr/lib/system/libunc.dylib 0x94f5b000 - 0x94f5cfff /usr/lib/libSystem.B.dylib 0x95f44000 - 0x95f5cfff /usr/lib/system/libsystem_malloc.dylib 0x95fd4000 - 0x95fdcfff /usr/lib/system/libsystem_dnssd.dylib 0x962d5000 - 0x962e7fff /usr/lib/system/libsystem_asl.dylib 0x962e8000 - 0x962f0fff /usr/lib/system/liblaunch.dylib 0x96929000 - 0x9692dfff /usr/lib/system/libcache.dylib 0x97303000 - 0x97334fff /usr/lib/system/libsystem_m.dylib 0x97335000 - 0x97339fff /usr/lib/system/libmacho.dylib 0x97402000 - 0x9742afff /usr/lib/system/libsystem_info.dylib 0x980cc000 - 0x980cefff /usr/lib/system/libquarantine.dylib 0x98524000 - 0x9853cfff /usr/lib/system/libdispatch.dylib 0x9960f000 - 0x99610fff /usr/lib/system/libsystem_sandbox.dylib 0x9a4b1000 - 0x9a4b3fff /usr/lib/system/libsystem_configuration.dylib 0x9a742000 - 0x9a748fff /usr/lib/system/libunwind.dylib 0x9ad14000 - 0x9ad65fff /usr/lib/libstdc++.6.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jan 2014 16:37:55	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	518,400	609,310	1.1754
19 Jan 2014 13:21:06	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	492,480	578,844	1.1754
19 Jan 2014 02:43:52	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	466,560	546,447	1.1712
17 Jan 2014 18:48:39	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	440,640	515,123	1.1690
13 Jan 2014 06:57:28	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	414,720	483,215	1.1652
12 Jan 2014 11:29:09	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	388,800	452,214	1.1631
12 Jan 2014 02:21:56	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	362,880	422,111	1.1632
11 Jan 2014 11:13:16	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	336,960	392,495	1.1648
10 Jan 2014 17:10:42	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	311,040	362,963	1.1669
10 Jan 2014 05:46:35	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	285,120	332,058	1.1646
07 Jan 2014 06:32:25	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	259,200	302,390	1.1666
06 Jan 2014 05:12:40	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	233,280	271,315	1.1630
05 Jan 2014 11:25:32	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	207,360	241,066	1.1625
05 Jan 2014 01:13:19	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	181,440	210,360	1.1594
02 Jan 2014 07:25:15	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	155,520	180,405	1.1600
01 Jan 2014 10:29:45	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	129,600	150,919	1.1645
01 Jan 2014 01:37:37	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	103,680	121,034	1.1674
30 Dec 2013 06:21:22	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	77,760	91,980	1.1829
29 Dec 2013 20:59:10	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	51,840	62,809	1.2116
29 Dec 2013 07:02:01	1267789	16142236	hadcm3n_82gr_1980_40_008461134_3	25,920	31,683	1.2223