Task 19133662

Name	hadcm3n_sdnk_198012_480_010222246_0
Workunit	10222246
Created	4 Dec 2015, 19:32:04 UTC
Sent	4 Dec 2015, 21:33:46 UTC
Report deadline	16 Nov 2016, 2:53:46 UTC
Received	10 Dec 2015, 12:17:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1381777
Run time	4 days 6 hours 4 min 50 sec
CPU time	3 days 19 hours 55 min 48 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	4.15 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x105b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x105b600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x403cc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x403cc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x403cc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x403cc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x2823604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x283ec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x283ec00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x837604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x1040004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x1010e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x1010e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x2801804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58028,0xa2eba000) malloc: * error for object 0x2801800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.1 build 15B42 Thu Dec 10 03:15:56 2015 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/9/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9043b000 - 0x904a1fff /usr/lib/system/libsystem_network.dylib 0x912b6000 - 0x912b8fff /usr/lib/system/libsystem_secinit.dylib 0x914b4000 - 0x914bdfff /usr/lib/system/libcopyfile.dylib 0x914be000 - 0x914d7fff /usr/lib/system/libsystem_asl.dylib 0x91672000 - 0x9167afff /usr/lib/system/libsystem_pthread.dylib 0x916a3000 - 0x9170afff /usr/lib/system/libcorecrypto.dylib 0x91a58000 - 0x91a62fff /usr/lib/system/libsystem_notify.dylib 0x91a63000 - 0x91a65fff /usr/lib/system/libquarantine.dylib 0x91a66000 - 0x91a89fff /usr/lib/libc++abi.dylib 0x91b4f000 - 0x91b55fff /usr/lib/system/libsystem_platform.dylib 0x91b56000 - 0x91ba9fff /usr/lib/libstdc++.6.dylib 0x91fae000 - 0x91fb1fff /usr/lib/system/libsystem_sandbox.dylib 0x929b3000 - 0x929b4fff /usr/lib/libSystem.B.dylib 0x92c03000 - 0x92c08fff /usr/lib/system/libcompiler_rt.dylib 0x93229000 - 0x93252fff /usr/lib/system/libsystem_info.dylib 0x93303000 - 0x93305fff /usr/lib/system/libsystem_configuration.dylib 0x959da000 - 0x959e8fff /usr/lib/libz.1.dylib 0x95d98000 - 0x95dc0fff /usr/lib/system/libxpc.dylib 0x9685a000 - 0x9685efff /usr/lib/system/libcache.dylib 0x96aeb000 - 0x96b15fff /usr/lib/system/libdispatch.dylib 0x97984000 - 0x97a19fff /usr/lib/system/libsystem_c.dylib 0x97a1a000 - 0x97a22fff /usr/lib/system/libsystem_dnssd.dylib 0x97a33000 - 0x97a53fff /usr/lib/system/libsystem_kernel.dylib 0x98ee4000 - 0x98ee4fff /usr/lib/system/libkeymgr.dylib 0x98f5c000 - 0x98f5cfff /usr/lib/system/libsystem_blocks.dylib 0x99681000 - 0x99681fff /usr/lib/system/liblaunch.dylib 0x99a43000 - 0x99a5cfff /usr/lib/system/libsystem_malloc.dylib 0x9a06a000 - 0x9a07ffff /usr/lib/system/libsystem_coretls.dylib 0x9a759000 - 0x9a762fff /usr/lib/system/libsystem_networkextension.dylib 0x9af8d000 - 0x9af93fff /usr/lib/system/libunwind.dylib 0x9b4d1000 - 0x9b4e2fff /usr/lib/system/libsystem_trace.dylib 0x9b4ed000 - 0x9b4edfff /usr/lib/system/libunc.dylib 0x9cdde000 - 0x9cddffff /usr/lib/system/libremovefile.dylib 0x9e2a5000 - 0x9e2a8fff /usr/lib/system/libdyld.dylib 0x9e665000 - 0x9e667fff /usr/lib/system/libsystem_coreservices.dylib 0x9e858000 - 0x9e863fff /usr/lib/system/libcommonCrypto.dylib 0x9eced000 - 0x9ed20fff /usr/lib/system/libsystem_m.dylib 0x9ed21000 - 0x9ed26fff /usr/lib/system/libmacho.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Dec 2015 12:21:12	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	259,200	330,946	1.2768
09 Dec 2015 06:23:58	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	233,280	297,714	1.2762
08 Dec 2015 19:23:12	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	207,360	264,724	1.2766
08 Dec 2015 08:29:50	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	181,440	232,165	1.2796
07 Dec 2015 22:09:03	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	155,520	199,459	1.2825
07 Dec 2015 11:25:38	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	129,600	165,346	1.2758
07 Dec 2015 00:20:33	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	103,680	131,922	1.2724
06 Dec 2015 14:02:10	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	77,760	99,021	1.2734
05 Dec 2015 21:40:38	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	51,840	65,777	1.2688
05 Dec 2015 12:20:50	1381777	19133662	hadcm3n_sdnk_198012_480_010222246_0	25,920	32,324	1.2471