Task 16079828

Name	hadcm3n_o4om_1980_40_008402071_2
Workunit	8552927
Created	13 Nov 2013, 0:42:34 UTC
Sent	13 Nov 2013, 0:42:40 UTC
Report deadline	12 Feb 2014, 8:09:51 UTC
Received	18 Dec 2013, 1:54:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1257385
Run time	6 days 11 hours 39 min 6 sec
CPU time	6 days 7 hours 19 min 27 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2a9ba04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2ab7004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2ab7000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2a9ba04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2ab7004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2ab7000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2ab7004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2ab7000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2ab7004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x2ab7000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x1aa3a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(273,0xa08f11a8) malloc: * error for object 0x1aa3a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:23:07 (279): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:08 (279): No heartbeat from core client for 30 sec - exiting 18:23:09 (279): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(567,0xa19f21a8) malloc: * error for object 0x4bc9804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(567,0xa19f21a8) malloc: * error for object 0x4bc9800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(567,0xa19f21a8) malloc: * error for object 0x4bbfa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(567,0xa19f21a8) malloc: * error for object 0x4bbfa00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(567,0xa19f21a8) malloc: * error for object 0x4bbfa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(567,0xa19f21a8) malloc: * error for object 0x4bbfa00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(567,0xa19f21a8) malloc: * error for object 0x4bbfa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.1 build 13B42 Tue Dec 17 19:29:56 2013 Thread 0 Crashed: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fb28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/6/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9005b000 - 0x9005ffff /usr/lib/system/libmacho.dylib 0x914b0000 - 0x914b6fff /usr/lib/system/libunwind.dylib 0x914b7000 - 0x91549fff /usr/lib/system/libsystem_c.dylib 0x91555000 - 0x915a5fff /usr/lib/system/libcorecrypto.dylib 0x920fa000 - 0x9210cfff /usr/lib/system/libsystem_asl.dylib 0x924dc000 - 0x92504fff /usr/lib/system/libsystem_info.dylib 0x92831000 - 0x92836fff /usr/lib/system/libcompiler_rt.dylib 0x935a6000 - 0x935b1fff /usr/lib/system/libcommonCrypto.dylib 0x9363c000 - 0x93645fff /usr/lib/system/libsystem_notify.dylib 0x936e3000 - 0x936fbfff /usr/lib/system/libsystem_malloc.dylib 0x93964000 - 0x93965fff /usr/lib/system/libremovefile.dylib 0x95438000 - 0x95440fff /usr/lib/system/libsystem_dnssd.dylib 0x9589c000 - 0x958c7fff /usr/lib/system/libsystem_network.dylib 0x95bca000 - 0x95bcbfff /usr/lib/libSystem.B.dylib 0x95bda000 - 0x95be2fff /usr/lib/system/libcopyfile.dylib 0x95be3000 - 0x95be5fff /usr/lib/system/libsystem_configuration.dylib 0x96d25000 - 0x96d56fff /usr/lib/system/libsystem_m.dylib 0x990b5000 - 0x990b6fff /usr/lib/system/libsystem_sandbox.dylib 0x99655000 - 0x9965dfff /usr/lib/system/liblaunch.dylib 0x99a96000 - 0x99ae7fff /usr/lib/libstdc++.6.dylib 0x99aec000 - 0x99b0ffff /usr/lib/libc++abi.dylib 0x99b10000 - 0x99b14fff /usr/lib/system/libcache.dylib 0x99b72000 - 0x99b8afff /usr/lib/system/libdispatch.dylib 0x99fe3000 - 0x9a007fff /usr/lib/system/libxpc.dylib 0x9a0d3000 - 0x9a0d4fff /usr/lib/system/libunc.dylib 0x9a0d6000 - 0x9a0d9fff /usr/lib/system/libdyld.dylib 0x9a3a8000 - 0x9a3b6fff /usr/lib/libz.1.dylib 0x9aa64000 - 0x9aa66fff /usr/lib/system/libquarantine.dylib 0x9b012000 - 0x9b012fff /usr/lib/system/libkeymgr.dylib 0x9b1e8000 - 0x9b1edfff /usr/lib/system/libsystem_platform.dylib 0x9b30f000 - 0x9b32cfff /usr/lib/system/libsystem_kernel.dylib 0x9c105000 - 0x9c10cfff /usr/lib/system/libsystem_pthread.dylib 0x9c116000 - 0x9c117fff /usr/lib/system/libsystem_blocks.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Dec 2013 01:54:37	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	518,400	544,764	1.0509
17 Dec 2013 01:03:42	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	492,480	524,490	1.0650
15 Dec 2013 03:40:13	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	466,560	501,604	1.0751
13 Dec 2013 02:11:30	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	440,640	473,049	1.0735
11 Dec 2013 03:26:19	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	414,720	445,194	1.0735
10 Dec 2013 01:23:46	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	388,800	421,638	1.0845
08 Dec 2013 02:01:57	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	362,880	393,256	1.0837
06 Dec 2013 03:00:20	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	336,960	364,637	1.0821
04 Dec 2013 02:03:00	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	311,040	336,351	1.0814
02 Dec 2013 04:07:44	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	285,120	307,867	1.0798
01 Dec 2013 03:07:28	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	259,200	280,044	1.0804
29 Nov 2013 03:43:08	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	233,280	251,394	1.0776
28 Nov 2013 01:40:30	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	207,360	222,979	1.0753
26 Nov 2013 02:53:51	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	181,440	194,552	1.0723
24 Nov 2013 02:10:12	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	155,520	166,101	1.0680
22 Nov 2013 03:19:07	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	129,600	139,521	1.0766
20 Nov 2013 04:15:27	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	103,680	111,334	1.0738
19 Nov 2013 01:27:31	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	77,760	82,976	1.0671
17 Nov 2013 00:12:01	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	51,840	54,760	1.0563
15 Nov 2013 00:39:03	1257385	16079828	hadcm3n_o4om_1980_40_008402071_2	25,920	28,724	1.1082