Task 14877350

Name	hadcm3n_206b_1980_40_008000071_3
Workunit	8155185
Created	8 Jul 2012, 15:39:58 UTC
Sent	8 Jul 2012, 15:40:21 UTC
Report deadline	7 Oct 2012, 23:07:32 UTC
Received	17 Jul 2012, 13:03:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1244925
Run time	7 days 21 hours 22 min 27 sec
CPU time	7 days 10 hours 18 min 11 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x1098204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x1098200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x287cc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x1098204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x1098200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x387be04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x287cc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x87f004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x107cc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x486bc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x486bc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x384e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x384e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x205b204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x205b200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(89606,0xac0ec2c0) malloc: * error for object 0x205b200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=89616, selfPID=89616, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(92595,0xac0ec2c0) malloc: * error for object 0xbf3400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.4 build 11E53 Tue Jul 17 08:20:15 2012 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90005000 - 0x90013fff /usr/lib/system/libdispatch.dylib 0x90a7c000 - 0x90b47fff /usr/lib/system/libsystem_c.dylib 0x90bd8000 - 0x90bf6fff /usr/lib/system/libsystem_kernel.dylib 0x90bf7000 - 0x90c0dfff /usr/lib/system/libxpc.dylib 0x914fa000 - 0x91502fff /usr/lib/system/liblaunch.dylib 0x9193e000 - 0x91947fff /usr/lib/libc++abi.dylib 0x92b00000 - 0x92b01fff /usr/lib/system/libunc.dylib 0x932e2000 - 0x932e3fff /usr/lib/system/libquarantine.dylib 0x93eb2000 - 0x93eb5fff /usr/lib/system/libmathCommon.A.dylib 0x94efd000 - 0x94f0bfff /usr/lib/libz.1.dylib 0x951ae000 - 0x951affff /usr/lib/system/libsystem_blocks.dylib 0x97825000 - 0x9782dfff /usr/lib/system/libunwind.dylib 0x979be000 - 0x979edfff /usr/lib/system/libsystem_info.dylib 0x984e6000 - 0x984eafff /usr/lib/system/libcache.dylib 0x9878e000 - 0x987bcfff /usr/lib/libSystem.B.dylib 0x98839000 - 0x98839fff /usr/lib/system/libkeymgr.dylib 0x9883a000 - 0x9889cfff /usr/lib/libstdc++.6.dylib 0x993da000 - 0x993e1fff /usr/lib/system/libsystem_dnssd.dylib 0x9941b000 - 0x9941bfff /usr/lib/system/libdnsinfo.dylib 0x9a152000 - 0x9a153fff /usr/lib/system/libsystem_sandbox.dylib 0x9b283000 - 0x9b28afff /usr/lib/system/libsystem_notify.dylib 0x9b2d7000 - 0x9b2dbfff /usr/lib/system/libsystem_network.dylib 0x9b6df000 - 0x9b6e0fff /usr/lib/system/libremovefile.dylib 0x9b893000 - 0x9b89bfff /usr/lib/system/libcopyfile.dylib 0x9c806000 - 0x9c849fff /usr/lib/system/libcommonCrypto.dylib 0x9cc8d000 - 0x9cc92fff /usr/lib/system/libmacho.dylib 0x9cdf6000 - 0x9cdf8fff /usr/lib/system/libdyld.dylib 0x9cef4000 - 0x9cef7fff /usr/lib/system/libcompiler_rt.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Jul 2012 10:05:35	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	777,600	634,271	0.8157
17 Jul 2012 03:14:12	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	751,680	611,872	0.8140
16 Jul 2012 18:29:16	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	725,760	589,469	0.8122
16 Jul 2012 09:06:32	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	699,840	567,138	0.8104
16 Jul 2012 02:09:53	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	673,920	545,328	0.8092
15 Jul 2012 20:07:51	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	648,000	523,714	0.8082
15 Jul 2012 13:48:13	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	622,080	502,171	0.8072
15 Jul 2012 07:42:06	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	596,160	482,141	0.8087
15 Jul 2012 02:41:11	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	570,240	463,924	0.8136
14 Jul 2012 20:19:09	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	544,320	442,441	0.8128
14 Jul 2012 11:50:34	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	518,400	420,877	0.8119
14 Jul 2012 05:14:21	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	492,480	398,415	0.8090
13 Jul 2012 22:37:57	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	466,560	376,563	0.8071
13 Jul 2012 16:16:08	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	440,640	354,741	0.8051
13 Jul 2012 09:54:43	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	414,720	332,903	0.8027
13 Jul 2012 02:53:25	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	388,800	311,120	0.8002
12 Jul 2012 18:27:43	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	362,880	289,472	0.7977
12 Jul 2012 11:07:16	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	336,960	268,811	0.7978
12 Jul 2012 05:06:06	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	311,040	250,636	0.8058
11 Jul 2012 23:59:37	1191540	14877350	hadcm3n_206b_1980_40_008000071_3	285,120	232,678	0.8161