Task 15692560

Name	hadcm3n_zkch_1960_40_008341214_0
Workunit	8492075
Created	29 Mar 2013, 4:26:59 UTC
Sent	29 Mar 2013, 4:42:32 UTC
Report deadline	28 Jun 2013, 12:09:43 UTC
Received	29 May 2013, 3:56:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1241328
Run time	8 days 14 hours 26 min 7 sec
CPU time	7 days 16 hours 54 min 55 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.93 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:20:32 (40322): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:33 (40322): No heartbeat from core client for 30 sec - exiting 09:20:34 (40322): No heartbeat from core client for 30 sec - exiting 09:20:35 (40322): No heartbeat from core client for 30 sec - exiting 09:20:36 (40322): No heartbeat from core client for 30 sec - exiting 09:20:37 (40322): No heartbeat from core client for 30 sec - exiting 09:20:38 (40322): No heartbeat from core client for 30 sec - exiting 09:20:39 (40322): No heartbeat from core client for 30 sec - exiting 09:20:40 (40322): No heartbeat from core client for 30 sec - exiting 09:20:41 (40322): No heartbeat from core client for 30 sec - exiting 09:20:42 (40322): No heartbeat from core client for 30 sec - exiting 09:20:43 (40322): No heartbeat from core client for 30 sec - exiting 09:20:44 (40322): No heartbeat from core client for 30 sec - exiting 09:20:45 (40322): No heartbeat from core client for 30 sec - exiting 09:20:46 (40322): No heartbeat from core client for 30 sec - exiting 09:20:47 (40322): No heartbeat from core client for 30 sec - exiting 09:20:48 (40322): No heartbeat from core client for 30 sec - exiting 09:20:49 (40322): No heartbeat from core client for 30 sec - exiting 09:20:50 (40322): No heartbeat from core client for 30 sec - exiting 09:20:51 (40322): No heartbeat from core client for 30 sec - exiting 09:20:52 (40322): No heartbeat from core client for 30 sec - exiting 09:20:53 (40322): No heartbeat from core client for 30 sec - exiting 09:20:54 (40322): No heartbeat from core client for 30 sec - exiting 09:20:55 (40322): No heartbeat from core client for 30 sec - exiting 09:20:56 (40322): No heartbeat from core client for 30 sec - exiting 09:20:57 (40322): No heartbeat from core client for 30 sec - exiting 09:20:58 (40322): No heartbeat from core client for 30 sec - exiting 09:20:59 (40322): No heartbeat from core client for 30 sec - exiting 09:21:00 (40322): No heartbeat from core client for 30 sec - exiting 09:21:01 (40322): No heartbeat from core client for 30 sec - exiting 09:21:02 (40322): No heartbeat from core client for 30 sec - exiting 09:21:03 (40322): No heartbeat from core client for 30 sec - exiting 09:21:04 (40322): No heartbeat from core client for 30 sec - exiting 09:21:05 (40322): No heartbeat from core client for 30 sec - exiting 09:21:06 (40322): No heartbeat from core client for 30 sec - exiting 09:21:07 (40322): No heartbeat from core client for 30 sec - exiting 09:21:08 (40322): No heartbeat from core client for 30 sec - exiting 09:21:09 (40322): No heartbeat from core client for 30 sec - exiting 09:21:10 (40322): No heartbeat from core client for 30 sec - exiting 09:21:11 (40322): No heartbeat from core client for 30 sec - exiting 09:21:12 (40322): No heartbeat from core client for 30 sec - exiting 09:21:13 (40322): No heartbeat from core client for 30 sec - exiting 09:21:14 (40322): No heartbeat from core client for 30 sec - exiting 09:21:15 (40322): No heartbeat from core client for 30 sec - exiting 09:21:16 (40322): No heartbeat from core client for 30 sec - exiting 09:21:17 (40322): No heartbeat from core client for 30 sec - exiting 09:21:18 (40322): No heartbeat from core client for 30 sec - exiting 09:21:19 (40322): No heartbeat from core client for 30 sec - exiting 09:21:20 (40322): No heartbeat from core client for 30 sec - exiting 09:21:21 (40322): No heartbeat from core client for 30 sec - exiting 09:23:04 (41593): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:51:46 (151): No heartbeat from core client for 30 sec - exiting 19:51:47 (151): No heartbeat from core client for 30 sec - exiting 19:51:48 (151): No heartbeat from core client for 30 sec - exiting 19:51:49 (151): No heartbeat from core client for 30 sec - exiting 19:51:50 (151): No heartbeat from core client for 30 sec - exiting 19:51:51 (151): No heartbeat from core client for 30 sec - exiting 19:51:52 (151): No heartbeat from core client for 30 sec - exiting 19:51:53 (151): No heartbeat from core client for 30 sec - exiting 19:51:54 (151): No heartbeat from core client for 30 sec - exiting 19:51:55 (151): No heartbeat from core client for 30 sec - exiting 19:51:56 (151): No heartbeat from core client for 30 sec - exiting 19:51:57 (151): No heartbeat from core client for 30 sec - exiting 19:51:58 (151): No heartbeat from core client for 30 sec - exiting 19:51:59 (151): No heartbeat from core client for 30 sec - exiting 19:52:00 (151): No heartbeat from core client for 30 sec - exiting 19:52:01 (151): No heartbeat from core client for 30 sec - exiting 19:52:02 (151): No heartbeat from core client for 30 sec - exiting 19:52:03 (151): No heartbeat from core client for 30 sec - exiting 19:52:04 (151): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L31a Tue May 28 20:53:32 2013 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. 0 hadcm3n_6.07_i686-apple-darwin 0x00074953 version + 61229 1 hadcm3n_6.07_i686-apple-darwin 0x0006a936 version + 20240 2 libSystem.B.dylib 0x90a341cb _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 hadcm3n_6.07_i686-apple-darwin 0x00020602 ncx_getn_float_float + 34 5 hadcm3n_6.07_i686-apple-darwin 0x00027264 fill_NC_var + 17204 6 hadcm3n_6.07_i686-apple-darwin 0x000294e3 fill_NC_var + 26035 7 hadcm3n_6.07_i686-apple-darwin 0x0002f733 nc_get_var_float + 355 8 hadcm3n_6.07_i686-apple-darwin 0x0000b927 _Z12annual_cyclePKSt6vectorISsSaISsEEPKcii + 3177 9 hadcm3n_6.07_i686-apple-darwin 0x0000d36b _Z12decadalMeansiPKc + 957 10 hadcm3n_6.07_i686-apple-darwin 0x000067ff _Z9doCM3Procv + 185 11 hadcm3n_6.07_i686-apple-darwin 0x0000791c _Z8mainLoopv + 410 12 hadcm3n_6.07_i686-apple-darwin 0x000087c7 _Z6workerv + 2989 13 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 14 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x909fc7c2 ecx: 0xbff9019c edx: 0x909c8166 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff901d8 esp: 0xbff9019c ss: 0x0000001f efl: 0x00000206 eip: 0x909c8166 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/2/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90735000 - 0x90743fff /usr/lib/libz.1.dylib 0x909c7000 - 0x90b2efff /usr/lib/libSystem.B.dylib 0x9655f000 - 0x96563fff /usr/lib/system/libmathCommon.A.dylib 0x965cd000 - 0x965d4fff /usr/lib/libgcc_s.1.dylib 0x96c5e000 - 0x96cbbfff /usr/lib/libstdc++.6.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 May 2013 04:01:17	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	518,400	665,691	1.2841
23 May 2013 14:55:11	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	492,480	632,389	1.2841
21 May 2013 14:50:18	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	466,560	599,019	1.2839
15 May 2013 19:09:42	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	440,640	565,648	1.2837
12 May 2013 21:43:18	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	414,720	532,493	1.2840
11 May 2013 21:16:41	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	388,800	498,563	1.2823
10 May 2013 14:40:20	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	362,880	465,164	1.2819
08 May 2013 15:50:42	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	336,960	431,603	1.2809
06 May 2013 03:37:08	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	311,040	398,475	1.2811
01 May 2013 18:53:36	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	285,120	365,094	1.2805
28 Apr 2013 21:49:00	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	259,200	332,002	1.2809
27 Apr 2013 06:02:09	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	233,280	298,996	1.2817
24 Apr 2013 18:17:55	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	207,360	265,814	1.2819
20 Apr 2013 21:43:32	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	181,440	232,204	1.2798
17 Apr 2013 23:11:12	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	155,520	198,423	1.2759
16 Apr 2013 16:41:17	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	129,600	165,266	1.2752
11 Apr 2013 18:05:12	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	103,680	132,331	1.2763
08 Apr 2013 14:55:26	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	77,760	99,273	1.2767
06 Apr 2013 16:41:19	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	51,840	66,078	1.2747
03 Apr 2013 19:12:39	1241328	15692560	hadcm3n_zkch_1960_40_008341214_0	25,920	33,040	1.2747