Task 13937315

Name	hadam3p_eu_80i0_1999_1_007686248_0
Workunit	7841356
Created	19 Jan 2012, 1:14:47 UTC
Sent	19 Jan 2012, 1:14:54 UTC
Report deadline	31 Dec 2012, 6:34:54 UTC
Received	1 Feb 2012, 4:35:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1179592
Run time	5 days 22 hours 46 min 51 sec
CPU time	5 days 2 hours 40 min 15 sec
Validate state	Invalid
Credit	1,591.88
Device peak FLOPS	1.37 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 02:19:48 (18158): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:05:17 (18531): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:04 (19602): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:31:58 (19820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:50 (19996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:32 (20177): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:27 (20405): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:54 (20584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:34 (21112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:31 (21288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:32 (21288): No heartbeat from core client for 30 sec - exiting 14:32:33 (21288): No heartbeat from core client for 30 sec - exiting 14:32:34 (21288): No heartbeat from core client for 30 sec - exiting 14:32:35 (21288): No heartbeat from core client for 30 sec - exiting 14:32:36 (21288): No heartbeat from core client for 30 sec - exiting 14:32:37 (21288): No heartbeat from core client for 30 sec - exiting 14:32:38 (21288): No heartbeat from core client for 30 sec - exiting 14:32:39 (21288): No heartbeat from core client for 30 sec - exiting 14:32:40 (21288): No heartbeat from core client for 30 sec - exiting 14:32:41 (21288): No heartbeat from core client for 30 sec - exiting 14:32:42 (21288): No heartbeat from core client for 30 sec - exiting 14:32:43 (21288): No heartbeat from core client for 30 sec - exiting 14:46:13 (21501): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:49:22 (21688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:04:14 (21860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:49 (22044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:08 (22296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:56 (22468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:12:47 (22753): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:12:48 (22753): No heartbeat from core client for 30 sec - exiting 02:12:49 (22753): No heartbeat from core client for 30 sec - exiting 02:12:50 (22753): No heartbeat from core client for 30 sec - exiting 02:12:51 (22753): No heartbeat from core client for 30 sec - exiting 20:44:05 (23025): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:33:04 (24352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:46:43 (24612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:46:44 (24612): No heartbeat from core client for 30 sec - exiting 01:46:45 (24612): No heartbeat from core client for 30 sec - exiting 01:46:46 (24612): No heartbeat from core client for 30 sec - exiting 01:46:47 (24612): No heartbeat from core client for 30 sec - exiting 01:46:48 (24612): No heartbeat from core client for 30 sec - exiting 01:46:49 (24612): No heartbeat from core client for 30 sec - exiting 01:46:50 (24612): No heartbeat from core client for 30 sec - exiting 01:46:51 (24612): No heartbeat from core client for 30 sec - exiting 01:46:52 (24612): No heartbeat from core client for 30 sec - exiting 01:46:53 (24612): No heartbeat from core client for 30 sec - exiting 01:46:54 (24612): No heartbeat from core client for 30 sec - exiting 01:46:55 (24612): No heartbeat from core client for 30 sec - exiting 01:46:56 (24612): No heartbeat from core client for 30 sec - exiting 01:46:57 (24612): No heartbeat from core client for 30 sec - exiting 01:46:58 (24612): No heartbeat from core client for 30 sec - exiting 01:46:59 (24612): No heartbeat from core client for 30 sec - exiting 01:47:00 (24612): No heartbeat from core client for 30 sec - exiting 01:47:01 (24612): No heartbeat from core client for 30 sec - exiting 01:47:02 (24612): No heartbeat from core client for 30 sec - exiting 01:47:03 (24612): No heartbeat from core client for 30 sec - exiting 11:09:04 (24791): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:05 (24791): No heartbeat from core client for 30 sec - exiting 11:09:06 (24791): No heartbeat from core client for 30 sec - exiting 11:11:18 (25333): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:33 (25503): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:09:39 (25758): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:45:35 (25995): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:03 (26224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:11 (26452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:10 (26622): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:52 (26811): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:59 (26981): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:09 (27182): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:16 (27352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:17 (27352): No heartbeat from core client for 30 sec - exiting 22:19:18 (27352): No heartbeat from core client for 30 sec - exiting 22:19:19 (27352): No heartbeat from core client for 30 sec - exiting 22:19:20 (27352): No heartbeat from core client for 30 sec - exiting 22:19:21 (27352): No heartbeat from core client for 30 sec - exiting 22:19:22 (27352): No heartbeat from core client for 30 sec - exiting 22:19:23 (27352): No heartbeat from core client for 30 sec - exiting 22:19:24 (27352): No heartbeat from core client for 30 sec - exiting 22:19:25 (27352): No heartbeat from core client for 30 sec - exiting 22:19:26 (27352): No heartbeat from core client for 30 sec - exiting 22:19:27 (27352): No heartbeat from core client for 30 sec - exiting 22:19:28 (27352): No heartbeat from core client for 30 sec - exiting 22:19:29 (27352): No heartbeat from core client for 30 sec - exiting 22:19:30 (27352): No heartbeat from core client for 30 sec - exiting 22:19:31 (27352): No heartbeat from core client for 30 sec - exiting 22:19:32 (27352): No heartbeat from core client for 30 sec - exiting 22:19:33 (27352): No heartbeat from core client for 30 sec - exiting 22:19:34 (27352): No heartbeat from core client for 30 sec - exiting 22:19:35 (27352): No heartbeat from core client for 30 sec - exiting 22:19:36 (27352): No heartbeat from core client for 30 sec - exiting 22:19:37 (27352): No heartbeat from core client for 30 sec - exiting 22:19:38 (27352): No heartbeat from core client for 30 sec - exiting 22:19:39 (27352): No heartbeat from core client for 30 sec - exiting 22:19:40 (27352): No heartbeat from core client for 30 sec - exiting 22:19:41 (27352): No heartbeat from core client for 30 sec - exiting 22:19:42 (27352): No heartbeat from core client for 30 sec - exiting 22:19:43 (27352): No heartbeat from core client for 30 sec - exiting 22:19:44 (27352): No heartbeat from core client for 30 sec - exiting 22:19:45 (27352): No heartbeat from core client for 30 sec - exiting 22:19:46 (27352): No heartbeat from core client for 30 sec - exiting 22:19:47 (27352): No heartbeat from core client for 30 sec - exiting 22:19:48 (27352): No heartbeat from core client for 30 sec - exiting 22:19:49 (27352): No heartbeat from core client for 30 sec - exiting 22:19:50 (27352): No heartbeat from core client for 30 sec - exiting 22:19:51 (27352): No heartbeat from core client for 30 sec - exiting 22:19:52 (27352): No heartbeat from core client for 30 sec - exiting 22:30:25 (27531): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:53 (27705): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:06 (27941): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:11:33 (28185): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:21:01 (28360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:17:28 (28592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:20:06 (28790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:18:56 (28962): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:39 (29197): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:06 (29592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:31 (29766): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:32 (29766): No heartbeat from core client for 30 sec - exiting 10:32:33 (29766): No heartbeat from core client for 30 sec - exiting 10:32:34 (29766): No heartbeat from core client for 30 sec - exiting 10:32:35 (29766): No heartbeat from core client for 30 sec - exiting 10:32:36 (29766): No heartbeat from core client for 30 sec - exiting 10:32:37 (29766): No heartbeat from core client for 30 sec - exiting 10:32:38 (29766): No heartbeat from core client for 30 sec - exiting 10:32:39 (29766): No heartbeat from core client for 30 sec - exiting 10:32:40 (29766): No heartbeat from core client for 30 sec - exiting 10:32:41 (29766): No heartbeat from core client for 30 sec - exiting 10:37:50 (29958): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:22 (30128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:33 (30301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:13 (30471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:14 (30471): No heartbeat from core client for 30 sec - exiting 12:21:15 (30471): No heartbeat from core client for 30 sec - exiting 12:21:16 (30471): No heartbeat from core client for 30 sec - exiting 12:21:17 (30471): No heartbeat from core client for 30 sec - exiting 12:21:18 (30471): No heartbeat from core client for 30 sec - exiting 12:21:19 (30471): No heartbeat from core client for 30 sec - exiting 12:21:20 (30471): No heartbeat from core client for 30 sec - exiting 12:21:21 (30471): No heartbeat from core client for 30 sec - exiting 12:21:22 (30471): No heartbeat from core client for 30 sec - exiting 12:21:23 (30471): No heartbeat from core client for 30 sec - exiting 12:21:24 (30471): No heartbeat from core client for 30 sec - exiting 12:21:25 (30471): No heartbeat from core client for 30 sec - exiting 12:21:26 (30471): No heartbeat from core client for 30 sec - exiting 12:21:27 (30471): No heartbeat from core client for 30 sec - exiting 12:21:28 (30471): No heartbeat from core client for 30 sec - exiting 12:21:29 (30471): No heartbeat from core client for 30 sec - exiting 12:21:30 (30471): No heartbeat from core client for 30 sec - exiting 12:21:31 (30471): No heartbeat from core client for 30 sec - exiting 12:21:32 (30471): No heartbeat from core client for 30 sec - exiting 12:21:33 (30471): No heartbeat from core client for 30 sec - exiting 12:21:34 (30471): No heartbeat from core client for 30 sec - exiting 12:21:35 (30471): No heartbeat from core client for 30 sec - exiting 12:21:36 (30471): No heartbeat from core client for 30 sec - exiting 12:23:20 (30744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:31 (30918): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:52 (31100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:19 (31785): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:20 (31785): No heartbeat from core client for 30 sec - exiting 02:25:21 (31785): No heartbeat from core client for 30 sec - exiting 02:25:22 (31785): No heartbeat from core client for 30 sec - exiting 02:25:23 (31785): No heartbeat from core client for 30 sec - exiting 02:25:24 (31785): No heartbeat from core client for 30 sec - exiting 02:25:25 (31785): No heartbeat from core client for 30 sec - exiting 02:25:26 (31785): No heartbeat from core client for 30 sec - exiting 02:25:27 (31785): No heartbeat from core client for 30 sec - exiting 02:25:28 (31785): No heartbeat from core client for 30 sec - exiting 02:25:29 (31785): No heartbeat from core client for 30 sec - exiting 02:25:30 (31785): No heartbeat from core client for 30 sec - exiting 02:25:31 (31785): No heartbeat from core client for 30 sec - exiting 02:27:28 (31964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:26 (32132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:41:06 (32304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:50 (32472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:51 (32472): No heartbeat from core client for 30 sec - exiting 03:39:52 (32472): No heartbeat from core client for 30 sec - exiting 03:39:53 (32472): No heartbeat from core client for 30 sec - exiting 03:39:54 (32472): No heartbeat from core client for 30 sec - exiting 03:39:55 (32472): No heartbeat from core client for 30 sec - exiting 03:39:56 (32472): No heartbeat from core client for 30 sec - exiting 03:39:57 (32472): No heartbeat from core client for 30 sec - exiting 03:39:58 (32472): No heartbeat from core client for 30 sec - exiting 03:39:59 (32472): No heartbeat from core client for 30 sec - exiting 03:40:00 (32472): No heartbeat from core client for 30 sec - exiting 04:36:16 (32662): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_80i0_1999_1_007686248_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_80i0_1999_1_007686248_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_80i0_1999_1_007686248_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_80i0_1999_1_007686248_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Feb 2012 02:07:49	1179592	13937315	hadam3p_eu_80i0_1999_1_007686248_0	92,279	404,110	4.3792
01 Feb 2012 02:07:49	1179592	13937315	hadam3p_eu_80i0_1999_1_007686248_0	92,256	403,391	4.3725
30 Jan 2012 13:12:59	1179592	13937315	hadam3p_eu_80i0_1999_1_007686248_0	80,736	353,555	4.3791
29 Jan 2012 18:46:52	1179592	13937315	hadam3p_eu_80i0_1999_1_007686248_0	69,216	303,657	4.3871
29 Jan 2012 04:24:00	1179592	13937315	hadam3p_eu_80i0_1999_1_007686248_0	57,696	253,331	4.3908
28 Jan 2012 13:39:02	1179592	13937315	hadam3p_eu_80i0_1999_1_007686248_0	46,176	202,637	4.3884
27 Jan 2012 21:06:07	1179592	13937315	hadam3p_eu_80i0_1999_1_007686248_0	34,656	151,890	4.3828
27 Jan 2012 01:56:00	1179592	13937315	hadam3p_eu_80i0_1999_1_007686248_0	23,136	101,101	4.3699
27 Jan 2012 01:55:58	1179592	13937315	hadam3p_eu_80i0_1999_1_007686248_0	11,616	50,668	4.3619