Task 13790642

Name	hadam3p_pnw_72hn_2004_1_007598467_1
Workunit	7776597
Created	17 Dec 2011, 12:09:30 UTC
Sent	17 Dec 2011, 12:25:42 UTC
Report deadline	28 Nov 2012, 17:45:42 UTC
Received	2 Jan 2012, 13:24:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1142983
Run time	2 days 1 hours 55 min 46 sec
CPU time	1 days 23 hours 36 min 19 sec
Validate state	Invalid
Credit	1,503.98
Device peak FLOPS	3.60 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> 06:35:29 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4916, selfPID=4916, iMonCtr=2 07:30:34 (1232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:37 (5860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:38 (5860): No heartbeat from core client for 30 sec - exiting 07:40:40 (5860): No heartbeat from core client for 30 sec - exiting 07:57:18 (6396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:20 (6396): No heartbeat from core client for 30 sec - exiting 08:15:42 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:44 (5656): No heartbeat from core client for 30 sec - exiting 08:15:47 (5656): No heartbeat from core client for 30 sec - exiting 08:15:49 (5656): No heartbeat from core client for 30 sec - exiting 08:15:51 (5656): No heartbeat from core client for 30 sec - exiting 08:37:06 (1124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:09 (1124): No heartbeat from core client for 30 sec - exiting 08:37:12 (1124): No heartbeat from core client for 30 sec - exiting 08:37:14 (1124): No heartbeat from core client for 30 sec - exiting 08:37:17 (1124): No heartbeat from core client for 30 sec - exiting 08:37:19 (1124): No heartbeat from core client for 30 sec - exiting 08:37:22 (1124): No heartbeat from core client for 30 sec - exiting 08:37:24 (1124): No heartbeat from core client for 30 sec - exiting 08:37:26 (1124): No heartbeat from core client for 30 sec - exiting 08:40:45 (3132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:47 (3132): No heartbeat from core client for 30 sec - exiting 08:40:50 (3132): No heartbeat from core client for 30 sec - exiting 10:27:16 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6520, selfPID=6520, iMonCtr=2 10:35:48 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:52 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 01:22:17 (6884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R1:22:19 (6884): No heartbeat from core client for 30 sec - exiting 01:26:59 (6004): No heartbeat from core client for 30 sec - exiting 01:27:01 (6004): No heartbeat from core client for 30 sec - exiting 01:27:03 (6004): No heartbeat from core client for 30 sec - exiting 01:27:05 (6004): No heartbeat from core client for 30 sec - exiting 01:27:07 (6004): No heartbeat from core client for 30 sec - exiting 01:27:09 (6004): No heartbeat from core client for 30 sec - exiting 01:27:11 (6004): No heartbeat from core client for 30 sec - exiting 01:27:13 (6004): No heartbeat from core client for 30 sec - exiting 01:27:44 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:18 (6904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:20 (6904): No heartbeat from core client for 30 sec - exiting 01:31:22 (6904): No heartbeat from core client for 30 sec - exiting 04:23:28 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:23:30 (4276): No heartbeat from core client for 30 sec - exiting 04:23:32 (4276): No heartbeat from core client for 30 sec - exiting 04:23:35 (4276): No heartbeat from core client for 30 sec - exiting 04:23:37 (4276): No heartbeat from core client for 30 sec - exiting 04:23:39 (4276): No heartbeat from core client for 30 sec - exiting 04:23:42 (4276): No heartbeat from core client for 30 sec - exiting 04:27:54 (4244): No heartbeat from core client for 30 sec - exiting 04:27:55 (4244): No heartbeat from core client for 30 sec - exiting 04:27:58 (4244): No heartbeat from core client for 30 sec - exiting 04:28:00 (4244): No heartbeat from core client for 30 sec - exiting 04:28:03 (4244): No heartbeat from core client for 30 sec - exiting 04:28:05 (4244): No heartbeat from core client for 30 sec - exiting 04:28:08 (4244): No heartbeat from core client for 30 sec - exiting 04:28:10 (4244): No heartbeat from core client for 30 sec - exiting 04:28:13 (4244): No heartbeat from core client for 30 sec - exiting 04:28:15 (4244): No heartbeat from core client for 30 sec - exiting 04:28:18 (4244): No heartbeat from core client for 30 sec - exiting 04:28:20 (4244): No heartbeat from core client for 30 sec - exiting 04:28:23 (4244): No heartbeat from core client for 30 sec - exiting 04:28:25 (4244): No heartbeat from core client for 30 sec - exiting 04:28:27 (4244): No heartbeat from core client for 30 sec - exiting 04:28:30 (4244): No heartbeat from core client for 30 sec - exiting 04:28:32 (4244): No heartbeat from core client for 30 sec - exiting 04:28:35 (4244): No heartbeat from core client for 30 sec - exiting 04:28:37 (4244): No heartbeat from core client for 30 sec - exiting 04:28:40 (4244): No heartbeat from core client for 30 sec - exiting 04:28:42 (4244): No heartbeat from core client for 30 sec - exiting 04:28:45 (4244): No heartbeat from core client for 30 sec - exiting 04:28:47 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:15 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:16 (2192): No heartbeat from core client for 30 sec - exiting R6:04:19 (2192): No heartbeat from core client for 30 sec - exiting 06:09:00 (6720): No heartbeat from core client for 30 sec - exiting 06:09:02 (6720): No heartbeat from core client for 30 sec - exiting 06:09:05 (6720): No heartbeat from core client for 30 sec - exiting 06:09:07 (6720): No heartbeat from core client for 30 sec - exiting 06:09:10 (6720): No heartbeat from core client for 30 sec - exiting 06:09:12 (6720): No heartbeat from core client for 30 sec - exiting 06:09:15 (6720): No heartbeat from core client for 30 sec - exiting 06:09:17 (6720): No heartbeat from core client for 30 sec - exiting 06:09:20 (6720): No heartbeat from core client for 30 sec - exiting 06:09:22 (6720): No heartbeat from core client for 30 sec - exiting 06:09:24 (6720): No heartbeat from core client for 30 sec - exiting 06:09:27 (6720): No heartbeat from core client for 30 sec - exiting 06:09:29 (6720): No heartbeat from core client for 30 sec - exiting 06:09:32 (6720): No heartbeat from core client for 30 sec - exiting 06:09:35 (6720): No heartbeat from core client for 30 sec - exiting 06:09:37 (6720): No heartbeat from core client for 30 sec - exiting 06:09:39 (6720): No heartbeat from core client for 30 sec - exiting 06:09:42 (6720): No heartbeat from core client for 30 sec - exiting 06:09:45 (6720): No heartbeat from core client for 30 sec - exiting 06:09:47 (6720): No heartbeat from core client for 30 sec - exiting 06:09:50 (6720): No heartbeat from core client for 30 sec - exiting 06:09:52 (6720): No heartbeat from core client for 30 sec - exiting 06:09:55 (6720): No heartbeat from core client for 30 sec - exiting 06:09:57 (6720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:10:30 (6720): No heartbeat from core client for 30 sec - exiting 06:10:32 (6720): No heartbeat from core client for 30 sec - exiting 06:10:34 (6720): No heartbeat from core client for 30 sec - exiting 06:10:37 (6720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:36:13 (3284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:15 (3284): No heartbeat from core client for 30 sec - exiting R2:36:17 (3284): No heartbeat from core client for 30 sec - exiting 12:41:14 (4264): No heartbeat from core client for 30 sec - exiting 12:41:16 (4264): No heartbeat from core client for 30 sec - exiting 12:41:18 (4264): No heartbeat from core client for 30 sec - exiting 12:41:20 (4264): No heartbeat from core client for 30 sec - exiting 12:41:21 (4264): No heartbeat from core client for 30 sec - exiting 12:41:23 (4264): No heartbeat from core client for 30 sec - exiting 12:41:25 (4264): No heartbeat from core client for 30 sec - exiting 12:41:27 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:23 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R6:06:26 (4844): No heartbeat from core client for 30 sec - exiting 16:26:25 (7056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:26:27 (7056): No heartbeat from core client for 30 sec - exiting No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1060, selfPID=1060, iMonCtr=2 16:36:25 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R6:36:27 (6104): No heartbeat from core client for 30 sec - exiting 16:42:59 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:00 (6068): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3352, selfPID=3352, iMonCtr=2 16:46:27 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:29 (3712): No heartbeat from core client for 30 sec - exiting R6:46:31 (3712): No heartbeat from core client for 30 sec - exiting 17:06:47 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:06:48 (3332): No heartbeat from core client for 30 sec - exiting 17:06:50 (3332): No heartbeat from core client for 30 sec - exiting 17:16:46 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:48 (6540): No heartbeat from core client for 30 sec - exiting R7:16:50 (6540): No heartbeat from core client for 30 sec - exiting 17:21:47 (6604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:21:49 (6604): No heartbeat from core client for 30 sec - exiting 19:49:54 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:55 (6492): No heartbeat from core client for 30 sec - exiting 1e:49:57 (6492): No heartbeat from core client for 30 sec - exiting 20:00:44 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:46 (5512): No heartbeat from core client for 30 sec - exiting 2e:00:47 (5512): No heartbeat from core client for 30 sec - exiting 20:08:07 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:08 (5932): No heartbeat from core client for 30 sec - exiting 20:08:10 (5932): No heartbeat from core client for 30 sec - exiting gional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4168, selfPID=4168, iMonCtr=2 20:23:08 (1420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:14 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:16 (5936): No heartbeat from core client for 30 sec - exiting 2e:28:17 (5936): No heartbeat from core client for 30 sec - exiting 20:39:36 (5868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:39 (5868): No heartbeat from core client for 30 sec - exiting 20:43:16 (4952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:18 (4952): No heartbeat from core client for 30 sec - exiting 2e:43:19 (4952): No heartbeat from core client for 30 sec - exiting 20:48:04 (5212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R0:48:05 (5212):eNo heartbeat from core client for 30 sec - exiting gional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=904, selfPID=904, iMonCtr=2 20:53:38 (2104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R0:53:40 (2104): No heartbeat from core client for 30 sec - exiting 21:00:59 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:01 (4392): No heartbeat from core client for 30 sec - exiting R1:01:02 (4392): No heartbeat from core client for 30 sec - exiting 21:08:40 (1404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:42 (1404): No heartbeat from core client for 30 sec - exiting R1:08:43 (1404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:00:13 (3156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:14 (3156): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 10:07:32 (5348): No heartbeat from core client for 30 sec - exiting 10:07:33 (5348): No heartbeat from core client for 30 sec - exiting Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_72hn_2004_1_007598467_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_72hn_2004_1_007598467_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_72hn_2004_1_007598467_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_72hn_2004_1_007598467_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_72hn_2004_1_007598467_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_72hn_2004_1_007598467_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Dec 2011 15:02:51	1142983	13790642	hadam3p_pnw_72hn_2004_1_007598467_1	69,216	160,952	2.3254
29 Dec 2011 05:32:57	1142983	13790642	hadam3p_pnw_72hn_2004_1_007598467_1	57,696	135,666	2.3514
28 Dec 2011 20:39:59	1142983	13790642	hadam3p_pnw_72hn_2004_1_007598467_1	46,176	109,005	2.3606
28 Dec 2011 00:52:54	1142983	13790642	hadam3p_pnw_72hn_2004_1_007598467_1	34,656	81,790	2.3601
27 Dec 2011 13:38:37	1142983	13790642	hadam3p_pnw_72hn_2004_1_007598467_1	23,136	54,382	2.3505
26 Dec 2011 12:55:57	1142983	13790642	hadam3p_pnw_72hn_2004_1_007598467_1	11,616	26,857	2.3121