Task 16119137

Name	hadam3p_eu_j05x_1997_1_008492058_0
Workunit	8642871
Created	3 Dec 2013, 21:14:57 UTC
Sent	4 Dec 2013, 17:26:26 UTC
Report deadline	16 Nov 2014, 22:46:26 UTC
Received	8 Dec 2013, 17:50:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1230461
Run time	2 days 8 hours 44 min 39 sec
CPU time	1 days 13 hours 41 min 11 sec
Validate state	Invalid
Credit	796.57
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> 22:07:52 (10012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:45:17 (113204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:15:38 (25656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=113228, selfPID=113228, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 05:23:30 (106460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:31 (106460): No heartbeat from core client for 30 sec - exiting 05:23:32 (106460): No heartbeat from core client for 30 sec - exiting 05:49:27 (114096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:13 (18872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:38 (7248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:47 (7988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:56 (7988): No heartbeat from core client for 30 sec - exiting 09:48:57 (7988): No heartbeat from core client for 30 sec - exiting 09:48:58 (7988): No heartbeat from core client for 30 sec - exiting 09:48:59 (7988): No heartbeat from core client for 30 sec - exiting 09:49:00 (7988): No heartbeat from core client for 30 sec - exiting 09:49:01 (7988): No heartbeat from core client for 30 sec - exiting 15:34:55 (33112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:03 (33112): No heartbeat from core client for 30 sec - exiting 15:35:04 (33112): No heartbeat from core client for 30 sec - exiting 15:35:05 (33112): No heartbeat from core client for 30 sec - exiting 15:35:06 (33112): No heartbeat from core client for 30 sec - exiting 15:35:07 (33112): No heartbeat from core client for 30 sec - exiting 15:35:08 (33112): No heartbeat from core client for 30 sec - exiting 15:35:09 (33112): No heartbeat from core client for 30 sec - exiting 15:35:10 (33112): No heartbeat from core client for 30 sec - exiting 15:35:11 (33112): No heartbeat from core client for 30 sec - exiting 16:34:41 (10872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:34:45 (10872): No heartbeat from core client for 30 sec - exiting 16:34:46 (10872): No heartbeat from core client for 30 sec - exiting 16:34:47 (10872): No heartbeat from core client for 30 sec - exiting 16:34:48 (10872): No heartbeat from core client for 30 sec - exiting 16:34:49 (10872): No heartbeat from core client for 30 sec - exiting 16:34:50 (10872): No heartbeat from core client for 30 sec - exiting 16:34:51 (10872): No heartbeat from core client for 30 sec - exiting 16:34:52 (10872): No heartbeat from core client for 30 sec - exiting 16:34:53 (10872): No heartbeat from core client for 30 sec - exiting 16:34:54 (10872): No heartbeat from core client for 30 sec - exiting 20:18:51 (26288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:28 (115252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=108428, selfPID=108428, iMonCtr=2 00:59:49 (22192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:45:28 (115848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:54:12 (115248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:55:04 (115248): No heartbeat from core client for 30 sec - exiting 03:55:05 (115248): No heartbeat from core client for 30 sec - exiting 03:55:06 (115248): No heartbeat from core client for 30 sec - exiting 03:55:07 (115248): No heartbeat from core client for 30 sec - exiting 03:55:08 (115248): No heartbeat from core client for 30 sec - exiting 03:55:09 (115248): No heartbeat from core client for 30 sec - exiting 03:55:10 (115248): No heartbeat from core client for 30 sec - exiting 03:55:11 (115248): No heartbeat from core client for 30 sec - exiting 03:55:12 (115248): No heartbeat from core client for 30 sec - exiting 03:55:13 (115248): No heartbeat from core client for 30 sec - exiting 03:55:14 (115248): No heartbeat from core client for 30 sec - exiting 03:55:15 (115248): No heartbeat from core client for 30 sec - exiting 05:05:06 (17712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:07 (17712): No heartbeat from core client for 30 sec - exiting 05:05:08 (17712): No heartbeat from core client for 30 sec - exiting 05:05:09 (17712): No heartbeat from core client for 30 sec - exiting 05:05:10 (17712): No heartbeat from core client for 30 sec - exiting 05:05:11 (17712): No heartbeat from core client for 30 sec - exiting 05:05:12 (17712): No heartbeat from core client for 30 sec - exiting 05:05:13 (17712): No heartbeat from core client for 30 sec - exiting 05:05:14 (17712): No heartbeat from core client for 30 sec - exiting 05:05:15 (17712): No heartbeat from core client for 30 sec - exiting 05:05:16 (17712): No heartbeat from core client for 30 sec - exiting 05:05:17 (17712): No heartbeat from core client for 30 sec - exiting 05:05:18 (17712): No heartbeat from core client for 30 sec - exiting 05:05:19 (17712): No heartbeat from core client for 30 sec - exiting 05:05:20 (17712): No heartbeat from core client for 30 sec - exiting 05:05:21 (17712): No heartbeat from core client for 30 sec - exiting 05:05:22 (17712): No heartbeat from core client for 30 sec - exiting 05:05:23 (17712): No heartbeat from core client for 30 sec - exiting 05:05:24 (17712): No heartbeat from core client for 30 sec - exiting 05:05:25 (17712): No heartbeat from core client for 30 sec - exiting 05:05:26 (17712): No heartbeat from core client for 30 sec - exiting 05:05:27 (17712): No heartbeat from core client for 30 sec - exiting 05:05:28 (17712): No heartbeat from core client for 30 sec - exiting 05:05:29 (17712): No heartbeat from core client for 30 sec - exiting 05:05:30 (17712): No heartbeat from core client for 30 sec - exiting 05:05:31 (17712): No heartbeat from core client for 30 sec - exiting 05:05:32 (17712): No heartbeat from core client for 30 sec - exiting 05:05:33 (17712): No heartbeat from core client for 30 sec - exiting 05:05:34 (17712): No heartbeat from core client for 30 sec - exiting 05:05:35 (17712): No heartbeat from core client for 30 sec - exiting 05:05:36 (17712): No heartbeat from core client for 30 sec - exiting 05:05:37 (17712): No heartbeat from core client for 30 sec - exiting 05:05:38 (17712): No heartbeat from core client for 30 sec - exiting 05:05:39 (17712): No heartbeat from core client for 30 sec - exiting 05:05:40 (17712): No heartbeat from core client for 30 sec - exiting 09:00:59 (116144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:43 (113396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:07 (9956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4632, selfPID=4632, iMonCtr=2 13:12:09 (9956): No heartbeat from core client for 30 sec - exiting 13:12:10 (9956): No heartbeat from core client for 30 sec - exiting 13:12:11 (9956): No heartbeat from core client for 30 sec - exiting 13:12:12 (9956): No heartbeat from core client for 30 sec - exiting 13:12:13 (9956): No heartbeat from core client for 30 sec - exiting 13:12:14 (9956): No heartbeat from core client for 30 sec - exiting 13:12:15 (9956): No heartbeat from core client for 30 sec - exiting 13:12:16 (9956): No heartbeat from core client for 30 sec - exiting 13:12:17 (9956): No heartbeat from core client for 30 sec - exiting 13:12:18 (9956): No heartbeat from core client for 30 sec - exiting 13:12:19 (9956): No heartbeat from core client for 30 sec - exiting 13:42:28 (113076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:42:33 (113076): No heartbeat from core client for 30 sec - exiting 13:42:34 (113076): No heartbeat from core client for 30 sec - exiting 13:42:35 (113076): No heartbeat from core client for 30 sec - exiting 13:42:36 (113076): No heartbeat from core client for 30 sec - exiting 13:42:37 (113076): No heartbeat from core client for 30 sec - exiting 13:42:38 (113076): No heartbeat from core client for 30 sec - exiting 15:02:55 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:03:29 (7028): No heartbeat from core client for 30 sec - exiting 16:55:27 (116104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:13 (114952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:15 (113548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=114416, selfPID=114416, iMonCtr=2 20:57:03 (67192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:50 (9912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:06 (113508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:33 (114936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:08:09 (114936): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:37:41 (116780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:50 (117236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:01 (115812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:49 (117176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=117576, selfPID=117576, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 10:47:33 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=116128, selfPID=116128, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 14:57:36 (117548): No heartbeat from core client for 30 sec - exiting 14:57:37 (117548): No heartbeat from core client for 30 sec - exiting 14:57:38 (117548): No heartbeat from core client for 30 sec - exiting 14:57:39 (117548): No heartbeat from core client for 30 sec - exiting 14:57:40 (117548): No heartbeat from core client for 30 sec - exiting 14:57:41 (117548): No heartbeat from core client for 30 sec - exiting 14:57:42 (117548): No heartbeat from core client for 30 sec - exiting 14:57:43 (117548): No heartbeat from core client for 30 sec - exiting 14:57:44 (117548): No heartbeat from core client for 30 sec - exiting 14:57:45 (117548): No heartbeat from core client for 30 sec - exiting 14:57:46 (117548): No heartbeat from core client for 30 sec - exiting 14:57:47 (117548): No heartbeat from core client for 30 sec - exiting 14:57:48 (117548): No heartbeat from core client for 30 sec - exiting 14:57:49 (117548): No heartbeat from core client for 30 sec - exiting 14:57:50 (117548): No heartbeat from core client for 30 sec - exiting 14:57:51 (117548): No heartbeat from core client for 30 sec - exiting 14:57:52 (117548): No heartbeat from core client for 30 sec - exiting 14:57:53 (117548): No heartbeat from core client for 30 sec - exiting 14:57:54 (117548): No heartbeat from core client for 30 sec - exiting 14:57:55 (117548): No heartbeat from core client for 30 sec - exiting 14:57:56 (117548): No heartbeat from core client for 30 sec - exiting 14:57:57 (117548): No heartbeat from core client for 30 sec - exiting 14:57:58 (117548): No heartbeat from core client for 30 sec - exiting 14:57:59 (117548): No heartbeat from core client for 30 sec - exiting 14:58:00 (117548): No heartbeat from core client for 30 sec - exiting 14:58:01 (117548): No heartbeat from core client for 30 sec - exiting 14:58:02 (117548): No heartbeat from core client for 30 sec - exiting 14:58:03 (117548): No heartbeat from core client for 30 sec - exiting 14:58:04 (117548): No heartbeat from core client for 30 sec - exiting 14:58:05 (117548): No heartbeat from core client for 30 sec - exiting 14:58:06 (117548): No heartbeat from core client for 30 sec - exiting 14:58:07 (117548): No heartbeat from core client for 30 sec - exiting 14:58:08 (117548): No heartbeat from core client for 30 sec - exiting 14:58:09 (117548): No heartbeat from core client for 30 sec - exiting 14:58:10 (117548): No heartbeat from core client for 30 sec - exiting 14:58:11 (117548): No heartbeat from core client for 30 sec - exiting 14:58:12 (117548): No heartbeat from core client for 30 sec - exiting 14:58:13 (117548): No heartbeat from core client for 30 sec - exiting 14:58:14 (117548): No heartbeat from core client for 30 sec - exiting 14:58:15 (117548): No heartbeat from core client for 30 sec - exiting 14:58:16 (117548): No heartbeat from core client for 30 sec - exiting 14:58:17 (117548): No heartbeat from core client for 30 sec - exiting 14:58:18 (117548): No heartbeat from core client for 30 sec - exiting 14:58:19 (117548): No heartbeat from core client for 30 sec - exiting 14:58:20 (117548): No heartbeat from core client for 30 sec - exiting 14:58:21 (117548): No heartbeat from core client for 30 sec - exiting 14:58:22 (117548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:02:55 (118748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:07:25 (117612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:35:02 (112456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worke05:15:22 (115196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:48 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:00 (3988): No heartbeat from core client for 30 sec - exiting 05:53:01 (3988): No heartbeat from core client for 30 sec - exiting 05:53:02 (3988): No heartbeat from core client for 30 sec - exiting 05:53:03 (3988): No heartbeat from core client for 30 sec - exiting 05:53:04 (3988): No heartbeat from core client for 30 sec - exiting 05:53:05 (3988): No heartbeat from core client for 30 sec - exiting 05:53:06 (3988): No heartbeat from core client for 30 sec - exiting 05:53:07 (3988): No heartbeat from core client for 30 sec - exiting 05:53:08 (3988): No heartbeat from core client for 30 sec - exiting 05:53:09 (3988): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_j05x_1997_1_008492058_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j05x_1997_1_008492058_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j05x_1997_1_008492058_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j05x_1997_1_008492058_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j05x_1997_1_008492058_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j05x_1997_1_008492058_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j05x_1997_1_008492058_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j05x_1997_1_008492058_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Dec 2013 05:23:17	1230461	16119137	hadam3p_eu_j05x_1997_1_008492058_0	46,176	127,889	2.7696
07 Dec 2013 02:53:41	1230461	16119137	hadam3p_eu_j05x_1997_1_008492058_0	34,668	92,234	2.6605
07 Dec 2013 02:53:41	1230461	16119137	hadam3p_eu_j05x_1997_1_008492058_0	34,656	91,703	2.6461
06 Dec 2013 09:28:01	1230461	16119137	hadam3p_eu_j05x_1997_1_008492058_0	23,136	52,592	2.2732
05 Dec 2013 16:38:20	1230461	16119137	hadam3p_eu_j05x_1997_1_008492058_0	11,616	14,191	1.2217