Task 14351480

Name	hadam3p_eu_9lqm_1994_1_007854314_0
Workunit	8009426
Created	3 Apr 2012, 12:01:08 UTC
Sent	3 Apr 2012, 12:01:22 UTC
Report deadline	16 Mar 2013, 17:21:22 UTC
Received	20 Apr 2012, 0:42:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1020912
Run time	2 days 5 hours 39 min 11 sec
CPU time	1 days 12 hours 44 min 59 sec
Validate state	Invalid
Credit	995.30
Device peak FLOPS	2.76 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 03:42:07 (5824): No heartbeat from core client for 30 sec - exiting 03:42:08 (5824): No heartbeat from core client for 30 sec - exiting 03:42:09 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:04:08 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:12:22 (860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:33:48 (3168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1420, selfPID=1420, iMonCtr=2 05:06:35 (3032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:16:11 (1180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1044, selfPID=816, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:09:55 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:09:57 (5160): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:04:14 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:15 (3752): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:13:50 (5344): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:11:55 (4044): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:11:56 (4044): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:12:25 (4924): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:09:45 (2756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:10:23 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:41:05 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:41:06 (5268): No heartbeat from core client for 30 sec - exiting 16:40:04 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:39:44 (1076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:39:45 (1076): No heartbeat from core client for 30 sec - exiting 21:39:46 (1076): No heartbeat from core client for 30 sec - exiting 21:39:47 (1076): No heartbeat from core client for 30 sec - exiting 21:40:43 (4832): No heartbeat from core client for 30 sec - exiting 21:40:44 (4832): No heartbeat from core client for 30 sec - exiting 21:40:45 (4832): No heartbeat from core client for 30 sec - exiting 21:40:46 (4832): No heartbeat from core client for 30 sec - exiting 21:40:47 (4832): No heartbeat from core client for 30 sec - exiting 21:40:48 (4832): No heartbeat from core client for 30 sec - exiting 21:40:49 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:50:34 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:35 (3808): No heartbeat from core client for 30 sec - exiting 18:50:36 (3808): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7496, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1096, iMonCtr=2 14:00:04 (1848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5436, selfPID=5436, iMonCtr=2 14:02:05 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:40 (5312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:27:43 (5272): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:24:29 (5064): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:24:31 (5064): No heartbeat from core client for 30 sec - exiting 16:50:55 (1812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:51:36 (3652): No heartbeat from core client for 30 sec - exiting 16:51:37 (3652): No heartbeat from core client for 30 sec - exiting 16:51:38 (3652): No heartbeat from core client for 30 sec - exiting 16:51:39 (3652): No heartbeat from core client for 30 sec - exiting 16:51:40 (3652): No heartbeat from core client for 30 sec - exiting 16:51:41 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:45 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:46 (4380): No heartbeat from core client for 30 sec - exiting 16:59:24 (3808): No heartbeat from core client for 30 sec - exiting 16:59:25 (3808): No heartbeat from core client for 30 sec - exiting 16:59:26 (3808): No heartbeat from core client for 30 sec - exiting 16:59:27 (3808): No heartbeat from core client for 30 sec - exiting 16:59:28 (3808): No heartbeat from core client for 30 sec - exiting 16:59:29 (3808): No heartbeat from core client for 30 sec - exiting 16:59:30 (3808): No heartbeat from core client for 30 sec - exiting 16:59:31 (3808): No heartbeat from core client for 30 sec - exiting 16:59:32 (3808): No heartbeat from core client for 30 sec - exiting 16:59:33 (3808): No heartbeat from core client for 30 sec - exiting 16:59:34 (3808): No heartbeat from core client for 30 sec - exiting 16:59:35 (3808): No heartbeat from core client for 30 sec - exiting 16:59:36 (3808): No heartbeat from core client for 30 sec - exiting 16:59:37 (3808): No heartbeat from core client for 30 sec - exiting 16:59:38 (3808): No heartbeat from core client for 30 sec - exiting 16:59:39 (3808): No heartbeat from core client for 30 sec - exiting 16:59:40 (3808): No heartbeat from core client for 30 sec - exiting 16:59:41 (3808): No heartbeat from core client for 30 sec - exiting 16:59:42 (3808): No heartbeat from core client for 30 sec - exiting 16:59:43 (3808): No heartbeat from core client for 30 sec - exiting 16:59:44 (3808): No heartbeat from core client for 30 sec - exiting 16:59:45 (3808): No heartbeat from core client for 30 sec - exiting 16:59:46 (3808): No heartbeat from core client for 30 sec - exiting 16:59:47 (3808): No heartbeat from core client for 30 sec - exiting 16:59:48 (3808): No heartbeat from core client for 30 sec - exiting 16:59:49 (3808): No heartbeat from core client for 30 sec - exiting 16:59:50 (3808): No heartbeat from core client for 30 sec - exiting 16:59:51 (3808): No heartbeat from core client for 30 sec - exiting 16:59:52 (3808): No heartbeat from core client for 30 sec - exiting 16:59:53 (3808): No heartbeat from core client for 30 sec - exiting 16:59:54 (3808): No heartbeat from core client for 30 sec - exiting 16:59:55 (3808): No heartbeat from core client for 30 sec - exiting 16:59:56 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:18 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:23:39 (3652): No heartbeat from core client for 30 sec - exiting 17:23:40 (3652): No heartbeat from core client for 30 sec - exiting 17:23:41 (3652): No heartbeat from core client for 30 sec - exiting 17:23:42 (3652): No heartbeat from core client for 30 sec - exiting 17:23:43 (3652): No heartbeat from core client for 30 sec - exiting 17:23:44 (3652): No heartbeat from core client for 30 sec - exiting 17:23:45 (3652): No heartbeat from core client for 30 sec - exiting 17:23:46 (3652): No heartbeat from core client for 30 sec - exiting 17:23:47 (3652): No heartbeat from core client for 30 sec - exiting 17:23:48 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:04 (1732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:46 (4612): No heartbeat from core client for 30 sec - exiting 17:31:47 (4612): No heartbeat from core client for 30 sec - exiting 17:31:48 (4612): No heartbeat from core client for 30 sec - exiting 17:31:49 (4612): No heartbeat from core client for 30 sec - exiting 17:31:50 (4612): No heartbeat from core client for 30 sec - exiting 17:31:51 (4612): No heartbeat from core client for 30 sec - exiting 17:31:52 (4612): No heartbeat from core client for 30 sec - exiting 17:31:53 (4612): No heartbeat from core client for 30 sec - exiting 17:31:54 (4612): No heartbeat from core client for 30 sec - exiting 17:31:55 (4612): No heartbeat from core client for 30 sec - exiting 17:31:56 (4612): No heartbeat from core client for 30 sec - exiting 17:31:57 (4612): No heartbeat from core client for 30 sec - exiting 17:31:58 (4612): No heartbeat from core client for 30 sec - exiting 17:31:59 (4612): No heartbeat from core client for 30 sec - exiting 17:32:00 (4612): No heartbeat from core client for 30 sec - exiting 17:32:01 (4612): No heartbeat from core client for 30 sec - exiting 17:32:02 (4612): No heartbeat from core client for 30 sec - exiting 17:32:03 (4612): No heartbeat from core client for 30 sec - exiting 17:32:04 (4612): No heartbeat from core client for 30 sec - exiting 17:32:05 (4612): No heartbeat from core client for 30 sec - exiting 17:32:06 (4612): No heartbeat from core client for 30 sec - exiting 17:32:07 (4612): No heartbeat from core client for 30 sec - exiting 17:32:08 (4612): No heartbeat from core client for 30 sec - exiting 17:32:09 (4612): No heartbeat from core client for 30 sec - exiting 17:32:10 (4612): No heartbeat from core client for 30 sec - exiting 17:32:59 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:41:34 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:10 (836): No heartbeat from core client for 30 sec - exiting 17:42:11 (836): No heartbeat from core client for 30 sec - exiting 17:42:12 (836): No heartbeat from core client for 30 sec - exiting 17:42:13 (836): No heartbeat from core client for 30 sec - exiting 17:42:14 (836): No heartbeat from core client for 30 sec - exiting 17:42:15 (836): No heartbeat from core client for 30 sec - exiting 17:42:16 (836): No heartbeat from core client for 30 sec - exiting 17:42:17 (836): No heartbeat from core client for 30 sec - exiting 17:42:18 (836): No heartbeat from core client for 30 sec - exiting 17:42:19 (836): No heartbeat from core client for 30 sec - exiting 17:42:20 (836): No heartbeat from core client for 30 sec - exiting 17:42:21 (836): No heartbeat from core client for 30 sec - exiting 17:42:22 (836): No heartbeat from core client for 30 sec - exiting 17:42:23 (836): No heartbeat from core client for 30 sec - exiting 17:42:24 (836): No heartbeat from core client for 30 sec - exiting 17:42:25 (836): No heartbeat from core client for 30 sec - exiting 17:42:26 (836): No heartbeat from core client for 30 sec - exiting 17:42:27 (836): No heartbeat from core client for 30 sec - exiting 17:42:28 (836): No heartbeat from core client for 30 sec - exiting 17:42:29 (836): No heartbeat from core client for 30 sec - exiting 17:42:30 (836): No heartbeat from core client for 30 sec - exiting 17:42:31 (836): No heartbeat from core client for 30 sec - exiting 17:42:32 (836): No heartbeat from core client for 30 sec - exiting 17:42:33 (836): No heartbeat from core client for 30 sec - exiting 17:42:34 (836): No heartbeat from core client for 30 sec - exiting 17:42:35 (836): No heartbeat from core client for 30 sec - exiting 17:42:36 (836): No heartbeat from core client for 30 sec - exiting 17:42:37 (836): No heartbeat from core client for 30 sec - exiting 17:42:38 (836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:52 (3244): No heartbeat from core client for 30 sec - exiting 17:44:53 (3244): No heartbeat from core client for 30 sec - exiting 17:44:54 (3244): No heartbeat from core client for 30 sec - exiting 17:44:55 (3244): No heartbeat from core client for 30 sec - exiting 17:44:56 (3244): No heartbeat from core client for 30 sec - exiting 17:44:57 (3244): No heartbeat from core client for 30 sec - exiting 17:44:58 (3244): No heartbeat from core client for 30 sec - exiting 17:44:59 (3244): No heartbeat from core client for 30 sec - exiting 17:45:00 (3244): No heartbeat from core client for 30 sec - exiting 17:45:01 (3244): No heartbeat from core client for 30 sec - exiting 17:45:02 (3244): No heartbeat from core client for 30 sec - exiting 17:45:03 (3244): No heartbeat from core client for 30 sec - exiting 17:45:04 (3244): No heartbeat from core client for 30 sec - exiting 17:45:05 (3244): No heartbeat from core client for 30 sec - exiting 17:45:06 (3244): No heartbeat from core client for 30 sec - exiting 17:45:07 (3244): No heartbeat from core client for 30 sec - exiting 17:45:08 (3244): No heartbeat from core client for 30 sec - exiting 17:45:09 (3244): No heartbeat from core client for 30 sec - exiting 17:45:10 (3244): No heartbeat from core client for 30 sec - exiting 17:45:11 (3244): No heartbeat from core client for 30 sec - exiting 17:45:12 (3244): No heartbeat from core client for 30 sec - exiting 17:45:13 (3244): No heartbeat from core client for 30 sec - exiting 17:45:14 (3244): No heartbeat from core client for 30 sec - exiting 17:45:15 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:51 (1044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_9lqm_1994_1_007854314_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9lqm_1994_1_007854314_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9lqm_1994_1_007854314_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9lqm_1994_1_007854314_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9lqm_1994_1_007854314_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9lqm_1994_1_007854314_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9lqm_1994_1_007854314_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Apr 2012 22:44:29	1020912	14351480	hadam3p_eu_9lqm_1994_1_007854314_0	57,696	130,619	2.2639
15 Apr 2012 09:40:09	1020912	14351480	hadam3p_eu_9lqm_1994_1_007854314_0	46,176	104,317	2.2591
12 Apr 2012 04:09:13	1020912	14351480	hadam3p_eu_9lqm_1994_1_007854314_0	34,656	78,521	2.2657
09 Apr 2012 00:15:14	1020912	14351480	hadam3p_eu_9lqm_1994_1_007854314_0	23,136	52,801	2.2822
06 Apr 2012 12:55:39	1020912	14351480	hadam3p_eu_9lqm_1994_1_007854314_0	11,616	26,813	2.3083