Task 12183695

Name	hadam3p_eu_wyu9_1992_1_006907705_0
Workunit	7111021
Created	20 Nov 2010, 20:54:43 UTC
Sent	14 Feb 2011, 10:53:59 UTC
Report deadline	27 Jan 2012, 16:13:59 UTC
Received	17 Jan 2012, 19:55:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1132241
Run time	5 days 0 hours 21 min 47 sec
CPU time	10 min 32 sec
Validate state	Invalid
Credit	995.30
Device peak FLOPS	1.33 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3844, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2784, selfPID=2380, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... RegionalSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2456, selfPID=2000, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 11:39:28 (2000): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:57:27 (3032): No heartbeat from core client for 30 sec - exiting 16:57:28 (3032): No heartbeat from core client for 30 sec - exiting 16:57:29 (3032): No heartbeat from core client for 30 sec - exiting 16:57:30 (3032): No heartbeat from core client for 30 sec - exiting 16:57:31 (3032): No heartbeat from core client for 30 sec - exiting 16:57:32 (3032): No heartbeat from core client for 30 sec - exiting 16:57:34 (3032): No heartbeat from core client for 30 sec - exiting 16:57:35 (3032): No heartbeat from core client for 30 sec - exiting 16:57:36 (3032): No heartbeat from core client for 30 sec - exiting 16:57:37 (3032): No heartbeat from core client for 30 sec - exiting 16:57:38 (3032): No heartbeat from core client for 30 sec - exiting 16:57:39 (3032): No heartbeat from core client for 30 sec - exiting 16:57:40 (3032): No heartbeat from core client for 30 sec - exiting 16:57:41 (3032): No heartbeat from core client for 30 sec - exiting 16:57:42 (3032): No heartbeat from core client for 30 sec - exiting 16:57:43 (3032): No heartbeat from core client for 30 sec - exiting 16:57:45 (3032): No heartbeat from core client for 30 sec - exiting 16:57:46 (3032): No heartbeat from core client for 30 sec - exiting 16:57:47 (3032): No heartbeat from core client for 30 sec - exiting 16:57:48 (3032): No heartbeat from core client for 30 sec - exiting 16:57:49 (3032): No heartbeat from core client for 30 sec - exiting 16:57:50 (3032): No heartbeat from core client for 30 sec - exiting 16:57:51 (3032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3444, selfPID=3444, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3096, selfPID=3096, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:43:09 (1724): No heartbeat from core client for 30 sec - exiting 22:43:10 (1724): No heartbeat from core client for 30 sec - exiting 22:43:11 (1724): No heartbeat from core client for 30 sec - exiting 22:43:12 (1724): No heartbeat from core client for 30 sec - exiting 22:43:13 (1724): No heartbeat from core client for 30 sec - exiting 22:43:15 (1724): No heartbeat from core client for 30 sec - exiting 22:43:16 (1724): No heartbeat from core client for 30 sec - exiting 22:43:17 (1724): No heartbeat from core client for 30 sec - exiting 22:43:18 (1724): No heartbeat from core client for 30 sec - exiting 22:43:19 (1724): No heartbeat from core client for 30 sec - exiting 22:43:20 (1724): No heartbeat from core client for 30 sec - exiting 22:43:21 (1724): No heartbeat from core client for 30 sec - exiting 22:43:22 (1724): No heartbeat from core client for 30 sec - exiting 22:43:23 (1724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2372, selfPID=2372, iMonCtr=2 G08:51:44 (3312): No heartbeat from core client for 30 sec - exiting 08:51:46 (3312): No heartbeat from core client for 30 sec - exiting 08:51:47 (3312): No heartbeat from core client for 30 sec - exiting 08:51:48 (3312): No heartbeat from core client for 30 sec - exiting 08:51:49 (3312): No heartbeat from core client for 30 sec - exiting 08:51:50 (3312): No heartbeat from core client for 30 sec - exiting 08:51:51 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:44 (2852): No heartbeat from core client for 30 sec - exiting 09:17:46 (2852): No heartbeat from core client for 30 sec - exiting 09:17:47 (2852): No heartbeat from core client for 30 sec - exiting 09:17:48 (2852): No heartbeat from core client for 30 sec - exiting 09:17:49 (2852): No heartbeat from core client for 30 sec - exiting 09:17:50 (2852): No heartbeat from core client for 30 sec - exiting 09:17:51 (2852): No heartbeat from core client for 30 sec - exiting 09:17:53 (2852): No heartbeat from core client for 30 sec - exiting 09:17:54 (2852): No heartbeat from core client for 30 sec - exiting 09:17:55 (2852): No heartbeat from core client for 30 sec - exiting 09:17:56 (2852): No heartbeat from core client for 30 sec - exiting 09:17:57 (2852): No heartbeat from core client for 30 sec - exiting 09:17:58 (2852): No heartbeat from core client for 30 sec - exiting 09:17:59 (2852): No heartbeat from core client for 30 sec - exiting 09:18:00 (2852): No heartbeat from core client for 30 sec - exiting 09:18:01 (2852): No heartbeat from core client for 30 sec - exiting 09:18:02 (2852): No heartbeat from core client for 30 sec - exiting 09:18:03 (2852): No heartbeat from core client for 30 sec - exiting 09:18:05 (2852): No heartbeat from core client for 30 sec - exiting 09:18:06 (2852): No heartbeat from core client for 30 sec - exiting 09:18:07 (2852): No heartbeat from core client for 30 sec - exiting 09:18:08 (2852): No heartbeat from core client for 30 sec - exiting 09:18:09 (2852): No heartbeat from core client for 30 sec - exiting 09:18:10 (2852): No heartbeat from core client for 30 sec - exiting 09:18:11 (2852): No heartbeat from core client for 30 sec - exiting 09:18:12 (2852): No heartbeat from core client for 30 sec - exiting 09:18:13 (2852): No heartbeat from core client for 30 sec - exiting 09:18:14 (2852): No heartbeat from core client for 30 sec - exiting 09:18:16 (2852): No heartbeat from core client for 30 sec - exiting 09:18:17 (2852): No heartbeat from core client for 30 sec - exiting 09:18:18 (2852): No heartbeat from core client for 30 sec - exiting 09:18:19 (2852): No heartbeat from core client for 30 sec - exiting 09:18:20 (2852): No heartbeat from core client for 30 sec - exiting 09:18:21 (2852): No heartbeat from core client for 30 sec - exiting 09:18:22 (2852): No heartbeat from core client for 30 sec - exiting 09:18:23 (2852): No heartbeat from core client for 30 sec - exiting 09:18:24 (2852): No heartbeat from core client for 30 sec - exiting 09:18:25 (2852): No heartbeat from core client for 30 sec - exiting 09:18:26 (2852): No heartbeat from core client for 30 sec - exiting 09:18:28 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:36:21 (2272): No heartbeat from core client for 30 sec - exiting 09:36:22 (2272): No heartbeat from core client for 30 sec - exiting 09:36:23 (2272): No heartbeat from core client for 30 sec - exiting 09:36:24 (2272): No heartbeat from core client for 30 sec - exiting 09:36:25 (2272): No heartbeat from core client for 30 sec - exiting 09:36:26 (2272): No heartbeat from core client for 30 sec - exiting 09:36:28 (2272): No heartbeat from core client for 30 sec - exiting 09:36:29 (2272): No heartbeat from core client for 30 sec - exiting 09:36:30 (2272): No heartbeat from core client for 30 sec - exiting 09:36:31 (2272): No heartbeat from core client for 30 sec - exiting 09:36:32 (2272): No heartbeat from core client for 30 sec - exiting 09:36:33 (2272): No heartbeat from core client for 30 sec - exiting 09:36:34 (2272): No heartbeat from core client for 30 sec - exiting 09:36:35 (2272): No heartbeat from core client for 30 sec - exiting 09:36:36 (2272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2316, selfPID=2316, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2388, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:03:58 (3992): No heartbeat from core client for 30 sec - exiting 17:04:00 (3992): No heartbeat from core client for 30 sec - exiting 17:04:01 (3992): No heartbeat from core client for 30 sec - exiting 17:04:02 (3992): No heartbeat from core client for 30 sec - exiting 17:04:03 (3992): No heartbeat from core client for 30 sec - exiting 17:04:04 (3992): No heartbeat from core client for 30 sec - exiting 17:04:05 (3992): No heartbeat from core client for 30 sec - exiting 17:04:06 (3992): No heartbeat from core client for 30 sec - exiting 17:04:07 (3992): No heartbeat from core client for 30 sec - exiting 17:04:08 (3992): No heartbeat from core client for 30 sec - exiting 17:04:09 (3992): No heartbeat from core client for 30 sec - exiting 17:04:10 (3992): No heartbeat from core client for 30 sec - exiting 17:04:11 (3992): No heartbeat from core client for 30 sec - exiting 17:04:13 (3992): No heartbeat from core client for 30 sec - exiting 17:04:14 (3992): No heartbeat from core client for 30 sec - exiting 17:04:15 (3992): No heartbeat from core client for 30 sec - exiting 17:04:16 (3992): No heartbeat from core client for 30 sec - exiting 17:04:17 (3992): No heartbeat from core client for 30 sec - exiting 17:04:18 (3992): No heartbeat from core client for 30 sec - exiting 17:04:19 (3992): No heartbeat from core client for 30 sec - exiting 17:04:20 (3992): No heartbeat from core client for 30 sec - exiting 17:04:21 (3992): No heartbeat from core client for 30 sec - exiting 17:04:22 (3992): No heartbeat from core client for 30 sec - exiting 17:04:23 (3992): No heartbeat from core client for 30 sec - exiting 17:04:24 (3992): No heartbeat from core client for 30 sec - exiting 17:04:25 (3992): No heartbeat from core client for 30 sec - exiting 17:04:26 (3992): No heartbeat from core client for 30 sec - exiting 17:04:27 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3640, selfPID=2676, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 18:30:14 (1216): No heartbeat from core client for 30 sec - exiting 18:30:18 (1216): No heartbeat from core client for 30 sec - exiting 18:30:51 (1216): No heartbeat from core client for 30 sec - exiting 18:30:52 (1216): No heartbeat from core client for 30 sec - exiting 18:30:53 (1216): No heartbeat from core client for 30 sec - exiting 18:30:54 (1216): No heartbeat from core client for 30 sec - exiting 18:30:55 (1216): No heartbeat from core client for 30 sec - exiting 18:30:56 (1216): No heartbeat from core client for 30 sec - exiting 18:30:57 (1216): No heartbeat from core client for 30 sec - exiting 18:30:58 (1216): No heartbeat from core client for 30 sec - exiting 18:30:59 (1216): No heartbeat from core client for 30 sec - exiting 18:31:00 (1216): No heartbeat from core client for 30 sec - exiting 18:31:01 (1216): No heartbeat from core client for 30 sec - exiting 18:31:02 (1216): No heartbeat from core client for 30 sec - exiting 18:31:03 (1216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3092, selfPID=3092, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1168, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5916, selfPID=3032, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 16:46:01 (2460): No heartbeat from core client for 30 sec - exiting 16:46:02 (2460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5064, selfPID=5064, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2156, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=112, iMonCtr=2 Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2216, selfPID=4128, iMonCtr=1 Model crash detected, will try to restart... 14:22:20 (2448): No heartbeat from core client for 30 sec - exiting 14:22:21 (2448): No heartbeat from core client for 30 sec - exiting 14:22:22 (2448): No heartbeat from core client for 30 sec - exiting 14:22:23 (2448): No heartbeat from core client for 30 sec - exiting 14:22:24 (2448): No heartbeat from core client for 30 sec - exiting 14:22:25 (2448): No heartbeat from core client for 30 sec - exiting 14:22:26 (2448): No heartbeat from core client for 30 sec - exiting 14:22:27 (2448): No heartbeat from core client for 30 sec - exiting 14:22:28 (2448): No heartbeat from core client for 30 sec - exiting 14:22:29 (2448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3440, selfPID=2140, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2540, selfPID=2264, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4688, selfPID=4688, iMonCtr=2 </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_wyu9_1992_1_006907705_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wyu9_1992_1_006907705_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wyu9_1992_1_006907705_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wyu9_1992_1_006907705_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wyu9_1992_1_006907705_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wyu9_1992_1_006907705_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wyu9_1992_1_006907705_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Jan 2012 07:40:16	1132241	12183695	hadam3p_eu_wyu9_1992_1_006907705_0	57,696	258,720	4.4842
03 Jan 2012 18:18:58	1132241	12183695	hadam3p_eu_wyu9_1992_1_006907705_0	46,176	208,416	4.5135
16 Nov 2011 18:31:38	1132241	12183695	hadam3p_eu_wyu9_1992_1_006907705_0	34,656	157,161	4.5349
31 Oct 2011 15:06:21	1132241	12183695	hadam3p_eu_wyu9_1992_1_006907705_0	23,149	103,924	4.4894
31 Oct 2011 15:06:21	1132241	12183695	hadam3p_eu_wyu9_1992_1_006907705_0	23,143	103,225	4.4603
31 Oct 2011 15:06:21	1132241	12183695	hadam3p_eu_wyu9_1992_1_006907705_0	23,137	102,544	4.4320
31 Oct 2011 15:06:21	1132241	12183695	hadam3p_eu_wyu9_1992_1_006907705_0	23,136	101,896	4.4042
10 Aug 2011 09:27:05	1132241	12183695	hadam3p_eu_wyu9_1992_1_006907705_0	11,616	51,274	4.4141