Task 15256657

Name	hadam3p_eu_82ew_2003_1_008190470_1
Workunit	8345594
Created	9 Sep 2012, 0:08:33 UTC
Sent	9 Sep 2012, 0:54:13 UTC
Report deadline	22 Aug 2013, 6:14:13 UTC
Received	30 Sep 2012, 21:59:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1015608
Run time	10 days 10 hours 31 min 22 sec
CPU time	7 days 4 hours 17 min 55 sec
Validate state	Invalid
Credit	1,790.21
Device peak FLOPS	1.38 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1520, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1400, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5384, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4660, selfPID=5336, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5028, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=2 Model crash detected, will try to restart... 16:46:09 (4848): No heartbeat from core client for 30 sec - exiting 16:46:10 (4848): No heartbeat from core client for 30 sec - exiting 16:46:11 (4848): No heartbeat from core client for 30 sec - exiting 16:46:12 (4848): No heartbeat from core client for 30 sec - exiting 16:46:13 (4848): No heartbeat from core client for 30 sec - exiting 16:46:14 (4848): No heartbeat from core client for 30 sec - exiting 16:46:15 (4848): No heartbeat from core client for 30 sec - exiting 16:46:16 (4848): No heartbeat from core client for 30 sec - exiting 16:46:17 (4848): No heartbeat from core client for 30 sec - exiting 16:46:18 (4848): No heartbeat from core client for 30 sec - exiting 16:46:19 (4848): No heartbeat from core client for 30 sec - exiting 16:46:20 (4848): No heartbeat from core client for 30 sec - exiting 16:46:21 (4848): No heartbeat from core client for 30 sec - exiting 16:46:22 (4848): No heartbeat from core client for 30 sec - exiting 16:46:23 (4848): No heartbeat from core client for 30 sec - exiting 16:46:24 (4848): No heartbeat from core client for 30 sec - exiting 16:46:25 (4848): No heartbeat from core client for 30 sec - exiting 16:46:26 (4848): No heartbeat from core client for 30 sec - exiting 16:46:27 (4848): No heartbeat from core client for 30 sec - exiting 16:46:28 (4848): No heartbeat from core client for 30 sec - exiting 16:46:29 (4848): No heartbeat from core client for 30 sec - exiting 16:46:30 (4848): No heartbeat from core client for 30 sec - exiting 16:46:31 (4848): No heartbeat from core client for 30 sec - exiting 16:46:32 (4848): No heartbeat from core client for 30 sec - exiting 16:46:33 (4848): No heartbeat from core client for 30 sec - exiting 16:46:34 (4848): No heartbeat from core client for 30 sec - exiting 16:46:35 (4848): No heartbeat from core client for 30 sec - exiting 16:46:36 (4848): No heartbeat from core client for 30 sec - exiting 16:46:37 (4848): No heartbeat from core client for 30 sec - exiting 16:46:38 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5372, iMonCtr=2 Model crash detected, will try to restart... 01:23:03 (4644): No heartbeat from core client for 30 sec - exiting 01:23:04 (4644): No heartbeat from core client for 30 sec - exiting 01:23:05 (4644): No heartbeat from core client for 30 sec - exiting 01:23:06 (4644): No heartbeat from core client for 30 sec - exiting 01:23:07 (4644): No heartbeat from core client for 30 sec - exiting 01:23:08 (4644): No heartbeat from core client for 30 sec - exiting 01:23:09 (4644): No heartbeat from core client for 30 sec - exiting 01:23:10 (4644): No heartbeat from core client for 30 sec - exiting 01:23:11 (4644): No heartbeat from core client for 30 sec - exiting 01:23:12 (4644): No heartbeat from core client for 30 sec - exiting 01:23:13 (4644): No heartbeat from core client for 30 sec - exiting 01:23:14 (4644): No heartbeat from core client for 30 sec - exiting 01:23:15 (4644): No heartbeat from core client for 30 sec - exiting 01:23:16 (4644): No heartbeat from core client for 30 sec - exiting 01:23:17 (4644): No heartbeat from core client for 30 sec - exiting 01:23:18 (4644): No heartbeat from core client for 30 sec - exiting 01:23:19 (4644): No heartbeat from core client for 30 sec - exiting 01:23:20 (4644): No heartbeat from core client for 30 sec - exiting 01:23:21 (4644): No heartbeat from core client for 30 sec - exiting 01:23:22 (4644): No heartbeat from core client for 30 sec - exiting 01:23:23 (4644): No heartbeat from core client for 30 sec - exiting 01:23:24 (4644): No heartbeat from core client for 30 sec - exiting 01:23:25 (4644): No heartbeat from core client for 30 sec - exiting 01:23:26 (4644): No heartbeat from core client for 30 sec - exiting 01:23:27 (4644): No heartbeat from core client for 30 sec - exiting 01:23:28 (4644): No heartbeat from core client for 30 sec - exiting 01:23:29 (4644): No heartbeat from core client for 30 sec - exiting 01:23:30 (4644): No heartbeat from core client for 30 sec - exiting 01:23:31 (4644): No heartbeat from core client for 30 sec - exiting 01:23:32 (4644): No heartbeat from core client for 30 sec - exiting 01:23:33 (4644): No heartbeat from core client for 30 sec - exiting 01:23:34 (4644): No heartbeat from core client for 30 sec - exiting 01:23:35 (4644): No heartbeat from core client for 30 sec - exiting 01:23:36 (4644): No heartbeat from core client for 30 sec - exiting 01:23:37 (4644): No heartbeat from core client for 30 sec - exiting 01:23:38 (4644): No heartbeat from core client for 30 sec - exiting 01:23:39 (4644): No heartbeat from core client for 30 sec - exiting 01:23:40 (4644): No heartbeat from core client for 30 sec - exiting 01:23:41 (4644): No heartbeat from core client for 30 sec - exiting 01:23:42 (4644): No heartbeat from core client for 30 sec - exiting 01:23:43 (4644): No heartbeat from core client for 30 sec - exiting 01:23:44 (4644): No heartbeat from core client for 30 sec - exiting 01:23:45 (4644): No heartbeat from core client for 30 sec - exiting 01:23:46 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5148, iMonCtr=2 Model crash detected, will try to restart... 17:54:13 (5336): No heartbeat from core client for 30 sec - exiting 17:54:14 (5336): No heartbeat from core client for 30 sec - exiting 17:54:15 (5336): No heartbeat from core client for 30 sec - exiting 17:54:16 (5336): No heartbeat from core client for 30 sec - exiting 17:54:17 (5336): No heartbeat from core client for 30 sec - exiting 17:54:18 (5336): No heartbeat from core client for 30 sec - exiting 17:54:19 (5336): No heartbeat from core client for 30 sec - exiting 17:54:20 (5336): No heartbeat from core client for 30 sec - exiting 17:54:21 (5336): No heartbeat from core client for 30 sec - exiting 17:54:22 (5336): No heartbeat from core client for 30 sec - exiting 17:54:23 (5336): No heartbeat from core client for 30 sec - exiting 17:54:24 (5336): No heartbeat from core client for 30 sec - exiting 17:54:25 (5336): No heartbeat from core client for 30 sec - exiting 17:54:26 (5336): No heartbeat from core client for 30 sec - exiting 17:54:27 (5336): No heartbeat from core client for 30 sec - exiting 17:54:28 (5336): No heartbeat from core client for 30 sec - exiting 17:54:29 (5336): No heartbeat from core client for 30 sec - exiting 17:54:30 (5336): No heartbeat from core client for 30 sec - exiting 17:54:31 (5336): No heartbeat from core client for 30 sec - exiting 17:54:32 (5336): No heartbeat from core client for 30 sec - exiting 17:54:33 (5336): No heartbeat from core client for 30 sec - exiting 17:54:34 (5336): No heartbeat from core client for 30 sec - exiting 17:54:35 (5336): No heartbeat from core client for 30 sec - exiting 17:54:36 (5336): No heartbeat from core client for 30 sec - exiting 17:54:37 (5336): No heartbeat from core client for 30 sec - exiting 17:54:38 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5760, selfPID=5684, iMonCtr=1 Model crash detected, will try to restart... 19:11:50 (4960): No heartbeat from core client for 30 sec - exiting 19:11:51 (4960): No heartbeat from core client for 30 sec - exiting 19:11:52 (4960): No heartbeat from core client for 30 sec - exiting 19:11:53 (4960): No heartbeat from core client for 30 sec - exiting 19:11:54 (4960): No heartbeat from core client for 30 sec - exiting 19:11:55 (4960): No heartbeat from core client for 30 sec - exiting 19:11:56 (4960): No heartbeat from core client for 30 sec - exiting 19:11:57 (4960): No heartbeat from core client for 30 sec - exiting 19:11:58 (4960): No heartbeat from core client for 30 sec - exiting 19:11:59 (4960): No heartbeat from core client for 30 sec - exiting 19:12:00 (4960): No heartbeat from core client for 30 sec - exiting 19:12:01 (4960): No heartbeat from core client for 30 sec - exiting 19:12:02 (4960): No heartbeat from core client for 30 sec - exiting 19:12:03 (4960): No heartbeat from core client for 30 sec - exiting 19:12:04 (4960): No heartbeat from core client for 30 sec - exiting 19:12:05 (4960): No heartbeat from core client for 30 sec - exiting 19:12:06 (4960): No heartbeat from core client for 30 sec - exiting 19:12:07 (4960): No heartbeat from core client for 30 sec - exiting 19:12:08 (4960): No heartbeat from core client for 30 sec - exiting 19:12:09 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5328, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 14:46:34 (4920): No heartbeat from core client for 30 sec - exiting 14:46:35 (4920): No heartbeat from core client for 30 sec - exiting 14:46:36 (4920): No heartbeat from core client for 30 sec - exiting 14:46:37 (4920): No heartbeat from core client for 30 sec - exiting 14:46:38 (4920): No heartbeat from core client for 30 sec - exiting 14:46:39 (4920): No heartbeat from core client for 30 sec - exiting 14:46:40 (4920): No heartbeat from core client for 30 sec - exiting 14:46:41 (4920): No heartbeat from core client for 30 sec - exiting 14:46:42 (4920): No heartbeat from core client for 30 sec - exiting 14:46:43 (4920): No heartbeat from core client for 30 sec - exiting 14:46:44 (4920): No heartbeat from core client for 30 sec - exiting 14:46:45 (4920): No heartbeat from core client for 30 sec - exiting 14:46:46 (4920): No heartbeat from core client for 30 sec - exiting 14:46:47 (4920): No heartbeat from core client for 30 sec - exiting 14:46:48 (4920): No heartbeat from core client for 30 sec - exiting 14:46:49 (4920): No heartbeat from core client for 30 sec - exiting 14:46:50 (4920): No heartbeat from core client for 30 sec - exiting 14:46:51 (4920): No heartbeat from core client for 30 sec - exiting 14:46:52 (4920): No heartbeat from core client for 30 sec - exiting 14:46:53 (4920): No heartbeat from core client for 30 sec - exiting 14:46:54 (4920): No heartbeat from core client for 30 sec - exiting 14:46:55 (4920): No heartbeat from core client for 30 sec - exiting 14:46:56 (4920): No heartbeat from core client for 30 sec - exiting 14:46:57 (4920): No heartbeat from core client for 30 sec - exiting 14:46:58 (4920): No heartbeat from core client for 30 sec - exiting 14:46:59 (4920): No heartbeat from core client for 30 sec - exiting 14:47:00 (4920): No heartbeat from core client for 30 sec - exiting 14:47:01 (4920): No heartbeat from core client for 30 sec - exiting 14:47:02 (4920): No heartbeat from core client for 30 sec - exiting 14:47:03 (4920): No heartbeat from core client for 30 sec - exiting 14:47:04 (4920): No heartbeat from core client for 30 sec - exiting 14:47:05 (4920): No heartbeat from core client for 30 sec - exiting 14:47:06 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:07 (4920): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5436, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5876, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5300, iMonCtr=2 Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4852, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4848, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5564, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5140, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5548, iMonCtr=2 Leaving CPDN_Main::Monitor... 01:32:59 (4992): No heartbeat from core client for 30 sec - exiting 01:33:00 (4992): No heartbeat from core client for 30 sec - exiting 01:33:01 (4992): No heartbeat from core client for 30 sec - exiting 01:33:02 (4992): No heartbeat from core client for 30 sec - exiting 01:33:03 (4992): No heartbeat from core client for 30 sec - exiting 01:33:04 (4992): No heartbeat from core client for 30 sec - exiting 01:33:05 (4992): No heartbeat from core client for 30 sec - exiting 01:33:06 (4992): No heartbeat from core client for 30 sec - exiting 01:33:07 (4992): No heartbeat from core client for 30 sec - exiting 01:33:08 (4992): No heartbeat from core client for 30 sec - exiting 01:33:09 (4992): No heartbeat from core client for 30 sec - exiting 01:33:10 (4992): No heartbeat from core client for 30 sec - exiting 01:33:11 (4992): No heartbeat from core client for 30 sec - exiting 01:33:12 (4992): No heartbeat from core client for 30 sec - exiting 01:33:13 (4992): No heartbeat from core client for 30 sec - exiting 01:33:14 (4992): No heartbeat from core client for 30 sec - exiting 01:33:15 (4992): No heartbeat from core client for 30 sec - exiting 01:33:16 (4992): No heartbeat from core client for 30 sec - exiting 01:33:17 (4992): No heartbeat from core client for 30 sec - exiting 01:33:18 (4992): No heartbeat from core client for 30 sec - exiting 01:33:19 (4992): No heartbeat from core client for 30 sec - exiting 01:33:20 (4992): No heartbeat from core client for 30 sec - exiting 01:33:21 (4992): No heartbeat from core client for 30 sec - exiting Called boinc_finish 01:33:31 (4992): No heartbeat from core client for 30 sec - exiting 01:33:32 (4992): No heartbeat from core client for 30 sec - exiting </stderr_txt><message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_82ew_2003_1_008190470_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_82ew_2003_1_008190470_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_82ew_2003_1_008190470_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2012 08:25:47	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	103,776	585,162	5.6387
27 Sep 2012 15:05:31	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	92,256	520,877	5.6460
25 Sep 2012 14:19:10	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	80,736	455,318	5.6396
23 Sep 2012 14:07:20	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	69,216	389,153	5.6223
22 Sep 2012 01:21:20	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	57,696	321,745	5.5766
20 Sep 2012 18:15:51	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	46,176	257,003	5.5657
19 Sep 2012 02:51:39	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	34,656	189,718	5.4743
17 Sep 2012 18:37:40	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	23,136	128,516	5.5548
10 Sep 2012 15:03:47	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	11,625	66,660	5.7342
10 Sep 2012 05:31:13	1015608	15256657	hadam3p_eu_82ew_2003_1_008190470_1	11,616	65,788	5.6636