Task 13185944

Name	hadam3p_eu_2qs0_1961_1_007384608_0
Workunit	7582038
Created	1 Aug 2011, 10:03:12 UTC
Sent	3 Aug 2011, 3:15:18 UTC
Report deadline	15 Jul 2012, 8:35:18 UTC
Received	13 Aug 2011, 6:37:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1160470
Run time	4 days 5 hours 59 min 37 sec
CPU time	3 days 19 hours 46 min 59 sec
Validate state	Invalid
Credit	1,591.48
Device peak FLOPS	2.42 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3808, selfPID=7752, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6688, selfPID=7516, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:35:21 (4564): No heartbeat from core client for 30 sec - exiting 22:35:22 (4564): No heartbeat from core client for 30 sec - exiting 22:35:23 (4564): No heartbeat from core client for 30 sec - exiting 22:35:24 (4564): No heartbeat from core client for 30 sec - exiting 22:35:25 (4564): No heartbeat from core client for 30 sec - exiting 22:35:26 (4564): No heartbeat from core client for 30 sec - exiting 22:35:27 (4564): No heartbeat from core client for 30 sec - exiting 22:35:28 (4564): No heartbeat from core client for 30 sec - exiting 22:35:29 (4564): No heartbeat from core client for 30 sec - exiting 22:35:30 (4564): No heartbeat from core client for 30 sec - exiting 22:35:31 (4564): No heartbeat from core client for 30 sec - exiting 22:35:32 (4564): No heartbeat from core client for 30 sec - exiting 22:35:33 (4564): No heartbeat from core client for 30 sec - exiting 22:35:34 (4564): No heartbeat from core client for 30 sec - exiting 22:35:35 (4564): No heartbeat from core client for 30 sec - exiting 22:35:36 (4564): No heartbeat from core client for 30 sec - exiting 22:35:37 (4564): No heartbeat from core client for 30 sec - exiting 22:35:38 (4564): No heartbeat from core client for 30 sec - exiting 22:35:39 (4564): No heartbeat from core client for 30 sec - exiting 22:35:40 (4564): No heartbeat from core client for 30 sec - exiting 22:35:41 (4564): No heartbeat from core client for 30 sec - exiting 22:35:42 (4564): No heartbeat from core client for 30 sec - exiting 22:35:43 (4564): No heartbeat from core client for 30 sec - exiting 22:35:44 (4564): No heartbeat from core client for 30 sec - exiting 22:35:45 (4564): No heartbeat from core client for 30 sec - exiting 22:35:46 (4564): No heartbeat from core client for 30 sec - exiting 22:35:47 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:48 (4564): No heartbeat from core client for 30 sec - exiting 22:35:49 (4564): No heartbeat from core client for 30 sec - exiting 22:35:50 (4564): No heartbeat from core client for 30 sec - exiting 22:35:51 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7524, selfPID=7524, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20888, selfPID=20888, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19280, selfPID=19280, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:39:17 (20928): No heartbeat from core client for 30 sec - exiting 20:39:18 (20928): No heartbeat from core client for 30 sec - exiting 20:39:19 (20928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20932, selfPID=20932, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23276, selfPID=23276, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:56:00 (292): No heartbeat from core client for 30 sec - exiting 09:56:01 (292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:19:37 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:34:21 (2172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:37:12 (9660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10664, selfPID=10664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:26 (14212): No heartbeat from core client for 30 sec - exiting 18:48:27 (14212): No heartbeat from core client for 30 sec - exiting 18:48:28 (14212): No heartbeat from core client for 30 sec - exiting 18:48:29 (14212): No heartbeat from core client for 30 sec - exiting 18:48:30 (14212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:31 (14212): No heartbeat from core client for 30 sec - exiting 18:48:32 (14212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:11:28 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:25:28 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:51:06 (7004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:33 (6472): No heartbeat from core client for 30 sec - exiting 21:59:34 (6472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3996, selfPID=9996, iMonCtr=1 Model crash detected, will try to restart... 10:24:51 (6880): No heartbeat from core client for 30 sec - exiting 10:24:52 (6880): No heartbeat from core client for 30 sec - exiting 10:24:53 (6880): No heartbeat from core client for 30 sec - exiting 10:24:54 (6880): No heartbeat from core client for 30 sec - exiting 10:24:55 (6880): No heartbeat from core client for 30 sec - exiting 10:24:56 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:48:54 (9568): No heartbeat from core client for 30 sec - exiting 16:48:55 (9568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:49:26 (9568): No heartbeat from core client for 30 sec - exiting 21:37:41 (8036): No heartbeat from core client for 30 sec - exiting 21:38:12 (8036): No heartbeat from core client for 30 sec - exiting 21:38:13 (8036): No heartbeat from core client for 30 sec - exiting 21:38:14 (8036): No heartbeat from core client for 30 sec - exiting 21:38:15 (8036): No heartbeat from core client for 30 sec - exiting 21:38:16 (8036): No heartbeat from core client for 30 sec - exiting 21:38:17 (8036): No heartbeat from core client for 30 sec - exiting 21:38:18 (8036): No heartbeat from core client for 30 sec - exiting 21:38:19 (8036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:40:48 (1192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:32:24 (7980): No heartbeat from core client for 30 sec - exiting 07:32:25 (7980): No heartbeat from core client for 30 sec - exiting 07:32:26 (7980): No heartbeat from core client for 30 sec - exiting 07:32:27 (7980): No heartbeat from core client for 30 sec - exiting 07:32:28 (7980): No heartbeat from core client for 30 sec - exiting 07:32:29 (7980): No heartbeat from core client for 30 sec - exiting 07:32:30 (7980): No heartbeat from core client for 30 sec - exiting 07:32:31 (7980): No heartbeat from core client for 30 sec - exiting 07:32:32 (7980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:58:19 (2932): No heartbeat from core client for 30 sec - exiting 22:58:20 (2932): No heartbeat from core client for 30 sec - exiting 22:58:21 (2932): No heartbeat from core client for 30 sec - exiting 22:58:22 (2932): No heartbeat from core client for 30 sec - exiting 22:58:23 (2932): No heartbeat from core client for 30 sec - exiting 22:58:24 (2932): No heartbeat from core client for 30 sec - exiting 22:58:25 (2932): No heartbeat from core client for 30 sec - exiting 22:58:26 (2932): No heartbeat from core client for 30 sec - exiting 22:58:27 (2932): No heartbeat from core client for 30 sec - exiting 22:58:28 (2932): No heartbeat from core client for 30 sec - exiting 22:58:29 (2932): No heartbeat from core client for 30 sec - exiting 22:58:30 (2932): No heartbeat from core client for 30 sec - exiting 22:58:31 (2932): No heartbeat from core client for 30 sec - exiting 22:58:32 (2932): No heartbeat from core client for 30 sec - exiting 22:58:33 (2932): No heartbeat from core client for 30 sec - exiting 22:58:34 (2932): No heartbeat from core client for 30 sec - exiting 22:58:35 (2932): No heartbeat from core client for 30 sec - exiting 22:58:36 (2932): No heartbeat from core client for 30 sec - exiting 22:58:37 (2932): No heartbeat from core client for 30 sec - exiting 22:58:38 (2932): No heartbeat from core client for 30 sec - exiting 22:58:39 (2932): No heartbeat from core client for 30 sec - exiting 22:58:40 (2932): No heartbeat from core client for 30 sec - exiting 22:58:41 (2932): No heartbeat from core client for 30 sec - exiting 22:58:42 (2932): No heartbeat from core client for 30 sec - exiting 22:58:43 (2932): No heartbeat from core client for 30 sec - exiting 22:58:44 (2932): No heartbeat from core client for 30 sec - exiting 22:58:45 (2932): No heartbeat from core client for 30 sec - exiting 22:58:46 (2932): No heartbeat from core client for 30 sec - exiting 22:58:47 (2932): No heartbeat from core client for 30 sec - exiting 22:58:48 (2932): No heartbeat from core client for 30 sec - exiting 22:58:49 (2932): No heartbeat from core client for 30 sec - exiting 22:58:50 (2932): No heartbeat from core client for 30 sec - exiting 22:58:51 (2932): No heartbeat from core client for 30 sec - exiting 22:58:52 (2932): No heartbeat from core client for 30 sec - exiting 22:58:53 (2932): No heartbeat from core client for 30 sec - exiting 22:58:54 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:55 (2932): No heartbeat from core client for 30 sec - exiting 22:58:57 (2932): No heartbeat from core client for 30 sec - exiting 22:59:29 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8072, selfPID=10892, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6468, selfPID=9508, iMonCtr=1 Model crash detected, will try to restart... 01:24:40 (3928): No heartbeat from core client for 30 sec - exiting 01:24:41 (3928): No heartbeat from core client for 30 sec - exiting 01:24:42 (3928): No heartbeat from core client for 30 sec - exiting 01:24:43 (3928): No heartbeat from core client for 30 sec - exiting 01:24:44 (3928): No heartbeat from core client for 30 sec - exiting 01:24:45 (3928): No heartbeat from core client for 30 sec - exiting 01:24:46 (3928): No heartbeat from core client for 30 sec - exiting 01:24:47 (3928): No heartbeat from core client for 30 sec - exiting 01:24:48 (3928): No heartbeat from core client for 30 sec - exiting 01:24:49 (3928): No heartbeat from core client for 30 sec - exiting 01:24:50 (3928): No heartbeat from core client for 30 sec - exiting 01:24:51 (3928): No heartbeat from core client for 30 sec - exiting 01:24:52 (3928): No heartbeat from core client for 30 sec - exiting 01:24:53 (3928): No heartbeat from core client for 30 sec - exiting 01:24:54 (3928): No heartbeat from core client for 30 sec - exiting 01:24:55 (3928): No heartbeat from core client for 30 sec - exiting 01:24:56 (3928): No heartbeat from core client for 30 sec - exiting 01:24:57 (3928): No heartbeat from core client for 30 sec - exiting 01:24:58 (3928): No heartbeat from core client for 30 sec - exiting 01:24:59 (3928): No heartbeat from core client for 30 sec - exiting 01:25:00 (3928): No heartbeat from core client for 30 sec - exiting 01:25:01 (3928): No heartbeat from core client for 30 sec - exiting 01:25:02 (3928): No heartbeat from core client for 30 sec - exiting 01:25:03 (3928): No heartbeat from core client for 30 sec - exiting 01:25:04 (3928): No heartbeat from core client for 30 sec - exiting 01:25:05 (3928): No heartbeat from core client for 30 sec - exiting 01:25:06 (3928): No heartbeat from core client for 30 sec - exiting 01:25:07 (3928): No heartbeat from core client for 30 sec - exiting 01:25:08 (3928): No heartbeat from core client for 30 sec - exiting 01:25:09 (3928): No heartbeat from core client for 30 sec - exiting 01:25:10 (3928): No heartbeat from core client for 30 sec - exiting 01:25:11 (3928): No heartbeat from core client for 30 sec - exiting 01:25:12 (3928): No heartbeat from core client for 30 sec - exiting 01:25:13 (3928): No heartbeat from core client for 30 sec - exiting 01:25:44 (3928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6368, selfPID=7868, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 09:36:34 (6524): No heartbeat from core client for 30 sec - exiting 09:36:35 (6524): No heartbeat from core client for 30 sec - exiting 09:36:36 (6524): No heartbeat from core client for 30 sec - exiting 09:36:37 (6524): No heartbeat from core client for 30 sec - exiting 09:36:38 (6524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4976, selfPID=6624, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5732, selfPID=5732, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5732, selfPID=5408, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8280, selfPID=8280, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8280, selfPID=1252, iMonCtr=1 01:22:10 (5532): No heartbeat from core client for 30 sec - exiting 01:22:11 (5532): No heartbeat from core client for 30 sec - exiting 01:22:12 (5532): No heartbeat from core client for 30 sec - exiting 01:22:13 (5532): No heartbeat from core client for 30 sec - exiting 01:22:14 (5532): No heartbeat from core client for 30 sec - exiting 01:22:15 (5532): No heartbeat from core client for 30 sec - exiting 01:22:16 (5532): No heartbeat from core client for 30 sec - exiting 01:22:17 (5532): No heartbeat from core client for 30 sec - exiting 01:22:18 (5532): No heartbeat from core client for 30 sec - exiting 01:22:19 (5532): No heartbeat from core client for 30 sec - exiting 01:22:20 (5532): No heartbeat from core client for 30 sec - exiting 01:22:21 (5532): No heartbeat from core client for 30 sec - exiting 01:22:22 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:22:23 (5532): No heartbeat from core client for 30 sec - exiting 01:22:24 (5532): No heartbeat from core client for 30 sec - exiting 01:22:25 (5532): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9508, selfPID=8556, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9508, selfPID=9508, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11576, selfPID=12804, iMonCtr=1 forrtl: Acceso denegado. forrtl: severe (38): error during write, unit 8, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_2qs0_1961_1_007384608\tmp\xaakm.pipe_dummy Image PC Routine Line Source hadam3p_eu_um_6.0 00FDA39A Unknown Unknown Unknown hadam3p_eu_um_6.0 00F82CD0 Unknown Unknown Unknown hadam3p_eu_um_6.0 00F81E9A Unknown Unknown Unknown hadam3p_eu_um_6.0 00F5AA9D Unknown Unknown Unknown hadam3p_eu_um_6.0 00EFF27C Unknown Unknown Unknown hadam3p_eu_um_6.0 00C79BD2 Unknown Unknown Unknown hadam3p_eu_um_6.0 00FBE638 Unknown Unknown Unknown kernel32.dll 7744339A Unknown Unknown Unknown ntdll.dll 77E39ED2 Unknown Unknown Unknown ntdll.dll 77E39EA5 Unknown Unknown Unknown Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9408, selfPID=9408, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9408, selfPID=12780, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9712, iMonCtr=2 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_2qs0_1961_1_007384608_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2qs0_1961_1_007384608_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2qs0_1961_1_007384608_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2qs0_1961_1_007384608_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Aug 2011 04:07:24	1160470	13185944	hadam3p_eu_2qs0_1961_1_007384608_0	92,256	300,041	3.2523
10 Aug 2011 04:47:39	1160470	13185944	hadam3p_eu_2qs0_1961_1_007384608_0	80,736	262,850	3.2557
09 Aug 2011 03:04:55	1160470	13185944	hadam3p_eu_2qs0_1961_1_007384608_0	69,216	224,966	3.2502
07 Aug 2011 18:43:30	1160470	13185944	hadam3p_eu_2qs0_1961_1_007384608_0	57,705	187,200	3.2441
07 Aug 2011 17:43:14	1160470	13185944	hadam3p_eu_2qs0_1961_1_007384608_0	57,696	186,663	3.2353
07 Aug 2011 00:33:47	1160470	13185944	hadam3p_eu_2qs0_1961_1_007384608_0	46,176	146,669	3.1763
06 Aug 2011 08:24:59	1160470	13185944	hadam3p_eu_2qs0_1961_1_007384608_0	34,656	110,249	3.1812
06 Aug 2011 01:44:10	1160470	13185944	hadam3p_eu_2qs0_1961_1_007384608_0	23,136	73,821	3.1907
04 Aug 2011 03:41:08	1160470	13185944	hadam3p_eu_2qs0_1961_1_007384608_0	11,616	36,307	3.1256