Task 14352529

Name	hadam3p_eu_9nag_1974_1_007854667_0
Workunit	8009779
Created	3 Apr 2012, 17:22:42 UTC
Sent	3 Apr 2012, 17:22:54 UTC
Report deadline	16 Mar 2013, 22:42:54 UTC
Received	18 May 2012, 15:33:16 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1208851
Run time	3 days 16 hours 33 min 40 sec
CPU time	2 days 23 hours 50 min 56 sec
Validate state	Invalid
Credit	1,988.94
Device peak FLOPS	2.85 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:08:21 (6760): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:50:49 (7988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6936, selfPID=6084, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:29:05 (5516): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:52:44 (8468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:29:19 (6928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:05:30 (5568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5948, selfPID=5948, iMonCtr=2 01:05:32 (5568): No heartbeat from core client for 30 sec - exiting 01:05:33 (5568): No heartbeat from core client for 30 sec - exiting 01:05:34 (5568): No heartbeat from core client for 30 sec - exiting 01:05:35 (5568): No heartbeat from core client for 30 sec - exiting 01:05:36 (5568): No heartbeat from core client for 30 sec - exiting 01:05:37 (5568): No heartbeat from core client for 30 sec - exiting 01:05:39 (5568): No heartbeat from core client for 30 sec - exiting 01:05:40 (5568): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:43:45 (628): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:45:19 (5804): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:06:21 (6208): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:20:09 (6688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:20:10 (6688): No heartbeat from core client for 30 sec - exiting 19:20:11 (6688): No heartbeat from core client for 30 sec - exiting 19:20:12 (6688): No heartbeat from core client for 30 sec - exiting 19:20:14 (6688): No heartbeat from core client for 30 sec - exiting 19:20:15 (6688): No heartbeat from core client for 30 sec - exiting 19:20:16 (6688): No heartbeat from core client for 30 sec - exiting 19:20:17 (6688): No heartbeat from core client for 30 sec - exiting 19:20:18 (6688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:29:59 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4792, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:06:02 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:03 (2932): No heartbeat from core client for 30 sec - exiting 16:06:05 (2932): No heartbeat from core client for 30 sec - exiting 16:06:06 (2932): No heartbeat from core client for 30 sec - exiting 16:06:07 (2932): No heartbeat from core client for 30 sec - exiting 16:06:08 (2932): No heartbeat from core client for 30 sec - exiting 16:06:09 (2932): No heartbeat from core client for 30 sec - exiting 16:06:10 (2932): No heartbeat from core client for 30 sec - exiting 16:06:12 (2932): No heartbeat from core client for 30 sec - exiting 16:06:13 (2932): No heartbeat from core client for 30 sec - exiting 16:06:14 (2932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:14:18 (7544): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:26:14 (7196): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:26:14 (7164): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:19:37 (1292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:17:58 (5296): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:17:59 (5296): No heartbeat from core client for 30 sec - exiting 00:18:00 (5296): No heartbeat from core client for 30 sec - exiting 00:18:01 (5296): No heartbeat from core client for 30 sec - exiting 00:18:02 (5296): No heartbeat from core client for 30 sec - exiting 00:18:04 (5296): No heartbeat from core client for 30 sec - exiting 00:18:05 (5296): No heartbeat from core client for 30 sec - exiting 00:18:06 (5296): No heartbeat from core client for 30 sec - exiting 00:18:07 (5296): No heartbeat from core client for 30 sec - exiting 00:18:08 (5296): No heartbeat from core client for 30 sec - exiting 00:18:12 (5296): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:02:21 (6100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:02:22 (6100): No heartbeat from core client for 30 sec - exiting 00:02:23 (6100): No heartbeat from core client for 30 sec - exiting 00:02:24 (6100): No heartbeat from core client for 30 sec - exiting 00:02:25 (6100): No heartbeat from core client for 30 sec - exiting 00:02:27 (6100): No heartbeat from core client for 30 sec - exiting 00:02:28 (6100): No heartbeat from core client for 30 sec - exiting 00:02:29 (6100): No heartbeat from core client for 30 sec - exiting 00:02:30 (6100): No heartbeat from core client for 30 sec - exiting 00:02:31 (6100): No heartbeat from core client for 30 sec - exiting 00:02:33 (6100): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:40:35 (7396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:53:57 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:53:58 (3992): No heartbeat from core client for 30 sec - exiting 00:53:59 (3992): No heartbeat from core client for 30 sec - exiting 00:54:00 (3992): No heartbeat from core client for 30 sec - exiting 00:54:02 (3992): No heartbeat from core client for 30 sec - exiting 00:54:03 (3992): No heartbeat from core client for 30 sec - exiting 00:54:04 (3992): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6364, selfPID=6364, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 02:05:00 (7336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4448, selfPID=6836, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:53:12 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:03:10 (7184): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:24:03 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:24:04 (5776): No heartbeat from core client for 30 sec - exiting 00:24:05 (5776): No heartbeat from core client for 30 sec - exiting 00:24:06 (5776): No heartbeat from core client for 30 sec - exiting 00:24:08 (5776): No heartbeat from core client for 30 sec - exiting 00:24:09 (5776): No heartbeat from core client for 30 sec - exiting 00:24:10 (5776): No heartbeat from core client for 30 sec - exiting 00:24:11 (5776): No heartbeat from core client for 30 sec - exiting 00:24:12 (5776): No heartbeat from core client for 30 sec - exiting 00:24:13 (5776): No heartbeat from core client for 30 sec - exiting 00:24:14 (5776): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:33:53 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:15:11 (6444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:12 (6444): No heartbeat from core client for 30 sec - exiting 00:15:13 (6444): No heartbeat from core client for 30 sec - exiting 00:15:15 (6444): No heartbeat from core client for 30 sec - exiting 00:15:16 (6444): No heartbeat from core client for 30 sec - exiting 00:15:17 (6444): No heartbeat from core client for 30 sec - exiting 00:15:18 (6444): No heartbeat from core client for 30 sec - exiting 00:15:19 (6444): No heartbeat from core client for 30 sec - exiting 00:15:20 (6444): No heartbeat from core client for 30 sec - exiting 00:15:21 (6444): No heartbeat from core client for 30 sec - exiting 00:15:23 (6444): No heartbeat from core client for 30 sec - exiting 00:15:24 (6444): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:11:26 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Access is denied. forrtl: severe (38): error during write, unit 8, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_9nag_1974_1_007854667\tmp\xaakm.pipe_dummy Image PC Routine Line Source hadam3p_eu_um_6.0 00FBA39A Unknown Unknown Unknown hadam3p_eu_um_6.0 00F62CD0 Unknown Unknown Unknown hadam3p_eu_um_6.0 00F61E9A Unknown Unknown Unknown hadam3p_eu_um_6.0 00F3AA9D Unknown Unknown Unknown hadam3p_eu_um_6.0 00EDF27C Unknown Unknown Unknown hadam3p_eu_um_6.0 00C59BD2 Unknown Unknown Unknown hadam3p_eu_um_6.0 00F9E638 Unknown Unknown Unknown kernel32.dll 7550339A Unknown Unknown Unknown ntdll.dll 77499EF2 Unknown Unknown Unknown ntdll.dll 77499EC5 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7648, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_9nag_1974_1_007854667_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nag_1974_1_007854667_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 May 2012 14:39:35	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	115,296	235,963	2.0466
13 May 2012 16:17:13	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	103,776	212,474	2.0474
11 May 2012 20:04:53	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	92,256	189,109	2.0498
09 May 2012 17:17:18	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	80,736	166,125	2.0576
08 May 2012 14:55:49	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	69,216	142,853	2.0639
06 May 2012 00:53:40	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	57,696	119,307	2.0679
05 May 2012 00:12:26	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	46,176	95,551	2.0693
14 Apr 2012 19:11:26	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	34,656	71,463	2.0621
12 Apr 2012 20:28:31	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	23,136	47,420	2.0496
05 Apr 2012 18:02:37	1208851	14352529	hadam3p_eu_9nag_1974_1_007854667_0	11,616	23,910	2.0584