Task 16693069

Name	hadam3p_eu_idzm_2013_1_008782566_0
Workunit	8928544
Created	24 Jun 2014, 18:35:34 UTC
Sent	24 Jun 2014, 18:35:52 UTC
Report deadline	6 Jun 2015, 23:55:52 UTC
Received	29 Jul 2014, 17:49:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1232555
Run time	2 days 20 hours 24 min 21 sec
CPU time	1 days 21 hours 17 min 27 sec
Validate state	Invalid
Credit	1,194.02
Device peak FLOPS	3.02 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:05:06 (8984): No heartbeat from core client for 30 sec - exiting 18:05:07 (8984): No heartbeat from core client for 30 sec - exiting 18:05:08 (8984): No heartbeat from core client for 30 sec - exiting 18:05:09 (8984): No heartbeat from core client for 30 sec - exiting 18:05:10 (8984): No heartbeat from core client for 30 sec - exiting 18:05:11 (8984): No heartbeat from core client for 30 sec - exiting 18:05:12 (8984): No heartbeat from core client for 30 sec - exiting 18:05:13 (8984): No heartbeat from core client for 30 sec - exiting 18:05:14 (8984): No heartbeat from core client for 30 sec - exiting 18:05:15 (8984): No heartbeat from core client for 30 sec - exiting 18:05:16 (8984): No heartbeat from core client for 30 sec - exiting 18:05:17 (8984): No heartbeat from core client for 30 sec - exiting 18:05:18 (8984): No heartbeat from core client for 30 sec - exiting 18:05:19 (8984): No heartbeat from core client for 30 sec - exiting 18:05:20 (8984): No heartbeat from core client for 30 sec - exiting 18:05:21 (8984): No heartbeat from core client for 30 sec - exiting 18:05:22 (8984): No heartbeat from core client for 30 sec - exiting 18:05:23 (8984): No heartbeat from core client for 30 sec - exiting 18:05:24 (8984): No heartbeat from core client for 30 sec - exiting 18:05:25 (8984): No heartbeat from core client for 30 sec - exiting 18:05:26 (8984): No heartbeat from core client for 30 sec - exiting 18:05:27 (8984): No heartbeat from core client for 30 sec - exiting 18:05:28 (8984): No heartbeat from core client for 30 sec - exiting 18:05:29 (8984): No heartbeat from core client for 30 sec - exiting 18:05:30 (8984): No heartbeat from core client for 30 sec - exiting 18:05:31 (8984): No heartbeat from core client for 30 sec - exiting 18:05:32 (8984): No heartbeat from core client for 30 sec - exiting 18:05:33 (8984): No heartbeat from core client for 30 sec - exiting 18:05:34 (8984): No heartbeat from core client for 30 sec - exiting 18:05:35 (8984): No heartbeat from core client for 30 sec - exiting 18:05:36 (8984): No heartbeat from core client for 30 sec - exiting 18:05:37 (8984): No heartbeat from core client for 30 sec - exiting 18:05:38 (8984): No heartbeat from core client for 30 sec - exiting 18:05:39 (8984): No heartbeat from core client for 30 sec - exiting 18:05:40 (8984): No heartbeat from core client for 30 sec - exiting 18:05:41 (8984): No heartbeat from core client for 30 sec - exiting 18:05:42 (8984): No heartbeat from core client for 30 sec - exiting 18:05:43 (8984): No heartbeat from core client for 30 sec - exiting 18:05:44 (8984): No heartbeat from core client for 30 sec - exiting 18:05:45 (8984): No heartbeat from core client for 30 sec - exiting 18:05:46 (8984): No heartbeat from core client for 30 sec - exiting 18:05:47 (8984): No heartbeat from core client for 30 sec - exiting 18:05:48 (8984): No heartbeat from core client for 30 sec - exiting 18:05:49 (8984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... GSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1436, selfPID=6488, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 18:22:18 (6812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional WorkerSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8656, selfPID=8656, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6548, selfPID=1916, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:57:26 (6512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:11:23 (7452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:24 (7452): No heartbeat from core client for 30 sec - exiting 21:11:25 (7452): No heartbeat from core client for 30 sec - exiting 21:11:26 (7452): No heartbeat from core client for 30 sec - exiting 21:11:27 (7452): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5988, selfPID=5988, iMonCtr=2 21:11:28 (7452): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:59:30 (6368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:19:15 (6328): No heartbeat from core client for 30 sec - exiting 18:19:16 (6328): No heartbeat from core client for 30 sec - exiting 18:19:17 (6328): No heartbeat from core client for 30 sec - exiting 18:19:18 (6328): No heartbeat from core client for 30 sec - exiting 18:19:19 (6328): No heartbeat from core client for 30 sec - exiting 18:19:20 (6328): No heartbeat from core client for 30 sec - exiting 18:19:21 (6328): No heartbeat from core client for 30 sec - exiting 18:19:22 (6328): No heartbeat from core client for 30 sec - exiting 18:19:23 (6328): No heartbeat from core client for 30 sec - exiting 18:19:24 (6328): No heartbeat from core client for 30 sec - exiting 18:19:25 (6328): No heartbeat from core client for 30 sec - exiting 18:19:26 (6328): No heartbeat from core client for 30 sec - exiting 18:19:27 (6328): No heartbeat from core client for 30 sec - exiting 18:19:28 (6328): No heartbeat from core client for 30 sec - exiting 18:19:29 (6328): No heartbeat from core client for 30 sec - exiting 18:19:30 (6328): No heartbeat from core client for 30 sec - exiting 18:19:31 (6328): No heartbeat from core client for 30 sec - exiting 18:19:32 (6328): No heartbeat from core client for 30 sec - exiting 18:19:33 (6328): No heartbeat from core client for 30 sec - exiting 18:19:34 (6328): No heartbeat from core client for 30 sec - exiting 18:19:35 (6328): No heartbeat from core client for 30 sec - exiting 18:19:36 (6328): No heartbeat from core client for 30 sec - exiting 18:19:37 (6328): No heartbeat from core client for 30 sec - exiting 18:19:38 (6328): No heartbeat from core client for 30 sec - exiting 18:19:39 (6328): No heartbeat from core client for 30 sec - exiting 18:19:40 (6328): No heartbeat from core client for 30 sec - exiting 18:19:41 (6328): No heartbeat from core client for 30 sec - exiting 18:19:42 (6328): No heartbeat from core client for 30 sec - exiting 18:19:43 (6328): No heartbeat from core client for 30 sec - exiting 18:19:44 (6328): No heartbeat from core client for 30 sec - exiting 18:19:45 (6328): No heartbeat from core client for 30 sec - exiting 18:19:46 (6328): No heartbeat from core client for 30 sec - exiting 18:19:47 (6328): No heartbeat from core client for 30 sec - exiting 18:19:48 (6328): No heartbeat from core client for 30 sec - exiting 18:19:49 (6328): No heartbeat from core client for 30 sec - exiting 18:19:50 (6328): No heartbeat from core client for 30 sec - exiting 18:19:51 (6328): No heartbeat from core client for 30 sec - exiting 18:19:52 (6328): No heartbeat from core client for 30 sec - exiting 18:19:53 (6328): No heartbeat from core client for 30 sec - exiting 18:19:54 (6328): No heartbeat from core client for 30 sec - exiting 18:19:55 (6328): No heartbeat from core client for 30 sec - exiting 18:19:56 (6328): No heartbeat from core client for 30 sec - exiting 18:19:57 (6328): No heartbeat from core client for 30 sec - exiting 18:19:58 (6328): No heartbeat from core client for 30 sec - exiting 18:19:59 (6328): No heartbeat from core client for 30 sec - exiting 18:20:00 (6328): No heartbeat from core client for 30 sec - exiting 18:20:01 (6328): No heartbeat from core client for 30 sec - exiting 18:20:02 (6328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7936, selfPID=6488, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9340, selfPID=7552, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10096, selfPID=10096, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5168, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9640, selfPID=6612, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:27:25 (7152): No heartbeat from core client for 30 sec - exiting 18:27:26 (7152): No heartbeat from core client for 30 sec - exiting 18:27:27 (7152): No heartbeat from core client for 30 sec - exiting 18:27:28 (7152): No heartbeat from core client for 30 sec - exiting 18:27:29 (7152): No heartbeat from core client for 30 sec - exiting 18:27:30 (7152): No heartbeat from core client for 30 sec - exiting 18:28:13 (7152): No heartbeat from core client for 30 sec - exiting 18:28:14 (7152): No heartbeat from core client for 30 sec - exiting 18:28:15 (7152): No heartbeat from core client for 30 sec - exiting 18:28:16 (7152): No heartbeat from core client for 30 sec - exiting 18:28:17 (7152): No heartbeat from core client for 30 sec - exiting 18:28:18 (7152): No heartbeat from core client for 30 sec - exiting 18:28:19 (7152): No heartbeat from core client for 30 sec - exiting 18:28:20 (7152): No heartbeat from core client for 30 sec - exiting 18:28:21 (7152): No heartbeat from core client for 30 sec - exiting 18:28:22 (7152): No heartbeat from core client for 30 sec - exiting 18:28:23 (7152): No heartbeat from core client for 30 sec - exiting 18:28:24 (7152): No heartbeat from core client for 30 sec - exiting 18:28:25 (7152): No heartbeat from core client for 30 sec - exiting 18:28:26 (7152): No heartbeat from core client for 30 sec - exiting 18:28:27 (7152): No heartbeat from core client for 30 sec - exiting 18:28:28 (7152): No heartbeat from core client for 30 sec - exiting 18:28:29 (7152): No heartbeat from core client for 30 sec - exiting 18:28:30 (7152): No heartbeat from core client for 30 sec - exiting 18:28:31 (7152): No heartbeat from core client for 30 sec - exiting 18:28:32 (7152): No heartbeat from core client for 30 sec - exiting 18:28:33 (7152): No heartbeat from core client for 30 sec - exiting 18:28:34 (7152): No heartbeat from core client for 30 sec - exiting 18:28:35 (7152): No heartbeat from core client for 30 sec - exiting 18:28:36 (7152): No heartbeat from core client for 30 sec - exiting 18:28:37 (7152): No heartbeat from core client for 30 sec - exiting 18:28:38 (7152): No heartbeat from core client for 30 sec - exiting 18:28:39 (7152): No heartbeat from core client for 30 sec - exiting 18:28:40 (7152): No heartbeat from core client for 30 sec - exiting 18:28:41 (7152): No heartbeat from core client for 30 sec - exiting 18:28:42 (7152): No heartbeat from core client for 30 sec - exiting 18:28:43 (7152): No heartbeat from core client for 30 sec - exiting 18:28:44 (7152): No heartbeat from core client for 30 sec - exiting 18:28:45 (7152): No heartbeat from core client for 30 sec - exiting 18:28:46 (7152): No heartbeat from core client for 30 sec - exiting 18:28:47 (7152): No heartbeat from core client for 30 sec - exiting 18:28:48 (7152): No heartbeat from core client for 30 sec - exiting 18:28:49 (7152): No heartbeat from core client for 30 sec - exiting 18:28:50 (7152): No heartbeat from core client for 30 sec - exiting 18:28:51 (7152): No heartbeat from core client for 30 sec - exiting 18:28:52 (7152): No heartbeat from core client for 30 sec - exiting 18:28:53 (7152): No heartbeat from core client for 30 sec - exiting 18:28:54 (7152): No heartbeat from core client for 30 sec - exiting 18:28:55 (7152): No heartbeat from core client for 30 sec - exiting 18:28:56 (7152): No heartbeat from core client for 30 sec - exiting 18:28:57 (7152): No heartbeat from core client for 30 sec - exiting 18:28:58 (7152): No heartbeat from core client for 30 sec - exiting 18:28:59 (7152): No heartbeat from core client for 30 sec - exiting 18:29:00 (7152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8888, selfPID=8888, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3960, selfPID=8180, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_idzm_2013_1_008782566/dataout/atmos_restart.day after 11 attempts forrtl: severe (24): end-of-file during read, unit 9, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_idzm_2013_1_008782566\tmp\xaakm.namelists Image PC Routine Line Source hadam3p_eu_um_6.0 014BA39A Unknown Unknown Unknown hadam3p_eu_um_6.0 01462CD0 Unknown Unknown Unknown hadam3p_eu_um_6.0 01461E9A Unknown Unknown Unknown hadam3p_eu_um_6.0 01442819 Unknown Unknown Unknown hadam3p_eu_um_6.0 01342287 Unknown Unknown Unknown hadam3p_eu_um_6.0 013DE7B2 Unknown Unknown Unknown hadam3p_eu_um_6.0 013DF2DA Unknown Unknown Unknown hadam3p_eu_um_6.0 01159BD2 Unknown Unknown Unknown hadam3p_eu_um_6.0 0149E638 Unknown Unknown Unknown KERNEL32.dll 7774338A Unknown Unknown Unknown ntdll.dll 77DB9F72 Unknown Unknown Unknown ntdll.dll 77DB9F45 Unknown Unknown Unknown forrtl: severe (24): end-of-file during read, unit 9, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_idzm_2013_1_008782566\tmp\xaakg.namelists Image PC Routine Line Source hadrm3p_eu_um_6.0 0061C52A Unknown Unknown Unknown hadrm3p_eu_um_6.0 005C4460 Unknown Unknown Unknown hadrm3p_eu_um_6.0 005C362A Unknown Unknown Unknown hadrm3p_eu_um_6.0 005A2469 Unknown Unknown Unknown hadrm3p_eu_um_6.0 004A66EB Unknown Unknown Unknown hadrm3p_eu_um_6.0 00542AE2 Unknown Unknown Unknown hadrm3p_eu_um_6.0 005435AF Unknown Unknown Unknown hadrm3p_eu_um_6.0 002E9860 Unknown Unknown Unknown hadrm3p_eu_um_6.0 00600893 Unknown Unknown Unknown KERNEL32.dll 7774338A Unknown Unknown Unknown ntdll.dll 77DB9F72 Unknown Unknown Unknown ntdll.dll 77DB9F45 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2128, selfPID=9096, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_idzm_2013_1_008782566_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_idzm_2013_1_008782566_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_idzm_2013_1_008782566_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_idzm_2013_1_008782566_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_idzm_2013_1_008782566_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_idzm_2013_1_008782566_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2014 15:53:39	1232555	16693069	hadam3p_eu_idzm_2013_1_008782566_0	69,216	141,361	2.0423
17 Jul 2014 19:27:24	1232555	16693069	hadam3p_eu_idzm_2013_1_008782566_0	57,696	117,292	2.0329
15 Jul 2014 18:25:35	1232555	16693069	hadam3p_eu_idzm_2013_1_008782566_0	46,176	93,662	2.0284
10 Jul 2014 17:27:48	1232555	16693069	hadam3p_eu_idzm_2013_1_008782566_0	34,656	70,266	2.0275
01 Jul 2014 20:08:34	1232555	16693069	hadam3p_eu_idzm_2013_1_008782566_0	23,136	47,191	2.0397
26 Jun 2014 20:18:18	1232555	16693069	hadam3p_eu_idzm_2013_1_008782566_0	11,616	23,612	2.0327