Task 14071719

Name	hadam3p_eu_vaa6_1989_1_006674572_2
Workunit	6877825
Created	6 Feb 2012, 20:08:53 UTC
Sent	6 Feb 2012, 21:53:22 UTC
Report deadline	19 Jan 2013, 3:13:22 UTC
Received	17 Feb 2012, 9:33:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1194710
Run time	2 days 1 hours 23 min 45 sec
CPU time	1 days 21 hours 43 min 36 sec
Validate state	Invalid
Credit	796.57
Device peak FLOPS	2.55 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6948, selfPID=6948, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:42:30 (4980): No heartbeat from core client for 30 sec - exiting 08:42:31 (4980): No heartbeat from core client for 30 sec - exiting 08:42:32 (4980): No heartbeat from core client for 30 sec - exiting 08:42:33 (4980): No heartbeat from core client for 30 sec - exiting 08:42:34 (4980): No heartbeat from core client for 30 sec - exiting 08:42:35 (4980): No heartbeat from core client for 30 sec - exiting 08:42:36 (4980): No heartbeat from core client for 30 sec - exiting 08:42:37 (4980): No heartbeat from core client for 30 sec - exiting 08:42:38 (4980): No heartbeat from core client for 30 sec - exiting 08:42:39 (4980): No heartbeat from core client for 30 sec - exiting 08:42:40 (4980): No heartbeat from core client for 30 sec - exiting 08:42:41 (4980): No heartbeat from core client for 30 sec - exiting 08:42:42 (4980): No heartbeat from core client for 30 sec - exiting 08:42:43 (4980): No heartbeat from core client for 30 sec - exiting 08:42:44 (4980): No heartbeat from core client for 30 sec - exiting 08:42:45 (4980): No heartbeat from core client for 30 sec - exiting 08:42:46 (4980): No heartbeat from core client for 30 sec - exiting 08:42:47 (4980): No heartbeat from core client for 30 sec - exiting 08:42:48 (4980): No heartbeat from core client for 30 sec - exiting 08:42:49 (4980): No heartbeat from core client for 30 sec - exiting 08:42:50 (4980): No heartbeat from core client for 30 sec - exiting 08:42:51 (4980): No heartbeat from core client for 30 sec - exiting 08:42:52 (4980): No heartbeat from core client for 30 sec - exiting 08:42:53 (4980): No heartbeat from core client for 30 sec - exiting 08:42:54 (4980): No heartbeat from core client for 30 sec - exiting 08:42:55 (4980): No heartbeat from core client for 30 sec - exiting 08:42:56 (4980): No heartbeat from core client for 30 sec - exiting 08:42:57 (4980): No heartbeat from core client for 30 sec - exiting 08:42:58 (4980): No heartbeat from core client for 30 sec - exiting 08:42:59 (4980): No heartbeat from core client for 30 sec - exiting 08:43:00 (4980): No heartbeat from core client for 30 sec - exiting 08:43:01 (4980): No heartbeat from core client for 30 sec - exiting 08:43:02 (4980): No heartbeat from core client for 30 sec - exiting 08:43:03 (4980): No heartbeat from core client for 30 sec - exiting 08:43:04 (4980): No heartbeat from core client for 30 sec - exiting 08:43:05 (4980): No heartbeat from core client for 30 sec - exiting 08:43:06 (4980): No heartbeat from core client for 30 sec - exiting 08:43:07 (4980): No heartbeat from core client for 30 sec - exiting 08:43:08 (4980): No heartbeat from core client for 30 sec - exiting 08:43:09 (4980): No heartbeat from core client for 30 sec - exiting 08:43:10 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4828, selfPID=6920, iMonCtr=1 Model crash detected, will try to restart... 09:02:24 (3260): No heartbeat from core client for 30 sec - exiting 09:02:25 (3260): No heartbeat from core client for 30 sec - exiting 09:02:26 (3260): No heartbeat from core client for 30 sec - exiting 09:02:27 (3260): No heartbeat from core client for 30 sec - exiting 09:02:28 (3260): No heartbeat from core client for 30 sec - exiting 09:02:29 (3260): No heartbeat from core client for 30 sec - exiting 09:02:30 (3260): No heartbeat from core client for 30 sec - exiting 09:02:31 (3260): No heartbeat from core client for 30 sec - exiting 09:02:32 (3260): No heartbeat from core client for 30 sec - exiting 09:02:33 (3260): No heartbeat from core client for 30 sec - exiting 09:02:34 (3260): No heartbeat from core client for 30 sec - exiting 09:02:35 (3260): No heartbeat from core client for 30 sec - exiting 09:02:36 (3260): No heartbeat from core client for 30 sec - exiting 09:02:37 (3260): No heartbeat from core client for 30 sec - exiting 09:02:38 (3260): No heartbeat from core client for 30 sec - exiting 09:02:39 (3260): No heartbeat from core client for 30 sec - exiting 09:02:40 (3260): No heartbeat from core client for 30 sec - exiting 09:02:41 (3260): No heartbeat from core client for 30 sec - exiting 09:02:42 (3260): No heartbeat from core client for 30 sec - exiting 09:02:43 (3260): No heartbeat from core client for 30 sec - exiting 09:02:44 (3260): No heartbeat from core client for 30 sec - exiting 09:02:45 (3260): No heartbeat from core client for 30 sec - exiting 09:02:46 (3260): No heartbeat from core client for 30 sec - exiting 09:02:47 (3260): No heartbeat from core client for 30 sec - exiting 09:02:48 (3260): No heartbeat from core client for 30 sec - exiting 09:02:49 (3260): No heartbeat from core client for 30 sec - exiting 09:02:50 (3260): No heartbeat from core client for 30 sec - exiting 09:02:51 (3260): No heartbeat from core client for 30 sec - exiting 09:02:52 (3260): No heartbeat from core client for 30 sec - exiting 09:02:53 (3260): No heartbeat from core client for 30 sec - exiting 09:02:54 (3260): No heartbeat from core client for 30 sec - exiting 09:02:55 (3260): No heartbeat from core client for 30 sec - exiting 09:02:56 (3260): No heartbeat from core client for 30 sec - exiting 09:02:57 (3260): No heartbeat from core client for 30 sec - exiting 09:02:58 (3260): No heartbeat from core client for 30 sec - exiting 09:02:59 (3260): No heartbeat from core client for 30 sec - exiting 09:03:00 (3260): No heartbeat from core client for 30 sec - exiting 09:03:01 (3260): No heartbeat from core client for 30 sec - exiting 09:03:02 (3260): No heartbeat from core client for 30 sec - exiting 09:03:03 (3260): No heartbeat from core client for 30 sec - exiting 09:03:04 (3260): No heartbeat from core client for 30 sec - exiting 09:03:05 (3260): No heartbeat from core client for 30 sec - exiting 09:03:06 (3260): No heartbeat from core client for 30 sec - exiting 09:03:07 (3260): No heartbeat from core client for 30 sec - exiting 09:03:08 (3260): No heartbeat from core client for 30 sec - exiting 09:03:09 (3260): No heartbeat from core client for 30 sec - exiting 09:03:10 (3260): No heartbeat from core client for 30 sec - exiting 09:03:11 (3260): No heartbeat from core client for 30 sec - exiting 09:03:12 (3260): No heartbeat from core client for 30 sec - exiting 09:03:13 (3260): No heartbeat from core client for 30 sec - exiting 09:03:14 (3260): No heartbeat from core client for 30 sec - exiting 09:03:15 (3260): No heartbeat from core client for 30 sec - exiting 09:03:16 (3260): No heartbeat from core client for 30 sec - exiting 09:03:17 (3260): No heartbeat from core client for 30 sec - exiting 09:03:18 (3260): No heartbeat from core client for 30 sec - exiting 09:03:19 (3260): No heartbeat from core client for 30 sec - exiting 09:03:20 (3260): No heartbeat from core client for 30 sec - exiting 09:03:21 (3260): No heartbeat from core client for 30 sec - exiting 09:03:22 (3260): No heartbeat from core client for 30 sec - exiting 09:03:23 (3260): No heartbeat from core client for 30 sec - exiting 09:03:24 (3260): No heartbeat from core client for 30 sec - exiting 09:03:25 (3260): No heartbeat from core client for 30 sec - exiting 09:03:26 (3260): No heartbeat from core client for 30 sec - exiting 09:03:27 (3260): No heartbeat from core client for 30 sec - exiting 09:03:28 (3260): No heartbeat from core client for 30 sec - exiting 09:03:29 (3260): No heartbeat from core client for 30 sec - exiting 09:03:30 (3260): No heartbeat from core client for 30 sec - exiting 09:03:31 (3260): No heartbeat from core client for 30 sec - exiting 09:03:32 (3260): No heartbeat from core client for 30 sec - exiting 09:03:33 (3260): No heartbeat from core client for 30 sec - exiting 09:03:34 (3260): No heartbeat from core client for 30 sec - exiting 09:03:35 (3260): No heartbeat from core client for 30 sec - exiting 09:03:36 (3260): No heartbeat from core client for 30 sec - exiting 09:03:37 (3260): No heartbeat from core client for 30 sec - exiting 09:03:38 (3260): No heartbeat from core client for 30 sec - exiting 09:03:39 (3260): No heartbeat from core client for 30 sec - exiting 09:03:40 (3260): No heartbeat from core client for 30 sec - exiting 09:03:41 (3260): No heartbeat from core client for 30 sec - exiting 09:03:42 (3260): No heartbeat from core client for 30 sec - exiting 09:03:43 (3260): No heartbeat from core client for 30 sec - exiting 09:03:44 (3260): No heartbeat from core client for 30 sec - exiting 09:03:45 (3260): No heartbeat from core client for 30 sec - exiting 09:03:46 (3260): No heartbeat from core client for 30 sec - exiting 09:03:47 (3260): No heartbeat from core client for 30 sec - exiting 09:03:48 (3260): No heartbeat from core client for 30 sec - exiting 09:03:49 (3260): No heartbeat from core client for 30 sec - exiting 09:03:50 (3260): No heartbeat from core client for 30 sec - exiting 09:03:51 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1704, iMonCtr=2 08:25:27 (4984): No heartbeat from core client for 30 sec - exiting 08:25:28 (4984): No heartbeat from core client for 30 sec - exiting 08:25:29 (4984): No heartbeat from core client for 30 sec - exiting 08:25:30 (4984): No heartbeat from core client for 30 sec - exiting 08:25:31 (4984): No heartbeat from core client for 30 sec - exiting 08:25:32 (4984): No heartbeat from core client for 30 sec - exiting 08:25:33 (4984): No heartbeat from core client for 30 sec - exiting 08:25:34 (4984): No heartbeat from core client for 30 sec - exiting 08:25:35 (4984): No heartbeat from core client for 30 sec - exiting 08:25:36 (4984): No heartbeat from core client for 30 sec - exiting 08:25:37 (4984): No heartbeat from core client for 30 sec - exiting 08:25:38 (4984): No heartbeat from core client for 30 sec - exiting 08:25:39 (4984): No heartbeat from core client for 30 sec - exiting 08:25:40 (4984): No heartbeat from core client for 30 sec - exiting 08:25:41 (4984): No heartbeat from core client for 30 sec - exiting 08:25:42 (4984): No heartbeat from core client for 30 sec - exiting 08:25:43 (4984): No heartbeat from core client for 30 sec - exiting 08:25:44 (4984): No heartbeat from core client for 30 sec - exiting 08:25:45 (4984): No heartbeat from core client for 30 sec - exiting 08:25:46 (4984): No heartbeat from core client for 30 sec - exiting 08:25:47 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7116, selfPID=6176, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... forrtl: severe (24): end-of-file during read, unit 9, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_vaa6_1989_1_006674572\tmp\xaakg.namelists Image PC Routine Line Source hadrm3p_eu_um_6.0 016AC52A Unknown Unknown Unknown hadrm3p_eu_um_6.0 01654460 Unknown Unknown Unknown hadrm3p_eu_um_6.0 0165362A Unknown Unknown Unknown hadrm3p_eu_um_6.0 01632469 Unknown Unknown Unknown hadrm3p_eu_um_6.0 015366EB Unknown Unknown Unknown hadrm3p_eu_um_6.0 015D2AE2 Unknown Unknown Unknown hadrm3p_eu_um_6.0 015D35AF Unknown Unknown Unknown hadrm3p_eu_um_6.0 01379860 Unknown Unknown Unknown hadrm3p_eu_um_6.0 01690893 Unknown Unknown Unknown kernel32.dll 7698339A Unknown Unknown Unknown ntdll.dll 77AC9EF2 Unknown Unknown Unknown ntdll.dll 77AC9EC5 Unknown Unknown Unknown forrtl: severe (24): end-of-file during read, unit 9, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_vaa6_1989_1_006674572\tmp\xaakm.namelists Image PC Routine Line Source hadam3p_eu_um_6.0 0150A39A Unknown Unknown Unknown hadam3p_eu_um_6.0 014B2CD0 Unknown Unknown Unknown hadam3p_eu_um_6.0 014B1E9A Unknown Unknown Unknown hadam3p_eu_um_6.0 01492819 Unknown Unknown Unknown hadam3p_eu_um_6.0 01392287 Unknown Unknown Unknown hadam3p_eu_um_6.0 0142E7B2 Unknown Unknown Unknown hadam3p_eu_um_6.0 0142F2DA Unknown Unknown Unknown hadam3p_eu_um_6.0 011A9BD2 Unknown Unknown Unknown hadam3p_eu_um_6.0 014EE638 Unknown Unknown Unknown kernel32.dll 7698339A Unknown Unknown Unknown ntdll.dll 77AC9EF2 Unknown Unknown Unknown ntdll.dll 77AC9EC5 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6060, selfPID=5756, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_vaa6_1989_1_006674572_2_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vaa6_1989_1_006674572_2_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vaa6_1989_1_006674572_2_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vaa6_1989_1_006674572_2_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vaa6_1989_1_006674572_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vaa6_1989_1_006674572_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vaa6_1989_1_006674572_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vaa6_1989_1_006674572_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Feb 2012 22:57:31	1194710	14071719	hadam3p_eu_vaa6_1989_1_006674572_2	46,176	133,143	2.8834
15 Feb 2012 13:07:13	1194710	14071719	hadam3p_eu_vaa6_1989_1_006674572_2	34,656	100,270	2.8933
13 Feb 2012 23:21:16	1194710	14071719	hadam3p_eu_vaa6_1989_1_006674572_2	23,136	67,258	2.9071
13 Feb 2012 13:23:19	1194710	14071719	hadam3p_eu_vaa6_1989_1_006674572_2	11,616	33,959	2.9235