Task 14921167

Name	hadam3p_eu_91fs_1965_1_008051627_0
Workunit	8206741
Created	16 Jul 2012, 13:16:10 UTC
Sent	16 Jul 2012, 16:32:32 UTC
Report deadline	28 Jun 2013, 21:52:32 UTC
Received	28 Jul 2012, 20:58:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1177318
Run time	4 days 0 hours 56 min 51 sec
CPU time	3 days 17 hours 21 min 1 sec
Validate state	Invalid
Credit	1,591.48
Device peak FLOPS	2.46 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5676, selfPID=4804, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 14:59:47 (7416): No heartbeat from core client for 30 sec - exiting 14:59:48 (7416): No heartbeat from core client for 30 sec - exiting 14:59:49 (7416): No heartbeat from core client for 30 sec - exiting 14:59:50 (7416): No heartbeat from core client for 30 sec - exiting 14:59:51 (7416): No heartbeat from core client for 30 sec - exiting 14:59:52 (7416): No heartbeat from core client for 30 sec - exiting 14:59:53 (7416): No heartbeat from core client for 30 sec - exiting 14:59:54 (7416): No heartbeat from core client for 30 sec - exiting 14:59:55 (7416): No heartbeat from core client for 30 sec - exiting 14:59:56 (7416): No heartbeat from core client for 30 sec - exiting 14:59:57 (7416): No heartbeat from core client for 30 sec - exiting 14:59:58 (7416): No heartbeat from core client for 30 sec - exiting 14:59:59 (7416): No heartbeat from core client for 30 sec - exiting 15:00:00 (7416): No heartbeat from core client for 30 sec - exiting 15:00:01 (7416): No heartbeat from core client for 30 sec - exiting 15:00:02 (7416): No heartbeat from core client for 30 sec - exiting 15:00:03 (7416): No heartbeat from core client for 30 sec - exiting 15:00:04 (7416): No heartbeat from core client for 30 sec - exiting 15:00:05 (7416): No heartbeat from core client for 30 sec - exiting 15:00:06 (7416): No heartbeat from core client for 30 sec - exiting 15:00:07 (7416): No heartbeat from core client for 30 sec - exiting 15:00:08 (7416): No heartbeat from core client for 30 sec - exiting 15:00:09 (7416): No heartbeat from core client for 30 sec - exiting 15:00:10 (7416): No heartbeat from core client for 30 sec - exiting 15:00:11 (7416): No heartbeat from core client for 30 sec - exiting 15:00:12 (7416): No heartbeat from core client for 30 sec - exiting 15:00:13 (7416): No heartbeat from core client for 30 sec - exiting 15:00:14 (7416): No heartbeat from core client for 30 sec - exiting 15:00:15 (7416): No heartbeat from core client for 30 sec - exiting 15:00:16 (7416): No heartbeat from core client for 30 sec - exiting 15:00:17 (7416): No heartbeat from core client for 30 sec - exiting 15:00:18 (7416): No heartbeat from core client for 30 sec - exiting 15:00:19 (7416): No heartbeat from core client for 30 sec - exiting 15:00:20 (7416): No heartbeat from core client for 30 sec - exiting 15:00:21 (7416): No heartbeat from core client for 30 sec - exiting 15:00:22 (7416): No heartbeat from core client for 30 sec - exiting 15:00:23 (7416): No heartbeat from core client for 30 sec - exiting 15:00:24 (7416): No heartbeat from core client for 30 sec - exiting 15:00:25 (7416): No heartbeat from core client for 30 sec - exiting 15:00:26 (7416): No heartbeat from core client for 30 sec - exiting 15:00:27 (7416): No heartbeat from core client for 30 sec - exiting 15:00:28 (7416): No heartbeat from core client for 30 sec - exiting 15:00:29 (7416): No heartbeat from core client for 30 sec - exiting 15:00:30 (7416): No heartbeat from core client for 30 sec - exiting 15:00:31 (7416): No heartbeat from core client for 30 sec - exiting 15:00:32 (7416): No heartbeat from core client for 30 sec - exiting 15:00:33 (7416): No heartbeat from core client for 30 sec - exiting 15:00:34 (7416): No heartbeat from core client for 30 sec - exiting 15:00:35 (7416): No heartbeat from core client for 30 sec - exiting 15:00:36 (7416): No heartbeat from core client for 30 sec - exiting 15:00:37 (7416): No heartbeat from core client for 30 sec - exiting 15:00:38 (7416): No heartbeat from core client for 30 sec - exiting 15:00:39 (7416): No heartbeat from core client for 30 sec - exiting 15:00:40 (7416): No heartbeat from core client for 30 sec - exiting 15:00:41 (7416): No heartbeat from core client for 30 sec - exiting 15:00:42 (7416): No heartbeat from core client for 30 sec - exiting 15:00:43 (7416): No heartbeat from core client for 30 sec - exiting 15:00:44 (7416): No heartbeat from core client for 30 sec - exiting 15:00:45 (7416): No heartbeat from core client for 30 sec - exiting 15:00:46 (7416): No heartbeat from core client for 30 sec - exiting 15:00:47 (7416): No heartbeat from core client for 30 sec - exiting 15:00:48 (7416): No heartbeat from core client for 30 sec - exiting 15:00:49 (7416): No heartbeat from core client for 30 sec - exiting 15:00:50 (7416): No heartbeat from core client for 30 sec - exiting 15:00:51 (7416): No heartbeat from core client for 30 sec - exiting 15:00:52 (7416): No heartbeat from core client for 30 sec - exiting 15:00:53 (7416): No heartbeat from core client for 30 sec - exiting 15:00:54 (7416): No heartbeat from core client for 30 sec - exiting 15:00:55 (7416): No heartbeat from core client for 30 sec - exiting 15:00:56 (7416): No heartbeat from core client for 30 sec - exiting 15:00:57 (7416): No heartbeat from core client for 30 sec - exiting 15:00:58 (7416): No heartbeat from core client for 30 sec - exiting 15:00:59 (7416): No heartbeat from core client for 30 sec - exiting 15:01:00 (7416): No heartbeat from core client for 30 sec - exiting 15:01:01 (7416): No heartbeat from core client for 30 sec - exiting 15:01:02 (7416): No heartbeat from core client for 30 sec - exiting 15:01:03 (7416): No heartbeat from core client for 30 sec - exiting 15:01:04 (7416): No heartbeat from core client for 30 sec - exiting 15:01:05 (7416): No heartbeat from core client for 30 sec - exiting 15:01:06 (7416): No heartbeat from core client for 30 sec - exiting 15:01:07 (7416): No heartbeat from core client for 30 sec - exiting 15:01:08 (7416): No heartbeat from core client for 30 sec - exiting 15:01:09 (7416): No heartbeat from core client for 30 sec - exiting 15:01:10 (7416): No heartbeat from core client for 30 sec - exiting 15:01:11 (7416): No heartbeat from core client for 30 sec - exiting 15:01:12 (7416): No heartbeat from core client for 30 sec - exiting 15:01:13 (7416): No heartbeat from core client for 30 sec - exiting 15:01:14 (7416): No heartbeat from core client for 30 sec - exiting 15:01:15 (7416): No heartbeat from core client for 30 sec - exiting 15:01:16 (7416): No heartbeat from core client for 30 sec - exiting 15:01:17 (7416): No heartbeat from core client for 30 sec - exiting 15:01:18 (7416): No heartbeat from core client for 30 sec - exiting 15:01:19 (7416): No heartbeat from core client for 30 sec - exiting 15:01:20 (7416): No heartbeat from core client for 30 sec - exiting 15:01:21 (7416): No heartbeat from core client for 30 sec - exiting 15:01:22 (7416): No heartbeat from core client for 30 sec - exiting 15:01:23 (7416): No heartbeat from core client for 30 sec - exiting 15:01:24 (7416): No heartbeat from core client for 30 sec - exiting 15:01:25 (7416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:26 (7416): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2480, selfPID=272, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1220, selfPID=6436, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8028, selfPID=5444, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:50:19 (1076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6328, selfPID=4740, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6688, selfPID=5400, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:41:05 (6292): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file G:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_91fs_1965_1_008051627/dataout/atmos_restart.day after 11 attempts 22:41:06 (6292): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file G:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_91fs_1965_1_008051627/dataout/region_restart.day after 11 attempts 22:41:07 (6292): No heartbeat from core client for 30 sec - exiting 22:41:08 (6292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: cannot open input file G:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_91fs_1965_1_008051627/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file G:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_91fs_1965_1_008051627/dataout/region_restart.day after 11 attempts Model crashed:: EADHISIST:ndEnd oil filn inEAD f roromhhistory fille for nmelist N NLIIHIST O tm akm pi t a kg pi pe dum m y 2 48 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_91fs_1965_1_008051627_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_91fs_1965_1_008051627_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_91fs_1965_1_008051627_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_91fs_1965_1_008051627_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Jul 2012 11:39:37	1177318	14921167	hadam3p_eu_91fs_1965_1_008051627_0	92,256	292,905	3.1749
27 Jul 2012 16:57:41	1177318	14921167	hadam3p_eu_91fs_1965_1_008051627_0	80,736	256,380	3.1755
26 Jul 2012 17:48:27	1177318	14921167	hadam3p_eu_91fs_1965_1_008051627_0	69,216	221,026	3.1933
24 Jul 2012 09:04:01	1177318	14921167	hadam3p_eu_91fs_1965_1_008051627_0	57,696	186,033	3.2244
20 Jul 2012 19:52:47	1177318	14921167	hadam3p_eu_91fs_1965_1_008051627_0	46,176	148,899	3.2246
19 Jul 2012 08:26:11	1177318	14921167	hadam3p_eu_91fs_1965_1_008051627_0	34,656	111,909	3.2291
18 Jul 2012 20:23:18	1177318	14921167	hadam3p_eu_91fs_1965_1_008051627_0	23,136	74,514	3.2207
18 Jul 2012 08:29:05	1177318	14921167	hadam3p_eu_91fs_1965_1_008051627_0	11,616	36,062	3.1045