Task 12601517

Name	hadam3p_eu_2rn2_1969_1_007169318_0
Workunit	7354158
Created	18 Feb 2011, 18:45:08 UTC
Sent	20 Feb 2011, 6:24:16 UTC
Report deadline	2 Feb 2012, 11:44:16 UTC
Received	8 Mar 2011, 13:31:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1044542
Run time	7 days 0 hours 3 min 14 sec
CPU time	4 days 7 hours 13 min 58 sec
Validate state	Invalid
Credit	1,194.02
Device peak FLOPS	2.11 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.08 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3052, selfPID=3052, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:43:55 (6624): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7384, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5208, selfPID=5208, iMonCtr=2 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8140, selfPID=8160, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8140, selfPID=8140, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4624, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4024, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2936, selfPID=2976, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 23:18:49 (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5364, selfPID=5364, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2588, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5948, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4512, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9840, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3320, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5480, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4984, iMonCtr=2 Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1132, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3740, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5820, selfPID=5756, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4236, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5716, selfPID=5848, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2324, selfPID=5916, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6400, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:44:37 (4912): No heartbeat from core client for 30 sec - exiting 22:44:38 (4912): No heartbeat from core client for 30 sec - exiting 22:44:39 (4912): No heartbeat from core client for 30 sec - exiting 22:44:40 (4912): No heartbeat from core client for 30 sec - exiting 22:44:42 (4912): No heartbeat from core client for 30 sec - exiting 22:44:43 (4912): No heartbeat from core client for 30 sec - exiting 22:44:44 (4912): No heartbeat from core client for 30 sec - exiting 22:44:45 (4912): No heartbeat from core client for 30 sec - exiting 22:44:46 (4912): No heartbeat from core client for 30 sec - exiting 22:44:47 (4912): No heartbeat from core client for 30 sec - exiting 22:44:48 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2936, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5880, selfPID=5712, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4304, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5376, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5516, selfPID=5300, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5816, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5900, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4864, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5484, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5256, selfPID=5564, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5972, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4860, selfPID=5816, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4596, selfPID=4456, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1268, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5864, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5116, selfPID=4768, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2324, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4436, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5180, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5184, selfPID=6128, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_2rn2_1969_1_007169318/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_2rn2_1969_1_007169318/dataout/region_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... 22:30:36 (4232): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_2rn2_1969_1_007169318_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2rn2_1969_1_007169318_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2rn2_1969_1_007169318_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2rn2_1969_1_007169318_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2rn2_1969_1_007169318_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2rn2_1969_1_007169318_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2011 10:26:54	1044542	12601517	hadam3p_eu_2rn2_1969_1_007169318_0	69,216	352,965	5.0995
08 Mar 2011 10:26:54	1044542	12601517	hadam3p_eu_2rn2_1969_1_007169318_0	57,696	294,246	5.0999
08 Mar 2011 10:26:54	1044542	12601517	hadam3p_eu_2rn2_1969_1_007169318_0	46,176	235,757	5.1056
08 Mar 2011 10:26:54	1044542	12601517	hadam3p_eu_2rn2_1969_1_007169318_0	34,656	178,291	5.1446
27 Feb 2011 16:11:19	1044542	12601517	hadam3p_eu_2rn2_1969_1_007169318_0	23,196	122,431	5.2781
26 Feb 2011 16:52:57	1044542	12601517	hadam3p_eu_2rn2_1969_1_007169318_0	23,136	121,298	5.2428
24 Feb 2011 15:05:37	1044542	12601517	hadam3p_eu_2rn2_1969_1_007169318_0	11,900	64,099	5.3865
24 Feb 2011 04:13:05	1044542	12601517	hadam3p_eu_2rn2_1969_1_007169318_0	11,616	61,094	5.2595