Task 13792710

Name	hadam3p_pnw_71y2_2003_1_007597762_1
Workunit	7775892
Created	18 Dec 2011, 4:17:24 UTC
Sent	18 Dec 2011, 6:39:56 UTC
Report deadline	29 Nov 2012, 11:59:56 UTC
Received	27 Dec 2011, 3:13:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1259863
Run time	2 days 20 hours 9 min 10 sec
CPU time	2 days 0 hours 37 min 19 sec
Validate state	Invalid
Credit	1,003.35
Device peak FLOPS	2.15 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:46:18 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:23 (4432): No heartbeat from core client for 30 sec - exiting 19:46:24 (4432): No heartbeat from core client for 30 sec - exiting 19:46:25 (4432): No heartbeat from core client for 30 sec - exiting 19:46:26 (4432): No heartbeat from core client for 30 sec - exiting 19:46:27 (4432): No heartbeat from core client for 30 sec - exiting 19:46:28 (4432): No heartbeat from core client for 30 sec - exiting 19:46:29 (4432): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=2 Model crash detected, will try to restart... G23:54:55 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:56 (5020): No heartbeat from core client for 30 sec - exiting 23:54:57 (5020): No heartbeat from core client for 30 sec - exiting 23:54:58 (5020): No heartbeat from core client for 30 sec - exiting 23:54:59 (5020): No heartbeat from core client for 30 sec - exiting 23:55:00 (5020): No heartbeat from core client for 30 sec - exiting 23:55:01 (5020): No heartbeat from core client for 30 sec - exiting 23:55:02 (5020): No heartbeat from core client for 30 sec - exiting 23:55:03 (5020): No heartbeat from core client for 30 sec - exiting 23:55:05 (5020): No heartbeat from core client for 30 sec - exiting 23:55:06 (5020): No heartbeat from core client for 30 sec - exiting 23:55:07 (5020): No heartbeat from core client for 30 sec - exiting 23:55:08 (5020): No heartbeat from core client for 30 sec - exiting 23:55:09 (5020): No heartbeat from core client for 30 sec - exiting 23:55:10 (5020): No heartbeat from core client for 30 sec - exiting 23:55:11 (5020): No heartbeat from core client for 30 sec - exiting 23:55:12 (5020): No heartbeat from core client for 30 sec - exiting 23:55:13 (5020): No heartbeat from core client for 30 sec - exiting 23:55:14 (5020): No heartbeat from core client for 30 sec - exiting 23:55:15 (5020): No heartbeat from core client for 30 sec - exiting 23:55:17 (5020): No heartbeat from core client for 30 sec - exiting 19:06:24 (4960): No heartbeat from core client for 30 sec - exiting 19:06:25 (4960): No heartbeat from core client for 30 sec - exiting 19:06:26 (4960): No heartbeat from core client for 30 sec - exiting 19:07:00 (4960): No heartbeat from core client for 30 sec - exiting 19:07:01 (4960): No heartbeat from core client for 30 sec - exiting 19:07:02 (4960): No heartbeat from core client for 30 sec - exiting 19:07:03 (4960): No heartbeat from core client for 30 sec - exiting 19:07:05 (4960): No heartbeat from core client for 30 sec - exiting 19:07:06 (4960): No heartbeat from core client for 30 sec - exiting 19:07:07 (4960): No heartbeat from core client for 30 sec - exiting 19:07:08 (4960): No heartbeat from core client for 30 sec - exiting 19:07:09 (4960): No heartbeat from core client for 30 sec - exiting 19:07:10 (4960): No heartbeat from core client for 30 sec - exiting 19:07:11 (4960): No heartbeat from core client for 30 sec - exiting 19:07:12 (4960): No heartbeat from core client for 30 sec - exiting 19:07:13 (4960): No heartbeat from core client for 30 sec - exiting 19:07:14 (4960): No heartbeat from core client for 30 sec - exiting 19:07:15 (4960): No heartbeat from core client for 30 sec - exiting 19:07:17 (4960): No heartbeat from core client for 30 sec - exiting 19:07:18 (4960): No heartbeat from core client for 30 sec - exiting 19:07:19 (4960): No heartbeat from core client for 30 sec - exiting 19:07:20 (4960): No heartbeat from core client for 30 sec - exiting 19:07:21 (4960): No heartbeat from core client for 30 sec - exiting 19:07:22 (4960): No heartbeat from core client for 30 sec - exiting 19:07:23 (4960): No heartbeat from core client for 30 sec - exiting 19:07:24 (4960): No heartbeat from core client for 30 sec - exiting 19:07:25 (4960): No heartbeat from core client for 30 sec - exiting 19:07:26 (4960): No heartbeat from core client for 30 sec - exiting 19:07:27 (4960): No heartbeat from core client for 30 sec - exiting 19:07:29 (4960): No heartbeat from core client for 30 sec - exiting 19:07:30 (4960): No heartbeat from core client for 30 sec - exiting 19:07:31 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4068, selfPID=4296, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 19:15:04 (3208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:06 (3208): No heartbeat from core client for 30 sec - exiting 19:15:07 (3208): No heartbeat from core client for 30 sec - exiting 19:15:08 (3208): No heartbeat from core client for 30 sec - exiting 19:15:09 (3208): No heartbeat from core client for 30 sec - exiting 19:15:10 (3208): No heartbeat from core client for 30 sec - exiting 19:15:11 (3208): No heartbeat from core client for 30 sec - exiting 19:15:12 (3208): No heartbeat from core client for 30 sec - exiting 19:15:13 (3208): No heartbeat from core client for 30 sec - exiting 19:15:14 (3208): No heartbeat from core client for 30 sec - exiting 19:15:15 (3208): No heartbeat from core client for 30 sec - exiting 19:15:16 (3208): No heartbeat from core client for 30 sec - exiting 19:15:18 (3208): No heartbeat from core client for 30 sec - exiting 20:35:22 (1508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:24 (1508): No heartbeat from core client for 30 sec - exiting 20:35:25 (1508): No heartbeat from core client for 30 sec - exiting 20:35:26 (1508): No heartbeat from core client for 30 sec - exiting 20:35:27 (1508): No heartbeat from core client for 30 sec - exiting 20:35:28 (1508): No heartbeat from core client for 30 sec - exiting 20:35:29 (1508): No heartbeat from core client for 30 sec - exiting 20:35:30 (1508): No heartbeat from core client for 30 sec - exiting 20:35:31 (1508): No heartbeat from core client for 30 sec - exiting 20:35:32 (1508): No heartbeat from core client for 30 sec - exiting 20:35:33 (1508): No heartbeat from core client for 30 sec - exiting 20:35:34 (1508): No heartbeat from core client for 30 sec - exiting 20:35:36 (1508): No heartbeat from core client for 30 sec - exiting 20:35:37 (1508): No heartbeat from core client for 30 sec - exiting 20:35:38 (1508): No heartbeat from core client for 30 sec - exiting 20:35:39 (1508): No heartbeat from core client for 30 sec - exiting 20:35:40 (1508): No heartbeat from core client for 30 sec - exiting 20:35:41 (1508): No heartbeat from core client for 30 sec - exiting 20:35:42 (1508): No heartbeat from core client for 30 sec - exiting 20:35:43 (1508): No heartbeat from core client for 30 sec - exiting 20:35:44 (1508): No heartbeat from core client for 30 sec - exiting 20:45:24 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4168, selfPID=3900, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:21:20 (2976): Can't acquire lockfile (32) - waiting 35s 18:21:55 (2976): Can't acquire lockfile (32) - exiting 18:21:55 (2976): Error: vZXÍt@CÉANZXÅ«Ü¹ñBÊÌvZXªgpÅ·B (0x20) 19:01:32 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:33 (4064): No heartbeat from core client for 30 sec - exiting 19:01:34 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4364, selfPID=3840, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4428, selfPID=3808, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4656, selfPID=3512, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3608, selfPID=3828, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_71y2_2003_1_007597762_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_71y2_2003_1_007597762_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_71y2_2003_1_007597762_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_71y2_2003_1_007597762_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_71y2_2003_1_007597762_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_71y2_2003_1_007597762_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_71y2_2003_1_007597762_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_71y2_2003_1_007597762_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Dec 2011 08:15:00	1186039	13792710	hadam3p_pnw_71y2_2003_1_007597762_1	46,176	153,778	3.3303
25 Dec 2011 05:58:17	1186039	13792710	hadam3p_pnw_71y2_2003_1_007597762_1	34,656	115,550	3.3342
24 Dec 2011 05:14:18	1186039	13792710	hadam3p_pnw_71y2_2003_1_007597762_1	23,136	77,345	3.3431
20 Dec 2011 21:04:35	1186039	13792710	hadam3p_pnw_71y2_2003_1_007597762_1	11,616	38,675	3.3295