Task 14098001

Name	hadam3p_pnw_8r6f_2005_1_007708179_2
Workunit	7863287
Created	15 Feb 2012, 14:40:30 UTC
Sent	15 Feb 2012, 14:40:48 UTC
Report deadline	27 Jan 2013, 20:00:48 UTC
Received	7 Apr 2012, 15:21:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1096354
Run time	10 days 23 hours 13 min 19 sec
CPU time	7 days 5 hours 6 min 35 sec
Validate state	Invalid
Credit	1,503.98
Device peak FLOPS	0.93 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4168, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 22:34:53 (5296): No heartbeat from core client for 30 sec - exiting 22:34:54 (5296): No heartbeat from core client for 30 sec - exiting 22:34:55 (5296): No heartbeat from core client for 30 sec - exiting 22:34:56 (5296): No heartbeat from core client for 30 sec - exiting 22:34:57 (5296): No heartbeat from core client for 30 sec - exiting 22:34:58 (5296): No heartbeat from core client for 30 sec - exiting 22:34:59 (5296): No heartbeat from core client for 30 sec - exiting 22:35:00 (5296): No heartbeat from core client for 30 sec - exiting 22:35:01 (5296): No heartbeat from core client for 30 sec - exiting 22:35:02 (5296): No heartbeat from core client for 30 sec - exiting 22:35:03 (5296): No heartbeat from core client for 30 sec - exiting 22:35:04 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4188, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5804, selfPID=5804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 09:30:22 (5996): No heartbeat from core client for 30 sec - exiting 09:30:23 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:24 (5996): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2348, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6116, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5976, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 11:36:35 (4352): No heartbeat from core client for 30 sec - exiting 11:36:36 (4352): No heartbeat from core client for 30 sec - exiting 11:36:38 (4352): No heartbeat from core client for 30 sec - exiting 11:36:39 (4352): No heartbeat from core client for 30 sec - exiting 11:36:40 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:53 (5016): No heartbeat from core client for 30 sec - exiting 19:05:55 (5016): No heartbeat from core client for 30 sec - exiting 19:05:56 (5016): No heartbeat from core client for 30 sec - exiting 19:05:57 (5016): No heartbeat from core client for 30 sec - exiting 19:05:58 (5016): No heartbeat from core client for 30 sec - exiting 19:05:59 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3696, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5136, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:44:07 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:28 (4204): No heartbeat from core client for 30 sec - exiting 21:19:29 (4204): No heartbeat from core client for 30 sec - exiting 21:19:30 (4204): No heartbeat from core client for 30 sec - exiting 21:19:31 (4204): No heartbeat from core client for 30 sec - exiting 21:19:32 (4204): No heartbeat from core client for 30 sec - exiting 21:19:33 (4204): No heartbeat from core client for 30 sec - exiting 21:19:34 (4204): No heartbeat from core client for 30 sec - exiting 21:19:35 (4204): No heartbeat from core client for 30 sec - exiting 21:19:36 (4204): No heartbeat from core client for 30 sec - exiting 21:19:37 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:38 (4204): No heartbeat from core client for 30 sec - exiting 09:54:50 (5220): No heartbeat from core client for 30 sec - exiting 09:54:51 (5220): No heartbeat from core client for 30 sec - exiting 09:54:52 (5220): No heartbeat from core client for 30 sec - exiting 09:54:54 (5220): No heartbeat from core client for 30 sec - exiting 09:54:55 (5220): No heartbeat from core client for 30 sec - exiting 09:54:56 (5220): No heartbeat from core client for 30 sec - exiting 09:54:57 (5220): No heartbeat from core client for 30 sec - exiting 09:54:58 (5220): No heartbeat from core client for 30 sec - exiting 09:54:59 (5220): No heartbeat from core client for 30 sec - exiting 09:55:00 (5220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:05:28 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5664, selfPID=5664, iMonCtr=2 GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5996, selfPID=5868, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4956, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1988, selfPID=2468, iMonCtr=1 Model crash detected, will try to restart... 16:42:41 (5416): No heartbeat from core client for 30 sec - exiting 16:42:42 (5416): No heartbeat from core client for 30 sec - exiting 16:42:43 (5416): No heartbeat from core client for 30 sec - exiting 16:42:45 (5416): No heartbeat from core client for 30 sec - exiting 16:42:46 (5416): No heartbeat from core client for 30 sec - exiting 16:42:47 (5416): No heartbeat from core client for 30 sec - exiting 16:42:48 (5416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:04:41 (5692): No heartbeat from core client for 30 sec - exiting 21:04:42 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4836, iMonCtr=2 Model crash detected, will try to restart... 10:07:04 (6120): No heartbeat from core client for 30 sec - exiting 10:07:05 (6120): No heartbeat from core client for 30 sec - exiting 10:07:06 (6120): No heartbeat from core client for 30 sec - exiting 10:07:07 (6120): No heartbeat from core client for 30 sec - exiting 10:07:08 (6120): No heartbeat from core client for 30 sec - exiting 10:07:10 (6120): No heartbeat from core client for 30 sec - exiting 10:07:11 (6120): No heartbeat from core client for 30 sec - exiting 10:07:12 (6120): No heartbeat from core client for 30 sec - exiting 10:07:13 (6120): No heartbeat from core client for 30 sec - exiting 10:07:14 (6120): No heartbeat from core client for 30 sec - exiting 10:07:15 (6120): No heartbeat from core client for 30 sec - exiting 10:07:16 (6120): No heartbeat from core client for 30 sec - exiting 10:07:17 (6120): No heartbeat from core client for 30 sec - exiting 10:07:18 (6120): No heartbeat from core client for 30 sec - exiting 10:07:19 (6120): No heartbeat from core client for 30 sec - exiting 10:07:20 (6120): No heartbeat from core client for 30 sec - exiting 10:07:21 (6120): No heartbeat from core client for 30 sec - exiting 10:07:22 (6120): No heartbeat from core client for 30 sec - exiting 10:07:23 (6120): No heartbeat from core client for 30 sec - exiting 10:07:24 (6120): No heartbeat from core client for 30 sec - exiting 10:07:25 (6120): No heartbeat from core client for 30 sec - exiting 10:07:26 (6120): No heartbeat from core client for 30 sec - exiting 10:07:27 (6120): No heartbeat from core client for 30 sec - exiting 10:07:28 (6120): No heartbeat from core client for 30 sec - exiting 10:07:29 (6120): No heartbeat from core client for 30 sec - exiting 10:07:30 (6120): No heartbeat from core client for 30 sec - exiting 10:07:31 (6120): No heartbeat from core client for 30 sec - exiting 10:07:32 (6120): No heartbeat from core client for 30 sec - exiting 10:07:33 (6120): No heartbeat from core client for 30 sec - exiting 10:07:34 (6120): No heartbeat from core client for 30 sec - exiting 10:07:35 (6120): No heartbeat from core client for 30 sec - exiting 10:07:36 (6120): No heartbeat from core client for 30 sec - exiting 10:07:37 (6120): No heartbeat from core client for 30 sec - exiting 10:07:38 (6120): No heartbeat from core client for 30 sec - exiting 10:07:39 (6120): No heartbeat from core client for 30 sec - exiting 10:07:40 (6120): No heartbeat from core client for 30 sec - exiting 10:07:41 (6120): No heartbeat from core client for 30 sec - exiting 10:07:42 (6120): No heartbeat from core client for 30 sec - exiting 10:07:43 (6120): No heartbeat from core client for 30 sec - exiting 10:07:45 (6120): No heartbeat from core client for 30 sec - exiting 10:07:46 (6120): No heartbeat from core client for 30 sec - exiting 10:07:47 (6120): No heartbeat from core client for 30 sec - exiting 10:07:48 (6120): No heartbeat from core client for 30 sec - exiting 10:07:49 (6120): No heartbeat from core client for 30 sec - exiting 10:07:50 (6120): No heartbeat from core client for 30 sec - exiting 10:07:51 (6120): No heartbeat from core client for 30 sec - exiting 10:07:52 (6120): No heartbeat from core client for 30 sec - exiting 10:07:53 (6120): No heartbeat from core client for 30 sec - exiting 10:07:54 (6120): No heartbeat from core client for 30 sec - exiting 10:07:55 (6120): No heartbeat from core client for 30 sec - exiting 10:07:56 (6120): No heartbeat from core client for 30 sec - exiting 10:07:57 (6120): No heartbeat from core client for 30 sec - exiting 10:07:58 (6120): No heartbeat from core client for 30 sec - exiting 10:07:59 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:12 (5272): No heartbeat from core client for 30 sec - exiting 11:33:14 (5272): No heartbeat from core client for 30 sec - exiting 11:33:16 (5272): No heartbeat from core client for 30 sec - exiting 11:33:18 (5272): No heartbeat from core client for 30 sec - exiting 11:33:19 (5272): No heartbeat from core client for 30 sec - exiting 11:33:20 (5272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=2 Model crash detected, will try to restart... 19:28:26 (5660): No heartbeat from core client for 30 sec - exiting 19:28:27 (5660): No heartbeat from core client for 30 sec - exiting 19:28:28 (5660): No heartbeat from core client for 30 sec - exiting 19:28:29 (5660): No heartbeat from core client for 30 sec - exiting 19:28:30 (5660): No heartbeat from core client for 30 sec - exiting 19:28:31 (5660): No heartbeat from core client for 30 sec - exiting 19:28:32 (5660): No heartbeat from core client for 30 sec - exiting 19:28:33 (5660): No heartbeat from core client for 30 sec - exiting 19:28:34 (5660): No heartbeat from core client for 30 sec - exiting 19:28:35 (5660): No heartbeat from core client for 30 sec - exiting 19:28:36 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5420, iMonCtr=2 Model crash detected, will try to restart... 17:04:59 (5744): No heartbeat from core client for 30 sec - exiting 17:05:00 (5744): No heartbeat from core client for 30 sec - exiting 17:05:01 (5744): No heartbeat from core client for 30 sec - exiting 17:05:02 (5744): No heartbeat from core client for 30 sec - exiting 17:05:03 (5744): No heartbeat from core client for 30 sec - exiting 17:05:04 (5744): No heartbeat from core client for 30 sec - exiting 17:05:05 (5744): No heartbeat from core client for 30 sec - exiting 17:05:06 (5744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional WorkerCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4444, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 22:02:21 (4540): No heartbeat from core client for 30 sec - exiting 22:02:22 (4540): No heartbeat from core client for 30 sec - exiting 22:02:23 (4540): No heartbeat from core client for 30 sec - exiting 22:02:24 (4540): No heartbeat from core client for 30 sec - exiting 22:02:25 (4540): No heartbeat from core client for 30 sec - exiting 22:02:26 (4540): No heartbeat from core client for 30 sec - exiting 22:02:27 (4540): No heartbeat from core client for 30 sec - exiting 22:02:28 (4540): No heartbeat from core client for 30 sec - exiting 22:02:29 (4540): No heartbeat from core client for 30 sec - exiting 22:02:30 (4540): No heartbeat from core client for 30 sec - exiting 22:02:31 (4540): No heartbeat from core client for 30 sec - exiting 22:02:32 (4540): No heartbeat from core client for 30 sec - exiting 22:02:33 (4540): No heartbeat from core client for 30 sec - exiting 22:02:34 (4540): No heartbeat from core client for 30 sec - exiting 22:02:36 (4540): No heartbeat from core client for 30 sec - exiting 22:02:37 (4540): No heartbeat from core client for 30 sec - exiting 22:02:38 (4540): No heartbeat from core client for 30 sec - exiting 22:02:39 (4540): No heartbeat from core client for 30 sec - exiting 22:02:40 (4540): No heartbeat from core client for 30 sec - exiting 22:02:41 (4540): No heartbeat from core client for 30 sec - exiting 22:02:42 (4540): No heartbeat from core client for 30 sec - exiting 22:02:43 (4540): No heartbeat from core client for 30 sec - exiting 22:02:44 (4540): No heartbeat from core client for 30 sec - exiting 22:02:45 (4540): No heartbeat from core client for 30 sec - exiting 22:02:46 (4540): No heartbeat from core client for 30 sec - exiting 22:02:47 (4540): No heartbeat from core client for 30 sec - exiting 22:02:48 (4540): No heartbeat from core client for 30 sec - exiting 22:02:49 (4540): No heartbeat from core client for 30 sec - exiting 22:02:50 (4540): No heartbeat from core client for 30 sec - exiting 22:02:51 (4540): No heartbeat from core client for 30 sec - exiting 22:02:52 (4540): No heartbeat from core client for 30 sec - exiting 22:02:53 (4540): No heartbeat from core client for 30 sec - exiting 22:02:54 (4540): No heartbeat from core client for 30 sec - exiting 22:02:55 (4540): No heartbeat from core client for 30 sec - exiting 22:02:56 (4540): No heartbeat from core client for 30 sec - exiting 22:02:57 (4540): No heartbeat from core client for 30 sec - exiting 22:02:58 (4540): No heartbeat from core client for 30 sec - exiting 22:03:00 (4540): No heartbeat from core client for 30 sec - exiting 22:03:01 (4540): No heartbeat from core client for 30 sec - exiting 22:03:02 (4540): No heartbeat from core client for 30 sec - exiting 22:03:03 (4540): No heartbeat from core client for 30 sec - exiting 22:03:04 (4540): No heartbeat from core client for 30 sec - exiting 22:03:05 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:06 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:03:08 (4808): No heartbeat from core client for 30 sec - exiting 18:03:09 (4808): No heartbeat from core client for 30 sec - exiting 18:03:10 (4808): No heartbeat from core client for 30 sec - exiting 18:03:11 (4808): No heartbeat from core client for 30 sec - exiting 18:03:12 (4808): No heartbeat from core client for 30 sec - exiting 18:03:13 (4808): No heartbeat from core client for 30 sec - exiting 18:03:14 (4808): No heartbeat from core client for 30 sec - exiting 18:03:15 (4808): No heartbeat from core client for 30 sec - exiting 18:03:16 (4808): No heartbeat from core client for 30 sec - exiting 18:03:17 (4808): No heartbeat from core client for 30 sec - exiting 18:03:18 (4808): No heartbeat from core client for 30 sec - exiting 18:03:19 (4808): No heartbeat from core client for 30 sec - exiting 18:03:21 (4808): No heartbeat from core client for 30 sec - exiting 18:03:22 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2412, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5396, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4688, selfPID=4836, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_8r6f_2005_1_007708179_2_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r6f_2005_1_007708179_2_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r6f_2005_1_007708179_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r6f_2005_1_007708179_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r6f_2005_1_007708179_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r6f_2005_1_007708179_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Apr 2012 19:31:27	1096354	14098001	hadam3p_pnw_8r6f_2005_1_007708179_2	69,216	579,115	8.3668
25 Mar 2012 18:37:16	1096354	14098001	hadam3p_pnw_8r6f_2005_1_007708179_2	57,696	484,727	8.4014
18 Mar 2012 19:41:47	1096354	14098001	hadam3p_pnw_8r6f_2005_1_007708179_2	46,176	388,367	8.4106
09 Mar 2012 09:41:45	1096354	14098001	hadam3p_pnw_8r6f_2005_1_007708179_2	34,657	292,962	8.4532
08 Mar 2012 22:31:22	1096354	14098001	hadam3p_pnw_8r6f_2005_1_007708179_2	34,656	291,792	8.4197
28 Feb 2012 20:10:46	1096354	14098001	hadam3p_pnw_8r6f_2005_1_007708179_2	23,136	197,679	8.5442
24 Feb 2012 12:48:13	1096354	14098001	hadam3p_pnw_8r6f_2005_1_007708179_2	11,617	99,048	8.5261
23 Feb 2012 22:16:04	1096354	14098001	hadam3p_pnw_8r6f_2005_1_007708179_2	11,616	97,964	8.4335