Task 14890240

Name	hadam3p_pnw_bgvs_1960_1_008039885_0
Workunit	8194999
Created	10 Jul 2012, 11:08:09 UTC
Sent	10 Jul 2012, 11:14:02 UTC
Report deadline	22 Jun 2013, 16:34:02 UTC
Received	18 Aug 2012, 2:46:16 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1167449
Run time	12 days 17 hours 55 min 50 sec
CPU time	10 days 17 hours 24 min 5 sec
Validate state	Invalid
Credit	1,754.30
Device peak FLOPS	0.66 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> 19:20:15 (2700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:19:06 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:17:57 (380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:09:47 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:57 (2544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:39 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:35 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:16:30 (368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:15:18 (2620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:04 (240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:10:29 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:09:20 (5828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:21 (444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:25 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No22:31:35 (2676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:30:33 (2516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... RegioCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:05:27 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:04:26 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:26 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=164, selfPID=164, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:08:35 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:37 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:35:56 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:34:57 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:33:55 (4240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - QuiCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional23:44:40 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:43:37 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:32 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:48:50 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:01:23 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:47:42 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:46:29 (2316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit21:50:44 (2984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:49:43 (5316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:40 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:04 (3272): No heartbeat from core client for 30 sec - exiting 13:50:06 (3272): No heartbeat from core client for 30 sec - exiting 13:50:07 (3272): No heartbeat from core client for 30 sec - exiting 13:50:09 (3272): No heartbeat from core client for 30 sec - exiting 13:50:10 (3272): No heartbeat from core client for 30 sec - exiting 13:50:12 (3272): No heartbeat from core client for 30 sec - exiting 13:50:13 (3272): No heartbeat from core client for 30 sec - exiting 13:50:15 (3272): No heartbeat from core client for 30 sec - exiting 13:50:22 (3272): No heartbeat from core client for 30 sec - exiting 13:50:23 (3272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:25 (3360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:46:15 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:07 (608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:48:38 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:42:33 (2200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:01:41 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:01:42 (4752): No heartbeat from core client for 30 sec - exiting 03:41:50 (5828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:52 (5828): No heartbeat from core client for 30 sec - exiting No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5336, selfPID=5336, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 11:41:48 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:43 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:39:40 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:27 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:28 (4728): No heartbeat from core client for 30 sec - exiting 12:31:08 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:47 (5496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:57 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:17 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:56 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:27:56 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:26:40 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5768, selfPID=5768, iMonCtr=2 12:35:17 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:34:08 (3928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:33:04 (5404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2168, selfPID=2168, iMonCtr=2 04:32:01 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:58 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:45:35 (1812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:30 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:43:22 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:42:14 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:09 (484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:09 (480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:39:04 (1912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:38:01 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:18 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:29 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:07 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:04 (2828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:25:00 (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:24:01 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:45:29 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:31 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4360, selfPID=4360, iMonCtr=2 15:25:55 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:55 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:23:46 (4772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:22:44 (5836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not runn03:01:20 (1940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R06:21:25 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: 11:54:43 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:56:12 (3968): No heartbeat from core client for 30 sec - exiting 11:56:13 (3968): No heartbeat from core client for 30 sec - exiting 11:56:14 (3968): No heartbeat from core client for 30 sec - exiting 11:56:15 (3968): No heartbeat from core client for 30 sec - exiting 11:56:17 (3968): No heartbeat from core client for 30 sec - exiting 11:56:18 (3968): No heartbeat from core client for 30 sec - exiting 11:56:19 (3968): No heartbeat from core client for 30 sec - exiting 11:56:21 (3968): No heartbeat from core client for 30 sec - exiting 11:56:22 (3968): No heartbeat from core client for 30 sec - exiting 11:56:23 (3968): No heartbeat from core client for 30 sec - exiting 11:56:24 (3968): No heartbeat from core client for 30 sec - exiting 11:56:25 (3968): No heartbeat from core client for 30 sec - exiting 11:56:27 (3968): No heartbeat from core client for 30 sec - exiting 11:56:28 (3968): No heartbeat from core client for 30 sec - exiting 11:56:29 (3968): No heartbeat from core client for 30 sec - exiting 11:56:31 (3968): No heartbeat from core client for 30 sec - exiting 11:56:32 (3968): No heartbeat from core client for 30 sec - exiting 11:56:35 (3968): No heartbeat from core client for 30 sec - exiting 11:56:37 (3968): No heartbeat from core client for 30 sec - exiting 11:56:38 (3968): No heartbeat from core client for 30 sec - exiting 11:56:39 (3968): No heartbeat from core client for 30 sec - exiting 11:56:41 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:53:22 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:54:53 (5816): No heartbeat from core client for 30 sec - exiting 15:54:55 (5816): No heartbeat from core client for 30 sec - exiting 15:54:56 (5816): No heartbeat from core client for 30 sec - exiting 15:54:57 (5816): No heartbeat from core client for 30 sec - exiting 15:54:59 (5816): No heartbeat from core client for 30 sec - exiting 15:55:00 (5816): No heartbeat from core client for 30 sec - exiting 15:55:01 (5816): No heartbeat from core client for 30 sec - exiting 15:55:02 (5816): No heartbeat from core client for 30 sec - exiting 15:55:04 (5816): No heartbeat from core client for 30 sec - exiting 15:55:05 (5816): No heartbeat from core client for 30 sec - exiting 15:55:06 (5816): No heartbeat from core client for 30 sec - exiting 15:55:08 (5816): No heartbeat from core client for 30 sec - exiting 15:55:09 (5816): No heartbeat from core client for 30 sec - exiting 15:55:10 (5816): No heartbeat from core client for 30 sec - exiting 15:55:11 (5816): No heartbeat from core client for 30 sec - exiting 15:55:13 (5816): No heartbeat from core client for 30 sec - exiting 15:55:14 (5816): No heartbeat from core client for 30 sec - exiting 15:55:15 (5816): No heartbeat from core client for 30 sec - exiting 15:55:17 (5816): No heartbeat from core client for 30 sec - exiting 15:55:18 (5816): No heartbeat from core client for 30 sec - exiting 15:55:19 (5816): No heartbeat from core client for 30 sec - exiting 15:55:20 (5816): No heartbeat from core client for 30 sec - exiting 15:55:22 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:23 (5816): No heartbeat from core client for 30 sec - exiting 15:55:25 (5816): No heartbeat from core client for 30 sec - exiting 19:52:15 (1680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:08 (4208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:01 (1640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:36:33 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:42:40 (1192): No heartbeat from core client for 30 sec - exiting 11:42:44 (1192): No heartbeat from core client for 30 sec - exiting 11:42:49 (1192): No heartbeat from core client for 30 sec - exiting 11:42:55 (1192): No heartbeat from core client for 30 sec - exiting 11:42:57 (1192): No heartbeat from core client for 30 sec - exiting 11:43:04 (1192): No heartbeat from core client for 30 sec - exiting 11:43:10 (1192): No heartbeat from core client for 30 sec - exiting 11:43:17 (1192): No heartbeat from core client for 30 sec - exiting 11:43:20 (1192): No heartbeat from core client for 30 sec - exiting 11:43:26 (1192): No heartbeat from core client for 30 sec - exiting 11:43:35 (1192): No heartbeat from core client for 30 sec - exiting 11:43:47 (1192): No heartbeat from core client for 30 sec - exiting 11:43:54 (1192): No heartbeat from core client for 30 sec - exiting 11:44:01 (1192): No heartbeat from core client for 30 sec - exiting 11:44:09 (1192): No heartbeat from core client for 30 sec - exiting 11:44:15 (1192): No heartbeat from core client for 30 sec - exiting 11:44:24 (1192): No heartbeat from core client for 30 sec - exiting 11:44:30 (1192): No heartbeat from core client for 30 sec - exiting 11:44:38 (1192): No heartbeat from core client for 30 sec - exiting 11:44:44 (1192): No heartbeat from core client for 30 sec - exiting 11:44:51 (1192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:12 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:08 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:17 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:33:04 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:55 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:17 (3384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:42:31 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=260, selfPID=260, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=260, selfPID=4308, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_bgvs_1960_1_008039885_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bgvs_1960_1_008039885_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bgvs_1960_1_008039885_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bgvs_1960_1_008039885_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bgvs_1960_1_008039885_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Aug 2012 06:28:49	1167449	14890240	hadam3p_pnw_bgvs_1960_1_008039885_0	80,736	831,547	10.2996
10 Aug 2012 22:09:42	1167449	14890240	hadam3p_pnw_bgvs_1960_1_008039885_0	69,216	700,660	10.1228
05 Aug 2012 22:21:59	1167449	14890240	hadam3p_pnw_bgvs_1960_1_008039885_0	57,696	544,932	9.4449
04 Aug 2012 09:20:36	1167449	14890240	hadam3p_pnw_bgvs_1960_1_008039885_0	46,176	477,454	10.3399
03 Aug 2012 04:05:39	1167449	14890240	hadam3p_pnw_bgvs_1960_1_008039885_0	34,657	411,107	11.8622
03 Aug 2012 03:05:30	1167449	14890240	hadam3p_pnw_bgvs_1960_1_008039885_0	34,656	409,338	11.8115
31 Jul 2012 03:56:28	1167449	14890240	hadam3p_pnw_bgvs_1960_1_008039885_0	23,136	275,330	11.9005
28 Jul 2012 00:47:33	1167449	14890240	hadam3p_pnw_bgvs_1960_1_008039885_0	11,616	144,356	12.4273