Task 15127324

Name	hadam3p_pnw_6wtk_2006_1_008150840_2
Workunit	8305964
Created	15 Aug 2012, 22:19:34 UTC
Sent	15 Aug 2012, 23:01:41 UTC
Report deadline	29 Jul 2013, 4:21:41 UTC
Received	2 Sep 2012, 18:01:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1232385
Run time	1 days 21 hours 34 min 9 sec
CPU time	1 days 18 hours 20 min
Validate state	Invalid
Credit	2,004.61
Device peak FLOPS	3.39 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:13:50 (4028): No heartbeat from core client for 30 sec - exiting 15:13:51 (4028): No heartbeat from core client for 30 sec - exiting 15:13:52 (4028): No heartbeat from core client for 30 sec - exiting 15:13:53 (4028): No heartbeat from core client for 30 sec - exiting 15:13:54 (4028): No heartbeat from core client for 30 sec - exiting 15:13:55 (4028): No heartbeat from core client for 30 sec - exiting 15:13:56 (4028): No heartbeat from core client for 30 sec - exiting 15:13:57 (4028): No heartbeat from core client for 30 sec - exiting 15:13:59 (4028): No heartbeat from core client for 30 sec - exiting 15:14:00 (4028): No heartbeat from core client for 30 sec - exiting 15:14:01 (4028): No heartbeat from core client for 30 sec - exiting 15:14:02 (4028): No heartbeat from core client for 30 sec - exiting 15:14:03 (4028): No heartbeat from core client for 30 sec - exiting 15:14:04 (4028): No heartbeat from core client for 30 sec - exiting 15:14:05 (4028): No heartbeat from core client for 30 sec - exiting 15:14:06 (4028): No heartbeat from core client for 30 sec - exiting 15:14:07 (4028): No heartbeat from core client for 30 sec - exiting 15:14:08 (4028): No heartbeat from core client for 30 sec - exiting 15:14:09 (4028): No heartbeat from core client for 30 sec - exiting 15:14:11 (4028): No heartbeat from core client for 30 sec - exiting 15:14:12 (4028): No heartbeat from core client for 30 sec - exiting 15:14:13 (4028): No heartbeat from core client for 30 sec - exiting 15:14:14 (4028): No heartbeat from core client for 30 sec - exiting 15:14:15 (4028): No heartbeat from core client for 30 sec - exiting 15:14:16 (4028): No heartbeat from core client for 30 sec - exiting 15:14:17 (4028): No heartbeat from core client for 30 sec - exiting 15:14:18 (4028): No heartbeat from core client for 30 sec - exiting 15:14:19 (4028): No heartbeat from core client for 30 sec - exiting 15:14:20 (4028): No heartbeat from core client for 30 sec - exiting 15:14:21 (4028): No heartbeat from core client for 30 sec - exiting 15:14:23 (4028): No heartbeat from core client for 30 sec - exiting 15:14:24 (4028): No heartbeat from core client for 30 sec - exiting 15:14:25 (4028): No heartbeat from core client for 30 sec - exiting 15:14:26 (4028): No heartbeat from core client for 30 sec - exiting 15:14:27 (4028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5664, selfPID=7908, iMonCtr=1 Model crash detected, will try to restart... 20:15:21 (1416): No heartbeat from core client for 30 sec - exiting 20:15:22 (1416): No heartbeat from core client for 30 sec - exiting 20:15:23 (1416): No heartbeat from core client for 30 sec - exiting 20:15:25 (1416): No heartbeat from core client for 30 sec - exiting 20:15:26 (1416): No heartbeat from core client for 30 sec - exiting 20:15:27 (1416): No heartbeat from core client for 30 sec - exiting 20:15:28 (1416): No heartbeat from core client for 30 sec - exiting 20:15:29 (1416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:00:13 (4488): No heartbeat from core client for 30 sec - exiting 23:00:14 (4488): No heartbeat from core client for 30 sec - exiting 23:00:15 (4488): No heartbeat from core client for 30 sec - exiting 23:00:16 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:48:11 (6132): No heartbeat from core client for 30 sec - exiting 08:48:12 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:19:19 (4192): No heartbeat from core client for 30 sec - exiting 19:19:20 (4192): No heartbeat from core client for 30 sec - exiting 19:19:21 (4192): No heartbeat from core client for 30 sec - exiting 19:19:22 (4192): No heartbeat from core client for 30 sec - exiting 19:19:23 (4192): No heartbeat from core client for 30 sec - exiting 19:19:25 (4192): No heartbeat from core client for 30 sec - exiting 19:19:26 (4192): No heartbeat from core client for 30 sec - exiting 19:19:27 (4192): No heartbeat from core client for 30 sec - exiting 19:19:28 (4192): No heartbeat from core client for 30 sec - exiting 19:19:29 (4192): No heartbeat from core client for 30 sec - exiting 19:19:30 (4192): No heartbeat from core client for 30 sec - exiting 19:19:31 (4192): No heartbeat from core client for 30 sec - exiting 19:19:32 (4192): No heartbeat from core client for 30 sec - exiting 19:19:33 (4192): No heartbeat from core client for 30 sec - exiting 19:19:34 (4192): No heartbeat from core client for 30 sec - exiting 19:19:35 (4192): No heartbeat from core client for 30 sec - exiting 19:19:37 (4192): No heartbeat from core client for 30 sec - exiting 19:19:38 (4192): No heartbeat from core client for 30 sec - exiting 19:19:39 (4192): No heartbeat from core client for 30 sec - exiting 19:19:40 (4192): No heartbeat from core client for 30 sec - exiting 19:19:41 (4192): No heartbeat from core client for 30 sec - exiting 19:19:42 (4192): No heartbeat from core client for 30 sec - exiting 19:19:43 (4192): No heartbeat from core client for 30 sec - exiting 19:19:44 (4192): No heartbeat from core client for 30 sec - exiting 19:19:45 (4192): No heartbeat from core client for 30 sec - exiting 19:19:46 (4192): No heartbeat from core client for 30 sec - exiting 19:19:47 (4192): No heartbeat from core client for 30 sec - exiting 19:19:49 (4192): No heartbeat from core client for 30 sec - exiting 19:19:50 (4192): No heartbeat from core client for 30 sec - exiting 19:19:51 (4192): No heartbeat from core client for 30 sec - exiting 19:19:52 (4192): No heartbeat from core client for 30 sec - exiting 19:19:53 (4192): No heartbeat from core client for 30 sec - exiting 19:19:54 (4192): No heartbeat from core client for 30 sec - exiting 19:19:55 (4192): No heartbeat from core client for 30 sec - exiting 19:19:56 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5176, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8692, selfPID=7712, iMonCtr=1 Model crash detected, will try to restart... 01:56:43 (2332): No heartbeat from core client for 30 sec - exiting 01:56:45 (2332): No heartbeat from core client for 30 sec - exiting 01:56:46 (2332): No heartbeat from core client for 30 sec - exiting 01:56:47 (2332): No heartbeat from core client for 30 sec - exiting 01:56:48 (2332): No heartbeat from core client for 30 sec - exiting 01:56:49 (2332): No heartbeat from core client for 30 sec - exiting 01:56:50 (2332): No heartbeat from core client for 30 sec - exiting 01:56:51 (2332): No heartbeat from core client for 30 sec - exiting 01:56:52 (2332): No heartbeat from core client for 30 sec - exiting 01:56:53 (2332): No heartbeat from core client for 30 sec - exiting 01:56:54 (2332): No heartbeat from core client for 30 sec - exiting 01:56:55 (2332): No heartbeat from core client for 30 sec - exiting 01:56:57 (2332): No heartbeat from core client for 30 sec - exiting 01:56:58 (2332): No heartbeat from core client for 30 sec - exiting 01:56:59 (2332): No heartbeat from core client for 30 sec - exiting 01:57:00 (2332): No heartbeat from core client for 30 sec - exiting 01:57:01 (2332): No heartbeat from core client for 30 sec - exiting 01:57:02 (2332): No heartbeat from core client for 30 sec - exiting 01:57:03 (2332): No heartbeat from core client for 30 sec - exiting 01:57:04 (2332): No heartbeat from core client for 30 sec - exiting 01:57:05 (2332): No heartbeat from core client for 30 sec - exiting 01:57:06 (2332): No heartbeat from core client for 30 sec - exiting 01:57:07 (2332): No heartbeat from core client for 30 sec - exiting 01:57:09 (2332): No heartbeat from core client for 30 sec - exiting 01:57:10 (2332): No heartbeat from core client for 30 sec - exiting 01:57:11 (2332): No heartbeat from core client for 30 sec - exiting 01:57:12 (2332): No heartbeat from core client for 30 sec - exiting 01:57:13 (2332): No heartbeat from core client for 30 sec - exiting 01:57:14 (2332): No heartbeat from core client for 30 sec - exiting 01:57:15 (2332): No heartbeat from core client for 30 sec - exiting 01:57:16 (2332): No heartbeat from core client for 30 sec - exiting 01:57:17 (2332): No heartbeat from core client for 30 sec - exiting 01:57:18 (2332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=804, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4948, selfPID=3880, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_6wtk_2006_1_008150840_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_6wtk_2006_1_008150840_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_6wtk_2006_1_008150840_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_6wtk_2006_1_008150840_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Sep 2012 18:08:53	1232385	15127324	hadam3p_pnw_6wtk_2006_1_008150840_2	92,256	151,364	1.6407
28 Aug 2012 11:06:29	1232385	15127324	hadam3p_pnw_6wtk_2006_1_008150840_2	80,736	132,625	1.6427
27 Aug 2012 03:15:09	1232385	15127324	hadam3p_pnw_6wtk_2006_1_008150840_2	69,216	113,615	1.6415
23 Aug 2012 23:59:12	1232385	15127324	hadam3p_pnw_6wtk_2006_1_008150840_2	57,696	94,514	1.6381
23 Aug 2012 18:39:21	1232385	15127324	hadam3p_pnw_6wtk_2006_1_008150840_2	46,176	75,522	1.6355
20 Aug 2012 04:33:37	1232385	15127324	hadam3p_pnw_6wtk_2006_1_008150840_2	34,656	56,592	1.6330
19 Aug 2012 23:27:35	1232385	15127324	hadam3p_pnw_6wtk_2006_1_008150840_2	23,136	37,634	1.6266
18 Aug 2012 01:52:52	1232385	15127324	hadam3p_pnw_6wtk_2006_1_008150840_2	11,616	18,998	1.6355