Task 14356612

Name	hadam3p_pnw_8r0s_2000_1_007707976_1
Workunit	7863084
Created	4 Apr 2012, 15:14:16 UTC
Sent	4 Apr 2012, 15:14:25 UTC
Report deadline	17 Mar 2013, 20:34:25 UTC
Received	8 Apr 2012, 14:50:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	900316
Run time	2 days 4 hours 10 min 5 sec
CPU time	2 days 2 hours 50 min 16 sec
Validate state	Invalid
Credit	753.03
Device peak FLOPS	1.72 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> 04:12:41 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:21:01 (336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:11:38 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:10:33 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:09:31 (788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:35 (1844): No heartbeat from core client for 30 sec - exiting 19:10:36 (1844): No heartbeat from core client for 30 sec - exiting 19:10:38 (1844): No heartbeat from core client for 30 sec - exiting 19:10:39 (1844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:40 (1844): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:08:21 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:09:34 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:04:03 (960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:10 (2848): No heartbeat from core client for 30 sec - exiting 20:05:11 (2848): No heartbeat from core client for 30 sec - exiting 20:05:12 (2848): No heartbeat from core client for 30 sec - exiting 20:05:13 (2848): No heartbeat from core client for 30 sec - exiting 20:05:14 (2848): No heartbeat from core client for 30 sec - exiting 20:05:15 (2848): No heartbeat from core client for 30 sec - exiting 20:05:16 (2848): No heartbeat from core client for 30 sec - exiting 20:05:17 (2848): No heartbeat from core client for 30 sec - exiting 20:05:18 (2848): No heartbeat from core client for 30 sec - exiting 20:05:19 (2848): No heartbeat from core client for 30 sec - exiting 20:05:20 (2848): No heartbeat from core client for 30 sec - exiting 20:05:22 (2848): No heartbeat from core client for 30 sec - exiting 20:05:23 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:03:02 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:06 (2360): No heartbeat from core client for 30 sec - exiting 01:04:07 (2360): No heartbeat from core client for 30 sec - exiting 01:04:09 (2360): No heartbeat from core client for 30 sec - exiting 01:04:10 (2360): No heartbeat from core client for 30 sec - exiting 01:04:11 (2360): No heartbeat from core client for 30 sec - exiting 01:04:12 (2360): No heartbeat from core client for 30 sec - exiting 01:04:13 (2360): No heartbeat from core client for 30 sec - exiting 01:04:14 (2360): No heartbeat from core client for 30 sec - exiting 01:04:15 (2360): No heartbeat from core client for 30 sec - exiting 01:04:16 (2360): No heartbeat from core client for 30 sec - exiting 01:04:17 (2360): No heartbeat from core client for 30 sec - exiting 01:04:18 (2360): No heartbeat from core client for 30 sec - exiting 01:04:19 (2360): No heartbeat from core client for 30 sec - exiting 01:04:21 (2360): No heartbeat from core client for 30 sec - exiting 01:04:22 (2360): No heartbeat from core client for 30 sec - exiting 01:04:23 (2360): No heartbeat from core client for 30 sec - exiting 01:04:24 (2360): No heartbeat from core client for 30 sec - exiting 01:04:25 (2360): No heartbeat from core client for 30 sec - exiting 01:04:26 (2360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:00:56 (1384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:01 (2568): No heartbeat from core client for 30 sec - exiting 11:02:02 (2568): No heartbeat from core client for 30 sec - exiting 11:02:03 (2568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:58:50 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:56:41 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:57:54 (5772): No heartbeat from core client for 30 sec - exiting 06:57:55 (5772): No heartbeat from core client for 30 sec - exiting 06:57:56 (5772): No heartbeat from core client for 30 sec - exiting 06:57:57 (5772): No heartbeat from core client for 30 sec - exiting 06:57:58 (5772): No heartbeat from core client for 30 sec - exiting 06:57:59 (5772): No heartbeat from core client for 30 sec - exiting 06:58:00 (5772): No heartbeat from core client for 30 sec - exiting 06:58:01 (5772): No heartbeat from core client for 30 sec - exiting 06:58:03 (5772): No heartbeat from core client for 30 sec - exiting 06:58:04 (5772): No heartbeat from core client for 30 sec - exiting 06:58:05 (5772): No heartbeat from core client for 30 sec - exiting 06:58:06 (5772): No heartbeat from core client for 30 sec - exiting 06:58:07 (5772): No heartbeat from core client for 30 sec - exiting 06:58:08 (5772): No heartbeat from core client for 30 sec - exiting 06:58:09 (5772): No heartbeat from core client for 30 sec - exiting 06:58:10 (5772): No heartbeat from core client for 30 sec - exiting 06:58:11 (5772): No heartbeat from core client for 30 sec - exiting 06:58:12 (5772): No heartbeat from core client for 30 sec - exiting 06:58:14 (5772): No heartbeat from core client for 30 sec - exiting 06:58:15 (5772): No heartbeat from core client for 30 sec - exiting 06:58:16 (5772): No heartbeat from core client for 30 sec - exiting 06:58:17 (5772): No heartbeat from core client for 30 sec - exiting 06:58:18 (5772): No heartbeat from core client for 30 sec - exiting 06:58:19 (5772): No heartbeat from core client for 30 sec - exiting 06:58:20 (5772): No heartbeat from core client for 30 sec - exiting 06:58:21 (5772): No heartbeat from core client for 30 sec - exiting 06:58:22 (5772): No heartbeat from core client for 30 sec - exiting 06:58:23 (5772): No heartbeat from core client for 30 sec - exiting 06:58:24 (5772): No heartbeat from core client for 30 sec - exiting 06:58:26 (5772): No heartbeat from core client for 30 sec - exiting 06:58:27 (5772): No heartbeat from core client for 30 sec - exiting 06:58:28 (5772): No heartbeat from core client for 30 sec - exiting 06:58:29 (5772): No heartbeat from core client for 30 sec - exiting 06:58:30 (5772): No heartbeat from core client for 30 sec - exiting 06:58:31 (5772): No heartbeat from core client for 30 sec - exiting 06:58:32 (5772): No heartbeat from core client for 30 sec - exiting 06:58:33 (5772): No heartbeat from core client for 30 sec - exiting 06:58:34 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4148, selfPID=4148, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:54:35 (2948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:46 (4464): No heartbeat from core client for 30 sec - exiting 16:55:47 (4464): No heartbeat from core client for 30 sec - exiting 16:55:48 (4464): No heartbeat from core client for 30 sec - exiting 16:55:49 (4464): No heartbeat from core client for 30 sec - exiting 16:55:50 (4464): No heartbeat from core client for 30 sec - exiting 16:55:52 (4464): No heartbeat from core client for 30 sec - exiting 16:55:53 (4464): No heartbeat from core client for 30 sec - exiting 16:55:54 (4464): No heartbeat from core client for 30 sec - exiting 16:55:55 (4464): No heartbeat from core client for 30 sec - exiting 16:55:56 (4464): No heartbeat from core client for 30 sec - exiting 16:55:57 (4464): No heartbeat from core client for 30 sec - exiting 16:55:58 (4464): No heartbeat from core client for 30 sec - exiting 16:55:59 (4464): No heartbeat from core client for 30 sec - exiting 16:56:00 (4464): No heartbeat from core client for 30 sec - exiting 16:56:01 (4464): No heartbeat from core client for 30 sec - exiting 16:56:02 (4464): No heartbeat from core client for 30 sec - exiting 16:56:04 (4464): No heartbeat from core client for 30 sec - exiting 16:56:05 (4464): No heartbeat from core client for 30 sec - exiting 16:56:06 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:07 (4464): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:53:35 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:54:42 (5000): No heartbeat from core client for 30 sec - exiting 21:54:43 (5000): No heartbeat from core client for 30 sec - exiting 21:54:44 (5000): No heartbeat from core client for 30 sec - exiting 21:54:45 (5000): No heartbeat from core client for 30 sec - exiting 21:54:46 (5000): No heartbeat from core client for 30 sec - exiting 21:54:47 (5000): No heartbeat from core client for 30 sec - exiting 21:54:48 (5000): No heartbeat from core client for 30 sec - exiting 21:54:50 (5000): No heartbeat from core client for 30 sec - exiting 21:54:51 (5000): No heartbeat from core client for 30 sec - exiting 21:54:52 (5000): No heartbeat from core client for 30 sec - exiting 21:54:53 (5000): No heartbeat from core client for 30 sec - exiting 21:54:54 (5000): No heartbeat from core client for 30 sec - exiting 21:54:55 (5000): No heartbeat from core client for 30 sec - exiting 21:54:56 (5000): No heartbeat from core client for 30 sec - exiting 21:54:57 (5000): No heartbeat from core client for 30 sec - exiting 21:54:58 (5000): No heartbeat from core client for 30 sec - exiting 21:54:59 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_8r0s_2000_1_007707976_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r0s_2000_1_007707976_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r0s_2000_1_007707976_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r0s_2000_1_007707976_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r0s_2000_1_007707976_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r0s_2000_1_007707976_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r0s_2000_1_007707976_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r0s_2000_1_007707976_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r0s_2000_1_007707976_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Apr 2012 19:38:24	900316	14356612	hadam3p_pnw_8r0s_2000_1_007707976_1	34,656	140,159	4.0443
06 Apr 2012 10:07:34	900316	14356612	hadam3p_pnw_8r0s_2000_1_007707976_1	23,136	93,055	4.0221
05 Apr 2012 06:18:14	900316	14356612	hadam3p_pnw_8r0s_2000_1_007707976_1	11,616	46,941	4.0411