Task 14862804

Name	hadam3p_pnw_bzr0_1972_1_008027967_1
Workunit	8183081
Created	4 Jul 2012, 18:49:18 UTC
Sent	4 Jul 2012, 18:49:40 UTC
Report deadline	17 Jun 2013, 0:09:40 UTC
Received	19 Jul 2012, 15:51:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1181982
Run time	2 days 7 hours 31 min 23 sec
CPU time	2 days 1 hours 31 min 30 sec
Validate state	Invalid
Credit	2,004.61
Device peak FLOPS	3.52 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:04:41 (29202): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:19:45 (26861): No heartbeat from core client for 30 sec - exiting 12:19:46 (26861): No heartbeat from core client for 30 sec - exiting 12:19:47 (26861): No heartbeat from core client for 30 sec - exiting 12:19:48 (26861): No heartbeat from core client for 30 sec - exiting 12:19:49 (26861): No heartbeat from core client for 30 sec - exiting 12:19:50 (26861): No heartbeat from core client for 30 sec - exiting 12:19:51 (26861): No heartbeat from core client for 30 sec - exiting 12:19:53 (26861): No heartbeat from core client for 30 sec - exiting 12:19:54 (26861): No heartbeat from core client for 30 sec - exiting 12:19:55 (26861): No heartbeat from core client for 30 sec - exiting 12:19:56 (26861): No heartbeat from core client for 30 sec - exiting 12:19:57 (26861): No heartbeat from core client for 30 sec - exiting 12:19:58 (26861): No heartbeat from core client for 30 sec - exiting 12:19:59 (26861): No heartbeat from core client for 30 sec - exiting 12:20:00 (26861): No heartbeat from core client for 30 sec - exiting 12:20:01 (26861): No heartbeat from core client for 30 sec - exiting 12:20:02 (26861): No heartbeat from core client for 30 sec - exiting 12:20:03 (26861): No heartbeat from core client for 30 sec - exiting 12:20:04 (26861): No heartbeat from core client for 30 sec - exiting 12:20:05 (26861): No heartbeat from core client for 30 sec - exiting 12:20:06 (26861): No heartbeat from core client for 30 sec - exiting 12:20:07 (26861): No heartbeat from core client for 30 sec - exiting 12:20:08 (26861): No heartbeat from core client for 30 sec - exiting 12:20:09 (26861): No heartbeat from core client for 30 sec - exiting 12:20:10 (26861): No heartbeat from core client for 30 sec - exiting 12:20:11 (26861): No heartbeat from core client for 30 sec - exiting 12:20:12 (26861): No heartbeat from core client for 30 sec - exiting 12:20:13 (26861): No heartbeat from core client for 30 sec - exiting 12:20:14 (26861): No heartbeat from core client for 30 sec - exiting 12:20:15 (26861): No heartbeat from core client for 30 sec - exiting 12:20:16 (26861): No heartbeat from core client for 30 sec - exiting 12:20:17 (26861): No heartbeat from core client for 30 sec - exiting 12:20:18 (26861): No heartbeat from core client for 30 sec - exiting 12:20:19 (26861): No heartbeat from core client for 30 sec - exiting 12:20:20 (26861): No heartbeat from core client for 30 sec - exiting 12:20:21 (26861): No heartbeat from core client for 30 sec - exiting 12:20:22 (26861): No heartbeat from core client for 30 sec - exiting 12:20:23 (26861): No heartbeat from core client for 30 sec - exiting 12:20:24 (26861): No heartbeat from core client for 30 sec - exiting 12:20:25 (26861): No heartbeat from core client for 30 sec - exiting 12:20:26 (26861): No heartbeat from core client for 30 sec - exiting 12:20:27 (26861): No heartbeat from core client for 30 sec - exiting 12:20:29 (26861): No heartbeat from core client for 30 sec - exiting 12:20:30 (26861): No heartbeat from core client for 30 sec - exiting 12:20:31 (26861): No heartbeat from core client for 30 sec - exiting 12:20:32 (26861): No heartbeat from core client for 30 sec - exiting 12:20:33 (26861): No heartbeat from core client for 30 sec - exiting 12:20:34 (26861): No heartbeat from core client for 30 sec - exiting 12:20:35 (26861): No heartbeat from core client for 30 sec - exiting 12:20:36 (26861): No heartbeat from core client for 30 sec - exiting 12:20:37 (26861): No heartbeat from core client for 30 sec - exiting 12:20:38 (26861): No heartbeat from core client for 30 sec - exiting 12:20:39 (26861): No heartbeat from core client for 30 sec - exiting 12:20:40 (26861): No heartbeat from core client for 30 sec - exiting 12:20:41 (26861): No heartbeat from core client for 30 sec - exiting 12:20:42 (26861): No heartbeat from core client for 30 sec - exiting 12:20:43 (26861): No heartbeat from core client for 30 sec - exiting 12:20:44 (26861): No heartbeat from core client for 30 sec - exiting 12:20:45 (26861): No heartbeat from core client for 30 sec - exiting 12:20:46 (26861): No heartbeat from core client for 30 sec - exiting 12:20:47 (26861): No heartbeat from core client for 30 sec - exiting 12:20:48 (26861): No heartbeat from core client for 30 sec - exiting 12:20:49 (26861): No heartbeat from core client for 30 sec - exiting 12:20:50 (26861): No heartbeat from core client for 30 sec - exiting 12:20:51 (26861): No heartbeat from core client for 30 sec - exiting 12:20:52 (26861): No heartbeat from core client for 30 sec - exiting 12:20:53 (26861): No heartbeat from core client for 30 sec - exiting 12:20:54 (26861): No heartbeat from core client for 30 sec - exiting 12:20:55 (26861): No heartbeat from core client for 30 sec - exiting 12:20:56 (26861): No heartbeat from core client for 30 sec - exiting 12:20:57 (26861): No heartbeat from core client for 30 sec - exiting 12:20:58 (26861): No heartbeat from core client for 30 sec - exiting 12:20:59 (26861): No heartbeat from core client for 30 sec - exiting 12:21:00 (26861): No heartbeat from core client for 30 sec - exiting 12:21:01 (26861): No heartbeat from core client for 30 sec - exiting 12:21:02 (26861): No heartbeat from core client for 30 sec - exiting 12:21:03 (26861): No heartbeat from core client for 30 sec - exiting 12:21:04 (26861): No heartbeat from core client for 30 sec - exiting 12:21:05 (26861): No heartbeat from core client for 30 sec - exiting 12:21:06 (26861): No heartbeat from core client for 30 sec - exiting 12:21:07 (26861): No heartbeat from core client for 30 sec - exiting 12:21:08 (26861): No heartbeat from core client for 30 sec - exiting 12:21:09 (26861): No heartbeat from core client for 30 sec - exiting 12:21:10 (26861): No heartbeat from core client for 30 sec - exiting 12:21:11 (26861): No heartbeat from core client for 30 sec - exiting 12:21:12 (26861): No heartbeat from core client for 30 sec - exiting 12:21:13 (26861): No heartbeat from core client for 30 sec - exiting 12:21:14 (26861): No heartbeat from core client for 30 sec - exiting 12:21:15 (26861): No heartbeat from core client for 30 sec - exiting 12:21:16 (26861): No heartbeat from core client for 30 sec - exiting 12:21:17 (26861): No heartbeat from core client for 30 sec - exiting 12:21:18 (26861): No heartbeat from core client for 30 sec - exiting 12:21:19 (26861): No heartbeat from core client for 30 sec - exiting 12:21:20 (26861): No heartbeat from core client for 30 sec - exiting 12:21:21 (26861): No heartbeat from core client for 30 sec - exiting 12:21:22 (26861): No heartbeat from core client for 30 sec - exiting 12:21:23 (26861): No heartbeat from core client for 30 sec - exiting 12:21:24 (26861): No heartbeat from core client for 30 sec - exiting 12:21:25 (26861): No heartbeat from core client for 30 sec - exiting 12:21:26 (26861): No heartbeat from core client for 30 sec - exiting 12:21:27 (26861): No heartbeat from core client for 30 sec - exiting 12:21:28 (26861): No heartbeat from core client for 30 sec - exiting 12:21:29 (26861): No heartbeat from core client for 30 sec - exiting 12:21:30 (26861): No heartbeat from core client for 30 sec - exiting 12:21:31 (26861): No heartbeat from core client for 30 sec - exiting 12:21:32 (26861): No heartbeat from core client for 30 sec - exiting 12:21:33 (26861): No heartbeat from core client for 30 sec - exiting 12:21:34 (26861): No heartbeat from core client for 30 sec - exiting 12:21:35 (26861): No heartbeat from core client for 30 sec - exiting 12:21:36 (26861): No heartbeat from core client for 30 sec - exiting 12:21:37 (26861): No heartbeat from core client for 30 sec - exiting 12:21:38 (26861): No heartbeat from core client for 30 sec - exiting 12:21:39 (26861): No heartbeat from core client for 30 sec - exiting 12:21:40 (26861): No heartbeat from core client for 30 sec - exiting 12:21:41 (26861): No heartbeat from core client for 30 sec - exiting 12:21:42 (26861): No heartbeat from core client for 30 sec - exiting 12:21:43 (26861): No heartbeat from core client for 30 sec - exiting 12:21:44 (26861): No heartbeat from core client for 30 sec - exiting 12:21:45 (26861): No heartbeat from core client for 30 sec - exiting 12:21:46 (26861): No heartbeat from core client for 30 sec - exiting 12:21:47 (26861): No heartbeat from core client for 30 sec - exiting 12:21:48 (26861): No heartbeat from core client for 30 sec - exiting 12:21:49 (26861): No heartbeat from core client for 30 sec - exiting 12:21:50 (26861): No heartbeat from core client for 30 sec - exiting 12:21:51 (26861): No heartbeat from core client for 30 sec - exiting 12:21:52 (26861): No heartbeat from core client for 30 sec - exiting 12:21:53 (26861): No heartbeat from core client for 30 sec - exiting 12:21:54 (26861): No heartbeat from core client for 30 sec - exiting 12:21:55 (26861): No heartbeat from core client for 30 sec - exiting 12:21:56 (26861): No heartbeat from core client for 30 sec - exiting 12:21:57 (26861): No heartbeat from core client for 30 sec - exiting 12:21:58 (26861): No heartbeat from core client for 30 sec - exiting 12:21:59 (26861): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:25:24 (45632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:55:36 (48996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... RCM: BUFFIN : Read Failed: Inappropriate ioctl for device RCM : BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 RCM : BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_bzr0_1972_1_008027967_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bzr0_1972_1_008027967_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bzr0_1972_1_008027967_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bzr0_1972_1_008027967_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Jul 2012 05:20:35	1181982	14862804	hadam3p_pnw_bzr0_1972_1_008027967_1	92,256	160,868	1.7437
18 Jul 2012 15:10:28	1181982	14862804	hadam3p_pnw_bzr0_1972_1_008027967_1	80,736	140,593	1.7414
18 Jul 2012 04:23:16	1181982	14862804	hadam3p_pnw_bzr0_1972_1_008027967_1	69,216	120,273	1.7376
17 Jul 2012 11:45:56	1181982	14862804	hadam3p_pnw_bzr0_1972_1_008027967_1	57,696	99,679	1.7277
16 Jul 2012 21:37:40	1181982	14862804	hadam3p_pnw_bzr0_1972_1_008027967_1	46,176	79,169	1.7145
13 Jul 2012 07:39:17	1181982	14862804	hadam3p_pnw_bzr0_1972_1_008027967_1	34,656	58,756	1.6954
12 Jul 2012 13:57:49	1181982	14862804	hadam3p_pnw_bzr0_1972_1_008027967_1	23,136	38,528	1.6653
11 Jul 2012 09:48:52	1181982	14862804	hadam3p_pnw_bzr0_1972_1_008027967_1	11,616	18,971	1.6332