Task 13167499

Name	hadam3p_eu_2q4b_1970_1_007372768_1
Workunit	7570198
Created	30 Jul 2011, 0:47:55 UTC
Sent	30 Jul 2011, 0:48:31 UTC
Report deadline	11 Jul 2012, 6:08:31 UTC
Received	13 Sep 2011, 20:12:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1098106
Run time	3 days 10 hours 33 min 49 sec
CPU time	3 days 8 hours 0 min 47 sec
Validate state	Invalid
Credit	1,591.48
Device peak FLOPS	3.27 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:50:36 (3486): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:47:58 (625): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:13:19 (666): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:13:24 (281): No heartbeat from core client for 30 sec - exiting 11:13:25 (281): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:46 (251): No heartbeat from core client for 30 sec - exiting 11:26:48 (251): No heartbeat from core client for 30 sec - exiting 11:26:49 (251): No heartbeat from core client for 30 sec - exiting 11:26:50 (251): No heartbeat from core client for 30 sec - exiting 11:26:51 (251): No heartbeat from core client for 30 sec - exiting 11:26:52 (251): No heartbeat from core client for 30 sec - exiting 11:26:53 (251): No heartbeat from core client for 30 sec - exiting 11:26:54 (251): No heartbeat from core client for 30 sec - exiting 11:26:55 (251): No heartbeat from core client for 30 sec - exiting 11:26:56 (251): No heartbeat from core client for 30 sec - exiting 11:26:57 (251): No heartbeat from core client for 30 sec - exiting 11:26:58 (251): No heartbeat from core client for 30 sec - exiting 11:26:59 (251): No heartbeat from core client for 30 sec - exiting 11:27:00 (251): No heartbeat from core client for 30 sec - exiting 11:27:01 (251): No heartbeat from core client for 30 sec - exiting 11:27:02 (251): No heartbeat from core client for 30 sec - exiting 11:27:03 (251): No heartbeat from core client for 30 sec - exiting 11:27:04 (251): No heartbeat from core client for 30 sec - exiting 11:27:05 (251): No heartbeat from core client for 30 sec - exiting 11:27:06 (251): No heartbeat from core client for 30 sec - exiting 11:27:07 (251): No heartbeat from core client for 30 sec - exiting 11:27:09 (251): No heartbeat from core client for 30 sec - exiting 11:44:36 (257): No heartbeat from core client for 30 sec - exiting 11:44:37 (257): No heartbeat from core client for 30 sec - exiting 11:44:38 (257): No heartbeat from core client for 30 sec - exiting 11:44:39 (257): No heartbeat from core client for 30 sec - exiting 11:44:40 (257): No heartbeat from core client for 30 sec - exiting 11:44:41 (257): No heartbeat from core client for 30 sec - exiting 11:44:42 (257): No heartbeat from core client for 30 sec - exiting 11:44:43 (257): No heartbeat from core client for 30 sec - exiting 11:44:44 (257): No heartbeat from core client for 30 sec - exiting 11:44:45 (257): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:16 (243): No heartbeat from core client for 30 sec - exiting 12:53:17 (243): No heartbeat from core client for 30 sec - exiting 12:53:18 (243): No heartbeat from core client for 30 sec - exiting 12:53:19 (243): No heartbeat from core client for 30 sec - exiting 12:53:20 (243): No heartbeat from core client for 30 sec - exiting 12:53:21 (243): No heartbeat from core client for 30 sec - exiting 12:53:22 (243): No heartbeat from core client for 30 sec - exiting 12:53:23 (243): No heartbeat from core client for 30 sec - exiting 12:53:24 (243): No heartbeat from core client for 30 sec - exiting 12:53:25 (243): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:09:37 (242): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:24 (1128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:16:16 (248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:43:18 (247): No heartbeat from core client for 30 sec - exiting 21:43:19 (247): No heartbeat from core client for 30 sec - exiting 21:43:20 (247): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadam3p_eu_um_6.09_i686-apple-darwin, 161365) failed! execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadrm3p_eu_um_6.09_i686-apple-darwin, 161365) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3754, selfPID=3741, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_2q4b_1970_1_007372768_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2q4b_1970_1_007372768_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2q4b_1970_1_007372768_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2q4b_1970_1_007372768_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Sep 2011 02:03:16	1098106	13167499	hadam3p_eu_2q4b_1970_1_007372768_1	92,256	270,124	2.9280
04 Sep 2011 00:47:39	1098106	13167499	hadam3p_eu_2q4b_1970_1_007372768_1	80,736	240,335	2.9768
02 Sep 2011 00:00:33	1098106	13167499	hadam3p_eu_2q4b_1970_1_007372768_1	69,216	208,276	3.0091
31 Aug 2011 00:44:56	1098106	13167499	hadam3p_eu_2q4b_1970_1_007372768_1	57,696	174,432	3.0233
28 Aug 2011 19:13:33	1098106	13167499	hadam3p_eu_2q4b_1970_1_007372768_1	46,176	140,029	3.0325
24 Aug 2011 00:41:03	1098106	13167499	hadam3p_eu_2q4b_1970_1_007372768_1	34,656	105,858	3.0545
17 Aug 2011 21:04:49	1098106	13167499	hadam3p_eu_2q4b_1970_1_007372768_1	23,136	71,778	3.1024
01 Aug 2011 16:15:57	1098106	13167499	hadam3p_eu_2q4b_1970_1_007372768_1	11,616	36,408	3.1343