Task 14676694

Name	hadam3p_eu_cxfj_2004_1_007962881_0
Workunit	8117995
Created	16 May 2012, 14:46:08 UTC
Sent	5 Jun 2012, 9:48:49 UTC
Report deadline	18 May 2013, 15:08:49 UTC
Received	29 Aug 2012, 21:06:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1216754
Run time	3 days 11 hours 46 min 41 sec
CPU time	2 days 20 hours 52 min 31 sec
Validate state	Invalid
Credit	995.30
Device peak FLOPS	1.94 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5924, selfPID=5924, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4192, selfPID=4192, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4936, selfPID=4936, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5052, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 15:04:48 (4492): No heartbeat from core client for 30 sec - exiting 15:04:49 (4492): No heartbeat from core client for 30 sec - exiting 15:04:50 (4492): No heartbeat from core client for 30 sec - exiting 15:04:52 (4492): No heartbeat from core client for 30 sec - exiting 15:04:53 (4492): No heartbeat from core client for 30 sec - exiting 15:04:54 (4492): No heartbeat from core client for 30 sec - exiting 15:04:55 (4492): No heartbeat from core client for 30 sec - exiting 15:04:56 (4492): No heartbeat from core client for 30 sec - exiting 15:04:57 (4492): No heartbeat from core client for 30 sec - exiting 15:04:58 (4492): No heartbeat from core client for 30 sec - exiting 15:04:59 (4492): No heartbeat from core client for 30 sec - exiting 15:05:00 (4492): No heartbeat from core client for 30 sec - exiting 15:05:01 (4492): No heartbeat from core client for 30 sec - exiting 15:05:03 (4492): No heartbeat from core client for 30 sec - exiting 15:05:04 (4492): No heartbeat from core client for 30 sec - exiting 15:05:05 (4492): No heartbeat from core client for 30 sec - exiting 15:05:06 (4492): No heartbeat from core client for 30 sec - exiting 15:05:07 (4492): No heartbeat from core client for 30 sec - exiting 15:05:08 (4492): No heartbeat from core client for 30 sec - exiting 15:05:09 (4492): No heartbeat from core client for 30 sec - exiting 15:05:10 (4492): No heartbeat from core client for 30 sec - exiting 15:05:11 (4492): No heartbeat from core client for 30 sec - exiting 15:05:12 (4492): No heartbeat from core client for 30 sec - exiting 15:05:13 (4492): No heartbeat from core client for 30 sec - exiting 15:05:15 (4492): No heartbeat from core client for 30 sec - exiting 15:05:16 (4492): No heartbeat from core client for 30 sec - exiting 15:05:17 (4492): No heartbeat from core client for 30 sec - exiting 15:05:18 (4492): No heartbeat from core client for 30 sec - exiting 15:05:19 (4492): No heartbeat from core client for 30 sec - exiting 15:05:20 (4492): No heartbeat from core client for 30 sec - exiting 15:05:21 (4492): No heartbeat from core client for 30 sec - exiting 15:05:22 (4492): No heartbeat from core client for 30 sec - exiting 15:05:23 (4492): No heartbeat from core client for 30 sec - exiting 15:05:24 (4492): No heartbeat from core client for 30 sec - exiting 15:05:26 (4492): No heartbeat from core client for 30 sec - exiting 15:05:27 (4492): No heartbeat from core client for 30 sec - exiting 15:05:28 (4492): No heartbeat from core client for 30 sec - exiting 15:05:29 (4492): No heartbeat from core client for 30 sec - exiting 15:05:30 (4492): No heartbeat from core client for 30 sec - exiting 15:05:31 (4492): No heartbeat from core client for 30 sec - exiting 15:05:32 (4492): No heartbeat from core client for 30 sec - exiting 15:05:33 (4492): No heartbeat from core client for 30 sec - exiting 15:05:34 (4492): No heartbeat from core client for 30 sec - exiting 15:05:35 (4492): No heartbeat from core client for 30 sec - exiting 15:05:36 (4492): No heartbeat from core client for 30 sec - exiting 15:05:38 (4492): No heartbeat from core client for 30 sec - exiting 15:05:39 (4492): No heartbeat from core client for 30 sec - exiting 15:05:40 (4492): No heartbeat from core client for 30 sec - exiting 15:05:41 (4492): No heartbeat from core client for 30 sec - exiting 15:05:42 (4492): No heartbeat from core client for 30 sec - exiting 15:05:43 (4492): No heartbeat from core client for 30 sec - exiting 15:05:44 (4492): No heartbeat from core client for 30 sec - exiting 15:05:45 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1732, iMonCtr=2 Model crash detected, will try to restart... 21:06:43 (3768): No heartbeat from core client for 30 sec - exiting 21:06:44 (3768): No heartbeat from core client for 30 sec - exiting 21:06:45 (3768): No heartbeat from core client for 30 sec - exiting 21:06:46 (3768): No heartbeat from core client for 30 sec - exiting 21:06:47 (3768): No heartbeat from core client for 30 sec - exiting 21:06:48 (3768): No heartbeat from core client for 30 sec - exiting 21:06:50 (3768): No heartbeat from core client for 30 sec - exiting 21:06:51 (3768): No heartbeat from core client for 30 sec - exiting 21:06:52 (3768): No heartbeat from core client for 30 sec - exiting 21:06:53 (3768): No heartbeat from core client for 30 sec - exiting 21:06:54 (3768): No heartbeat from core client for 30 sec - exiting 21:06:55 (3768): No heartbeat from core client for 30 sec - exiting 21:06:56 (3768): No heartbeat from core client for 30 sec - exiting 21:06:57 (3768): No heartbeat from core client for 30 sec - exiting 21:06:58 (3768): No heartbeat from core client for 30 sec - exiting 21:06:59 (3768): No heartbeat from core client for 30 sec - exiting 21:07:01 (3768): No heartbeat from core client for 30 sec - exiting 21:07:02 (3768): No heartbeat from core client for 30 sec - exiting 21:07:03 (3768): No heartbeat from core client for 30 sec - exiting 21:07:04 (3768): No heartbeat from core client for 30 sec - exiting 21:07:05 (3768): No heartbeat from core client for 30 sec - exiting 21:07:06 (3768): No heartbeat from core client for 30 sec - exiting 21:07:07 (3768): No heartbeat from core client for 30 sec - exiting 21:07:08 (3768): No heartbeat from core client for 30 sec - exiting 21:07:09 (3768): No heartbeat from core client for 30 sec - exiting 21:07:10 (3768): No heartbeat from core client for 30 sec - exiting 21:07:11 (3768): No heartbeat from core client for 30 sec - exiting 21:07:13 (3768): No heartbeat from core client for 30 sec - exiting 21:07:14 (3768): No heartbeat from core client for 30 sec - exiting 21:07:15 (3768): No heartbeat from core client for 30 sec - exiting 21:07:16 (3768): No heartbeat from core client for 30 sec - exiting 21:07:17 (3768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5000, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5644, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4716, selfPID=4716, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:37:01 (4764): No heartbeat from core client for 30 sec - exiting 15:37:02 (4764): No heartbeat from core client for 30 sec - exiting 15:37:03 (4764): No heartbeat from core client for 30 sec - exiting 15:37:04 (4764): No heartbeat from core client for 30 sec - exiting 15:37:05 (4764): No heartbeat from core client for 30 sec - exiting 15:37:06 (4764): No heartbeat from core client for 30 sec - exiting 15:37:07 (4764): No heartbeat from core client for 30 sec - exiting 15:37:08 (4764): No heartbeat from core client for 30 sec - exiting 15:37:10 (4764): No heartbeat from core client for 30 sec - exiting 15:37:11 (4764): No heartbeat from core client for 30 sec - exiting 15:37:12 (4764): No heartbeat from core client for 30 sec - exiting 15:37:13 (4764): No heartbeat from core client for 30 sec - exiting 15:37:14 (4764): No heartbeat from core client for 30 sec - exiting 15:37:15 (4764): No heartbeat from core client for 30 sec - exiting 15:37:16 (4764): No heartbeat from core client for 30 sec - exiting 15:37:18 (4764): No heartbeat from core client for 30 sec - exiting 15:37:19 (4764): No heartbeat from core client for 30 sec - exiting 15:37:20 (4764): No heartbeat from core client for 30 sec - exiting 15:37:21 (4764): No heartbeat from core client for 30 sec - exiting 15:37:22 (4764): No heartbeat from core client for 30 sec - exiting 15:37:23 (4764): No heartbeat from core client for 30 sec - exiting 15:37:24 (4764): No heartbeat from core client for 30 sec - exiting 15:37:26 (4764): No heartbeat from core client for 30 sec - exiting 15:37:27 (4764): No heartbeat from core client for 30 sec - exiting 15:37:28 (4764): No heartbeat from core client for 30 sec - exiting 15:37:29 (4764): No heartbeat from core client for 30 sec - exiting 15:37:30 (4764): No heartbeat from core client for 30 sec - exiting 15:37:31 (4764): No heartbeat from core client for 30 sec - exiting 15:37:32 (4764): No heartbeat from core client for 30 sec - exiting 15:37:33 (4764): No heartbeat from core client for 30 sec - exiting 15:37:34 (4764): No heartbeat from core client for 30 sec - exiting 15:37:35 (4764): No heartbeat from core client for 30 sec - exiting 15:37:37 (4764): No heartbeat from core client for 30 sec - exiting 15:37:38 (4764): No heartbeat from core client for 30 sec - exiting 15:37:39 (4764): No heartbeat from core client for 30 sec - exiting 15:37:40 (4764): No heartbeat from core client for 30 sec - exiting 15:37:41 (4764): No heartbeat from core client for 30 sec - exiting 15:37:42 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:32:33 (1264): No heartbeat from core client for 30 sec - exiting 16:32:35 (1264): No heartbeat from core client for 30 sec - exiting 16:32:36 (1264): No heartbeat from core client for 30 sec - exiting 16:32:37 (1264): No heartbeat from core client for 30 sec - exiting 16:32:38 (1264): No heartbeat from core client for 30 sec - exiting 16:32:39 (1264): No heartbeat from core client for 30 sec - exiting 16:32:40 (1264): No heartbeat from core client for 30 sec - exiting 16:32:41 (1264): No heartbeat from core client for 30 sec - exiting 16:32:42 (1264): No heartbeat from core client for 30 sec - exiting 16:32:43 (1264): No heartbeat from core client for 30 sec - exiting 16:32:44 (1264): No heartbeat from core client for 30 sec - exiting 16:32:46 (1264): No heartbeat from core client for 30 sec - exiting 16:32:47 (1264): No heartbeat from core client for 30 sec - exiting 16:32:48 (1264): No heartbeat from core client for 30 sec - exiting 16:32:49 (1264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:26 (4600): No heartbeat from core client for 30 sec - exiting 18:09:27 (4600): No heartbeat from core client for 30 sec - exiting 18:09:28 (4600): No heartbeat from core client for 30 sec - exiting 18:09:29 (4600): No heartbeat from core client for 30 sec - exiting 18:09:30 (4600): No heartbeat from core client for 30 sec - exiting 18:09:31 (4600): No heartbeat from core client for 30 sec - exiting 18:09:32 (4600): No heartbeat from core client for 30 sec - exiting 18:09:33 (4600): No heartbeat from core client for 30 sec - exiting 18:09:34 (4600): No heartbeat from core client for 30 sec - exiting 18:09:35 (4600): No heartbeat from core client for 30 sec - exiting 18:09:37 (4600): No heartbeat from core client for 30 sec - exiting 18:09:38 (4600): No heartbeat from core client for 30 sec - exiting 18:09:39 (4600): No heartbeat from core client for 30 sec - exiting 18:09:40 (4600): No heartbeat from core client for 30 sec - exiting 18:09:41 (4600): No heartbeat from core client for 30 sec - exiting 18:09:42 (4600): No heartbeat from core client for 30 sec - exiting 18:09:43 (4600): No heartbeat from core client for 30 sec - exiting 18:09:44 (4600): No heartbeat from core client for 30 sec - exiting 18:09:45 (4600): No heartbeat from core client for 30 sec - exiting 18:09:46 (4600): No heartbeat from core client for 30 sec - exiting 18:09:48 (4600): No heartbeat from core client for 30 sec - exiting 18:09:49 (4600): No heartbeat from core client for 30 sec - exiting 18:09:50 (4600): No heartbeat from core client for 30 sec - exiting 18:09:51 (4600): No heartbeat from core client for 30 sec - exiting 18:09:52 (4600): No heartbeat from core client for 30 sec - exiting 18:09:53 (4600): No heartbeat from core client for 30 sec - exiting 18:09:54 (4600): No heartbeat from core client for 30 sec - exiting 18:09:55 (4600): No heartbeat from core client for 30 sec - exiting 18:09:56 (4600): No heartbeat from core client for 30 sec - exiting 18:09:57 (4600): No heartbeat from core client for 30 sec - exiting 18:09:58 (4600): No heartbeat from core client for 30 sec - exiting 18:10:00 (4600): No heartbeat from core client for 30 sec - exiting 18:10:01 (4600): No heartbeat from core client for 30 sec - exiting 18:10:02 (4600): No heartbeat from core client for 30 sec - exiting 18:10:03 (4600): No heartbeat from core client for 30 sec - exiting 18:10:04 (4600): No heartbeat from core client for 30 sec - exiting 18:10:05 (4600): No heartbeat from core client for 30 sec - exiting 18:10:06 (4600): No heartbeat from core client for 30 sec - exiting 18:10:07 (4600): No heartbeat from core client for 30 sec - exiting 18:10:08 (4600): No heartbeat from core client for 30 sec - exiting 18:10:09 (4600): No heartbeat from core client for 30 sec - exiting 18:10:11 (4600): No heartbeat from core client for 30 sec - exiting 18:10:12 (4600): No heartbeat from core client for 30 sec - exiting 18:10:13 (4600): No heartbeat from core client for 30 sec - exiting 18:10:14 (4600): No heartbeat from core client for 30 sec - exiting 18:10:15 (4600): No heartbeat from core client for 30 sec - exiting 18:10:16 (4600): No heartbeat from core client for 30 sec - exiting 18:10:17 (4600): No heartbeat from core client for 30 sec - exiting 18:10:18 (4600): No heartbeat from core client for 30 sec - exiting 18:10:19 (4600): No heartbeat from core client for 30 sec - exiting 18:10:20 (4600): No heartbeat from core client for 30 sec - exiting 18:10:22 (4600): No heartbeat from core client for 30 sec - exiting 18:10:23 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_cxfj_2004_1_007962881_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cxfj_2004_1_007962881_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cxfj_2004_1_007962881_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cxfj_2004_1_007962881_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cxfj_2004_1_007962881_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cxfj_2004_1_007962881_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cxfj_2004_1_007962881_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Aug 2012 19:00:39	1216754	14676694	hadam3p_eu_cxfj_2004_1_007962881_0	57,696	233,500	4.0471
02 Aug 2012 20:38:50	1216754	14676694	hadam3p_eu_cxfj_2004_1_007962881_0	46,180	188,845	4.0893
02 Aug 2012 00:45:36	1216754	14676694	hadam3p_eu_cxfj_2004_1_007962881_0	46,176	188,241	4.0766
29 Jul 2012 21:24:26	1216754	14676694	hadam3p_eu_cxfj_2004_1_007962881_0	34,656	143,616	4.1440
27 Jul 2012 19:45:25	1216754	14676694	hadam3p_eu_cxfj_2004_1_007962881_0	23,136	99,481	4.2998
25 Jun 2012 18:50:53	1216754	14676694	hadam3p_eu_cxfj_2004_1_007962881_0	11,616	48,609	4.1847