Task 16105639

Name	hadam3p_eu_ipu3_1996_1_008478672_0
Workunit	8629485
Created	3 Dec 2013, 19:22:45 UTC
Sent	7 Dec 2013, 11:41:47 UTC
Report deadline	19 Nov 2014, 17:01:47 UTC
Received	14 Dec 2013, 13:58:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1300539
Run time	3 days 18 hours 28 min 11 sec
CPU time	2 days 22 hours 38 min 4 sec
Validate state	Invalid
Credit	1,989.02
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.31</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3164, selfPID=3164, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7824, selfPID=7824, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10540, selfPID=10540, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11664, selfPID=11664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12232, selfPID=12232, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10216, selfPID=10216, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:51:44 (12948): No heartbeat from core client for 30 sec - exiting 19:51:45 (12948): No heartbeat from core client for 30 sec - exiting 19:51:46 (12948): No heartbeat from core client for 30 sec - exiting 19:51:47 (12948): No heartbeat from core client for 30 sec - exiting 19:51:48 (12948): No heartbeat from core client for 30 sec - exiting 19:51:49 (12948): No heartbeat from core client for 30 sec - exiting 19:51:50 (12948): No heartbeat from core client for 30 sec - exiting 19:51:51 (12948): No heartbeat from core client for 30 sec - exiting 19:51:52 (12948): No heartbeat from core client for 30 sec - exiting 19:51:53 (12948): No heartbeat from core client for 30 sec - exiting 19:51:54 (12948): No heartbeat from core client for 30 sec - exiting 19:51:55 (12948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:14:28 (9200): No heartbeat from core client for 30 sec - exiting 21:14:29 (9200): No heartbeat from core client for 30 sec - exiting 21:14:30 (9200): No heartbeat from core client for 30 sec - exiting 21:14:31 (9200): No heartbeat from core client for 30 sec - exiting 21:14:32 (9200): No heartbeat from core client for 30 sec - exiting 21:14:33 (9200): No heartbeat from core client for 30 sec - exiting 21:14:34 (9200): No heartbeat from core client for 30 sec - exiting 21:14:35 (9200): No heartbeat from core client for 30 sec - exiting 21:14:36 (9200): No heartbeat from core client for 30 sec - exiting 21:14:37 (9200): No heartbeat from core client for 30 sec - exiting 21:14:38 (9200): No heartbeat from core client for 30 sec - exiting 21:14:39 (9200): No heartbeat from core client for 30 sec - exiting 21:14:40 (9200): No heartbeat from core client for 30 sec - exiting 21:14:41 (9200): No heartbeat from core client for 30 sec - exiting 21:14:42 (9200): No heartbeat from core client for 30 sec - exiting 21:14:43 (9200): No heartbeat from core client for 30 sec - exiting 21:14:44 (9200): No heartbeat from core client for 30 sec - exiting 21:14:45 (9200): No heartbeat from core client for 30 sec - exiting 21:14:46 (9200): No heartbeat from core client for 30 sec - exiting 21:14:47 (9200): No heartbeat from core client for 30 sec - exiting 21:14:48 (9200): No heartbeat from core client for 30 sec - exiting 21:14:49 (9200): No heartbeat from core client for 30 sec - exiting 21:14:50 (9200): No heartbeat from core client for 30 sec - exiting 21:14:51 (9200): No heartbeat from core client for 30 sec - exiting 21:14:52 (9200): No heartbeat from core client for 30 sec - exiting 21:14:53 (9200): No heartbeat from core client for 30 sec - exiting 21:14:54 (9200): No heartbeat from core client for 30 sec - exiting 21:14:55 (9200): No heartbeat from core client for 30 sec - exiting 21:14:56 (9200): No heartbeat from core client for 30 sec - exiting 21:14:57 (9200): No heartbeat from core client for 30 sec - exiting 21:14:58 (9200): No heartbeat from core client for 30 sec - exiting 21:14:59 (9200): No heartbeat from core client for 30 sec - exiting 21:15:00 (9200): No heartbeat from core client for 30 sec - exiting 21:15:01 (9200): No heartbeat from core client for 30 sec - exiting 21:15:02 (9200): No heartbeat from core client for 30 sec - exiting 21:15:03 (9200): No heartbeat from core client for 30 sec - exiting 21:15:04 (9200): No heartbeat from core client for 30 sec - exiting 21:15:05 (9200): No heartbeat from core client for 30 sec - exiting 21:15:06 (9200): No heartbeat from core client for 30 sec - exiting 21:15:07 (9200): No heartbeat from core client for 30 sec - exiting 21:15:08 (9200): No heartbeat from core client for 30 sec - exiting 21:15:09 (9200): No heartbeat from core client for 30 sec - exiting 21:15:10 (9200): No heartbeat from core client for 30 sec - exiting 21:15:11 (9200): No heartbeat from core client for 30 sec - exiting 21:15:12 (9200): No heartbeat from core client for 30 sec - exiting 21:15:13 (9200): No heartbeat from core client for 30 sec - exiting 21:15:14 (9200): No heartbeat from core client for 30 sec - exiting 21:15:15 (9200): No heartbeat from core client for 30 sec - exiting 21:15:16 (9200): No heartbeat from core client for 30 sec - exiting 21:15:17 (9200): No heartbeat from core client for 30 sec - exiting 21:15:18 (9200): No heartbeat from core client for 30 sec - exiting 21:15:19 (9200): No heartbeat from core client for 30 sec - exiting 21:15:20 (9200): No heartbeat from core client for 30 sec - exiting 21:15:21 (9200): No heartbeat from core client for 30 sec - exiting 21:15:22 (9200): No heartbeat from core client for 30 sec - exiting 21:15:23 (9200): No heartbeat from core client for 30 sec - exiting 21:15:24 (9200): No heartbeat from core client for 30 sec - exiting 21:15:25 (9200): No heartbeat from core client for 30 sec - exiting 21:15:26 (9200): No heartbeat from core client for 30 sec - exiting 21:15:27 (9200): No heartbeat from core client for 30 sec - exiting 21:15:28 (9200): No heartbeat from core client for 30 sec - exiting 21:15:29 (9200): No heartbeat from core client for 30 sec - exiting 21:15:30 (9200): No heartbeat from core client for 30 sec - exiting 21:15:31 (9200): No heartbeat from core client for 30 sec - exiting 21:15:32 (9200): No heartbeat from core client for 30 sec - exiting 21:15:33 (9200): No heartbeat from core client for 30 sec - exiting 21:15:34 (9200): No heartbeat from core client for 30 sec - exiting 21:15:35 (9200): No heartbeat from core client for 30 sec - exiting 21:15:36 (9200): No heartbeat from core client for 30 sec - exiting 21:15:37 (9200): No heartbeat from core client for 30 sec - exiting 21:15:38 (9200): No heartbeat from core client for 30 sec - exiting 21:15:39 (9200): No heartbeat from core client for 30 sec - exiting 21:15:40 (9200): No heartbeat from core client for 30 sec - exiting 21:15:41 (9200): No heartbeat from core client for 30 sec - exiting 21:15:42 (9200): No heartbeat from core client for 30 sec - exiting 21:15:43 (9200): No heartbeat from core client for 30 sec - exiting 21:15:45 (9200): No heartbeat from core client for 30 sec - exiting 21:15:46 (9200): No heartbeat from core client for 30 sec - exiting 21:15:47 (9200): No heartbeat from core client for 30 sec - exiting 21:15:48 (9200): No heartbeat from core client for 30 sec - exiting 21:15:49 (9200): No heartbeat from core client for 30 sec - exiting 21:15:50 (9200): No heartbeat from core client for 30 sec - exiting 21:15:51 (9200): No heartbeat from core client for 30 sec - exiting 21:15:52 (9200): No heartbeat from core client for 30 sec - exiting 21:15:53 (9200): No heartbeat from core client for 30 sec - exiting 21:15:54 (9200): No heartbeat from core client for 30 sec - exiting 21:15:55 (9200): No heartbeat from core client for 30 sec - exiting 21:15:56 (9200): No heartbeat from core client for 30 sec - exiting 21:15:57 (9200): No heartbeat from core client for 30 sec - exiting 21:15:58 (9200): No heartbeat from core client for 30 sec - exiting 21:15:59 (9200): No heartbeat from core client for 30 sec - exiting 21:16:00 (9200): No heartbeat from core client for 30 sec - exiting 21:16:01 (9200): No heartbeat from core client for 30 sec - exiting 21:16:02 (9200): No heartbeat from core client for 30 sec - exiting 21:16:03 (9200): No heartbeat from core client for 30 sec - exiting 21:16:04 (9200): No heartbeat from core client for 30 sec - exiting 21:16:06 (9200): No heartbeat from core client for 30 sec - exiting 21:16:07 (9200): No heartbeat from core client for 30 sec - exiting 21:16:08 (9200): No heartbeat from core client for 30 sec - exiting 21:16:09 (9200): No heartbeat from core client for 30 sec - exiting 21:16:10 (9200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14296, selfPID=14296, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:49:11 (12040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11084, selfPID=11084, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14940, selfPID=14940, iMonCtr=2 06:53:44 (9572): No heartbeat from core client for 30 sec - exiting 06:53:45 (9572): No heartbeat from core client for 30 sec - exiting 06:53:46 (9572): No heartbeat from core client for 30 sec - exiting 06:53:47 (9572): No heartbeat from core client for 30 sec - exiting 06:53:48 (9572): No heartbeat from core client for 30 sec - exiting 06:53:49 (9572): No heartbeat from core client for 30 sec - exiting 06:53:50 (9572): No heartbeat from core client for 30 sec - exiting 06:53:51 (9572): No heartbeat from core client for 30 sec - exiting 06:53:52 (9572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:43:32 (3712): No heartbeat from core client for 30 sec - exiting 20:43:33 (3712): No heartbeat from core client for 30 sec - exiting 20:43:34 (3712): No heartbeat from core client for 30 sec - exiting 20:43:35 (3712): No heartbeat from core client for 30 sec - exiting 20:43:36 (3712): No heartbeat from core client for 30 sec - exiting 20:43:37 (3712): No heartbeat from core client for 30 sec - exiting 20:43:38 (3712): No heartbeat from core client for 30 sec - exiting 20:43:39 (3712): No heartbeat from core client for 30 sec - exiting 20:43:40 (3712): No heartbeat from core client for 30 sec - exiting 20:43:41 (3712): No heartbeat from core client for 30 sec - exiting 20:43:42 (3712): No heartbeat from core client for 30 sec - exiting 20:43:43 (3712): No heartbeat from core client for 30 sec - exiting 20:43:44 (3712): No heartbeat from core client for 30 sec - exiting 20:43:45 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6480, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6336, selfPID=9008, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_ipu3_1996_1_008478672_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ipu3_1996_1_008478672_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Dec 2013 04:04:07	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	115,301	231,609	2.0087
12 Dec 2013 02:28:16	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	115,296	231,295	2.0061
11 Dec 2013 18:53:13	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	103,776	208,685	2.0109
11 Dec 2013 09:48:33	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	92,256	186,127	2.0175
10 Dec 2013 22:19:44	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	80,736	163,595	2.0263
10 Dec 2013 14:07:39	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	69,216	140,617	2.0316
10 Dec 2013 06:10:43	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	57,696	117,401	2.0348
09 Dec 2013 20:42:08	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	46,176	94,329	2.0428
09 Dec 2013 11:45:16	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	34,656	70,831	2.0438
08 Dec 2013 15:53:33	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	23,136	47,212	2.0406
07 Dec 2013 22:09:26	1300539	16105639	hadam3p_eu_ipu3_1996_1_008478672_0	11,616	23,583	2.0302