Task 18343974

Name	hadam3p_anz_f727_2012_1_009778516_0
Workunit	9834480
Created	24 Apr 2015, 15:12:54 UTC
Sent	25 Apr 2015, 8:01:15 UTC
Report deadline	6 Apr 2016, 13:21:15 UTC
Received	21 May 2015, 2:46:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1321501
Run time	4 days 3 hours 16 min 37 sec
CPU time	3 days 21 hours 53 min 16 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	3.73 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5424, selfPID=2676, iMonCtr=1 Model crash detected, will try to restart... 09:23:45 (3268): No heartbeat from core client for 30 sec - exiting 09:23:46 (3268): No heartbeat from core client for 30 sec - exiting 09:23:47 (3268): No heartbeat from core client for 30 sec - exiting 09:23:48 (3268): No heartbeat from core client for 30 sec - exiting 09:23:49 (3268): No heartbeat from core client for 30 sec - exiting 09:23:50 (3268): No heartbeat from core client for 30 sec - exiting 09:23:51 (3268): No heartbeat from core client for 30 sec - exiting 09:23:52 (3268): No heartbeat from core client for 30 sec - exiting 09:23:53 (3268): No heartbeat from core client for 30 sec - exiting 09:23:54 (3268): No heartbeat from core client for 30 sec - exiting 09:23:55 (3268): No heartbeat from core client for 30 sec - exiting 09:23:57 (3268): No heartbeat from core client for 30 sec - exiting 09:23:58 (3268): No heartbeat from core client for 30 sec - exiting 09:23:59 (3268): No heartbeat from core client for 30 sec - exiting 09:24:00 (3268): No heartbeat from core client for 30 sec - exiting 09:24:01 (3268): No heartbeat from core client for 30 sec - exiting 09:24:02 (3268): No heartbeat from core client for 30 sec - exiting 09:24:03 (3268): No heartbeat from core client for 30 sec - exiting 09:24:04 (3268): No heartbeat from core client for 30 sec - exiting 09:24:05 (3268): No heartbeat from core client for 30 sec - exiting 09:24:06 (3268): No heartbeat from core client for 30 sec - exiting 09:24:07 (3268): No heartbeat from core client for 30 sec - exiting 09:24:09 (3268): No heartbeat from core client for 30 sec - exiting 09:24:10 (3268): No heartbeat from core client for 30 sec - exiting 09:24:11 (3268): No heartbeat from core client for 30 sec - exiting 09:24:12 (3268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6056, selfPID=6056, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6036, selfPID=6036, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8060, iMonCtr=2 10:10:35 (4804): No heartbeat from core client for 30 sec - exiting 10:10:36 (4804): No heartbeat from core client for 30 sec - exiting 10:10:37 (4804): No heartbeat from core client for 30 sec - exiting 10:10:38 (4804): No heartbeat from core client for 30 sec - exiting 10:10:39 (4804): No heartbeat from core client for 30 sec - exiting 10:10:40 (4804): No heartbeat from core client for 30 sec - exiting 10:10:41 (4804): No heartbeat from core client for 30 sec - exiting 10:10:43 (4804): No heartbeat from core client for 30 sec - exiting 10:10:44 (4804): No heartbeat from core client for 30 sec - exiting 10:10:45 (4804): No heartbeat from core client for 30 sec - exiting 10:10:46 (4804): No heartbeat from core client for 30 sec - exiting 10:10:47 (4804): No heartbeat from core client for 30 sec - exiting 10:10:48 (4804): No heartbeat from core client for 30 sec - exiting 10:10:49 (4804): No heartbeat from core client for 30 sec - exiting 10:10:50 (4804): No heartbeat from core client for 30 sec - exiting 10:10:51 (4804): No heartbeat from core client for 30 sec - exiting 10:10:52 (4804): No heartbeat from core client for 30 sec - exiting 10:10:53 (4804): No heartbeat from core client for 30 sec - exiting 10:10:55 (4804): No heartbeat from core client for 30 sec - exiting 10:10:56 (4804): No heartbeat from core client for 30 sec - exiting 10:10:57 (4804): No heartbeat from core client for 30 sec - exiting 10:10:58 (4804): No heartbeat from core client for 30 sec - exiting 10:10:59 (4804): No heartbeat from core client for 30 sec - exiting 10:11:00 (4804): No heartbeat from core client for 30 sec - exiting 10:11:01 (4804): No heartbeat from core client for 30 sec - exiting 10:11:02 (4804): No heartbeat from core client for 30 sec - exiting 10:11:03 (4804): No heartbeat from core client for 30 sec - exiting 10:11:04 (4804): No heartbeat from core client for 30 sec - exiting 10:11:06 (4804): No heartbeat from core client for 30 sec - exiting 10:11:07 (4804): No heartbeat from core client for 30 sec - exiting 10:11:08 (4804): No heartbeat from core client for 30 sec - exiting 10:11:09 (4804): No heartbeat from core client for 30 sec - exiting 10:11:10 (4804): No heartbeat from core client for 30 sec - exiting 10:11:11 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5308, selfPID=7832, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5912, selfPID=6900, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:25:50 (4368): No heartbeat from core client for 30 sec - exiting 10:25:51 (4368): No heartbeat from core client for 30 sec - exiting 10:25:52 (4368): No heartbeat from core client for 30 sec - exiting 10:25:53 (4368): No heartbeat from core client for 30 sec - exiting 10:25:54 (4368): No heartbeat from core client for 30 sec - exiting 10:25:55 (4368): No heartbeat from core client for 30 sec - exiting 10:25:56 (4368): No heartbeat from core client for 30 sec - exiting 10:25:58 (4368): No heartbeat from core client for 30 sec - exiting 10:25:59 (4368): No heartbeat from core client for 30 sec - exiting 10:26:00 (4368): No heartbeat from core client for 30 sec - exiting 10:26:01 (4368): No heartbeat from core client for 30 sec - exiting 10:26:02 (4368): No heartbeat from core client for 30 sec - exiting 10:26:03 (4368): No heartbeat from core client for 30 sec - exiting 10:26:04 (4368): No heartbeat from core client for 30 sec - exiting 10:26:05 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6508, selfPID=6508, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6912, selfPID=6912, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7392, selfPID=5720, iMonCtr=1 Model crash detected, will try to restart... 10:43:54 (5264): No heartbeat from core client for 30 sec - exiting 10:43:55 (5264): No heartbeat from core client for 30 sec - exiting 10:43:56 (5264): No heartbeat from core client for 30 sec - exiting 10:43:57 (5264): No heartbeat from core client for 30 sec - exiting 10:43:58 (5264): No heartbeat from core client for 30 sec - exiting 10:43:59 (5264): No heartbeat from core client for 30 sec - exiting 10:44:01 (5264): No heartbeat from core client for 30 sec - exiting 10:44:02 (5264): No heartbeat from core client for 30 sec - exiting 10:44:03 (5264): No heartbeat from core client for 30 sec - exiting 10:44:04 (5264): No heartbeat from core client for 30 sec - exiting 10:44:05 (5264): No heartbeat from core client for 30 sec - exiting 10:44:06 (5264): No heartbeat from core client for 30 sec - exiting 10:44:07 (5264): No heartbeat from core client for 30 sec - exiting 10:44:08 (5264): No heartbeat from core client for 30 sec - exiting 10:44:09 (5264): No heartbeat from core client for 30 sec - exiting 10:44:10 (5264): No heartbeat from core client for 30 sec - exiting 10:44:11 (5264): No heartbeat from core client for 30 sec - exiting 10:44:13 (5264): No heartbeat from core client for 30 sec - exiting 10:44:14 (5264): No heartbeat from core client for 30 sec - exiting 10:44:15 (5264): No heartbeat from core client for 30 sec - exiting 10:44:16 (5264): No heartbeat from core client for 30 sec - exiting 10:44:17 (5264): No heartbeat from core client for 30 sec - exiting 10:44:18 (5264): No heartbeat from core client for 30 sec - exiting 10:44:19 (5264): No heartbeat from core client for 30 sec - exiting 10:44:20 (5264): No heartbeat from core client for 30 sec - exiting 10:44:21 (5264): No heartbeat from core client for 30 sec - exiting 10:44:22 (5264): No heartbeat from core client for 30 sec - exiting 10:44:23 (5264): No heartbeat from core client for 30 sec - exiting 10:44:25 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5184, selfPID=5184, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=2 09:55:01 (3632): No heartbeat from core client for 30 sec - exiting 09:55:02 (3632): No heartbeat from core client for 30 sec - exiting 09:55:03 (3632): No heartbeat from core client for 30 sec - exiting 09:55:04 (3632): No heartbeat from core client for 30 sec - exiting 09:55:05 (3632): No heartbeat from core client for 30 sec - exiting 09:55:06 (3632): No heartbeat from core client for 30 sec - exiting 09:55:07 (3632): No heartbeat from core client for 30 sec - exiting 09:55:08 (3632): No heartbeat from core client for 30 sec - exiting 09:55:09 (3632): No heartbeat from core client for 30 sec - exiting 09:55:11 (3632): No heartbeat from core client for 30 sec - exiting 09:55:12 (3632): No heartbeat from core client for 30 sec - exiting 09:55:13 (3632): No heartbeat from core client for 30 sec - exiting 09:55:14 (3632): No heartbeat from core client for 30 sec - exiting 09:55:15 (3632): No heartbeat from core client for 30 sec - exiting 09:55:16 (3632): No heartbeat from core client for 30 sec - exiting 09:55:17 (3632): No heartbeat from core client for 30 sec - exiting 09:55:18 (3632): No heartbeat from core client for 30 sec - exiting 09:55:19 (3632): No heartbeat from core client for 30 sec - exiting 09:55:20 (3632): No heartbeat from core client for 30 sec - exiting 09:55:21 (3632): No heartbeat from core client for 30 sec - exiting 09:55:23 (3632): No heartbeat from core client for 30 sec - exiting 09:55:24 (3632): No heartbeat from core client for 30 sec - exiting 09:55:25 (3632): No heartbeat from core client for 30 sec - exiting 09:55:26 (3632): No heartbeat from core client for 30 sec - exiting 09:55:27 (3632): No heartbeat from core client for 30 sec - exiting 09:55:28 (3632): No heartbeat from core client for 30 sec - exiting 09:55:29 (3632): No heartbeat from core client for 30 sec - exiting 09:55:30 (3632): No heartbeat from core client for 30 sec - exiting 09:55:31 (3632): No heartbeat from core client for 30 sec - exiting 09:55:32 (3632): No heartbeat from core client for 30 sec - exiting 09:55:34 (3632): No heartbeat from core client for 30 sec - exiting 09:55:35 (3632): No heartbeat from core client for 30 sec - exiting 09:55:36 (3632): No heartbeat from core client for 30 sec - exiting 09:55:37 (3632): No heartbeat from core client for 30 sec - exiting 09:55:38 (3632): No heartbeat from core client for 30 sec - exiting 09:55:39 (3632): No heartbeat from core client for 30 sec - exiting 09:55:40 (3632): No heartbeat from core client for 30 sec - exiting 09:57:19 (3632): No heartbeat from core client for 30 sec - exiting 09:57:21 (3632): No heartbeat from core client for 30 sec - exiting 09:57:22 (3632): No heartbeat from core client for 30 sec - exiting 09:57:23 (3632): No heartbeat from core client for 30 sec - exiting 09:57:24 (3632): No heartbeat from core client for 30 sec - exiting 09:57:25 (3632): No heartbeat from core client for 30 sec - exiting 09:57:26 (3632): No heartbeat from core client for 30 sec - exiting 09:57:27 (3632): No heartbeat from core client for 30 sec - exiting 09:57:28 (3632): No heartbeat from core client for 30 sec - exiting 09:57:29 (3632): No heartbeat from core client for 30 sec - exiting 09:57:30 (3632): No heartbeat from core client for 30 sec - exiting 09:57:31 (3632): No heartbeat from core client for 30 sec - exiting 09:57:33 (3632): No heartbeat from core client for 30 sec - exiting 09:57:34 (3632): No heartbeat from core client for 30 sec - exiting 09:57:35 (3632): No heartbeat from core client for 30 sec - exiting 09:57:36 (3632): No heartbeat from core client for 30 sec - exiting 09:57:37 (3632): No heartbeat from core client for 30 sec - exiting 09:57:38 (3632): No heartbeat from core client for 30 sec - exiting 09:57:39 (3632): No heartbeat from core client for 30 sec - exiting 09:57:40 (3632): No heartbeat from core client for 30 sec - exiting 09:57:41 (3632): No heartbeat from core client for 30 sec - exiting 09:57:42 (3632): No heartbeat from core client for 30 sec - exiting 09:57:43 (3632): No heartbeat from core client for 30 sec - exiting 09:57:45 (3632): No heartbeat from core client for 30 sec - exiting 09:57:46 (3632): No heartbeat from core client for 30 sec - exiting 09:57:47 (3632): No heartbeat from core client for 30 sec - exiting 09:57:48 (3632): No heartbeat from core client for 30 sec - exiting 09:57:49 (3632): No heartbeat from core client for 30 sec - exiting 09:57:50 (3632): No heartbeat from core client for 30 sec - exiting 09:57:51 (3632): No heartbeat from core client for 30 sec - exiting 09:57:52 (3632): No heartbeat from core client for 30 sec - exiting 09:57:53 (3632): No heartbeat from core client for 30 sec - exiting 09:57:54 (3632): No heartbeat from core client for 30 sec - exiting 09:57:55 (3632): No heartbeat from core client for 30 sec - exiting 09:57:57 (3632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:43:12 (4072): No heartbeat from core client for 30 sec - exiting 10:43:14 (4072): No heartbeat from core client for 30 sec - exiting 10:43:15 (4072): No heartbeat from core client for 30 sec - exiting 10:43:16 (4072): No heartbeat from core client for 30 sec - exiting 10:43:17 (4072): No heartbeat from core client for 30 sec - exiting 10:43:18 (4072): No heartbeat from core client for 30 sec - exiting 10:43:19 (4072): No heartbeat from core client for 30 sec - exiting 10:43:20 (4072): No heartbeat from core client for 30 sec - exiting 10:43:21 (4072): No heartbeat from core client for 30 sec - exiting 10:43:22 (4072): No heartbeat from core client for 30 sec - exiting 10:43:23 (4072): No heartbeat from core client for 30 sec - exiting 10:43:24 (4072): No heartbeat from core client for 30 sec - exiting 10:43:25 (4072): No heartbeat from core client for 30 sec - exiting 10:43:26 (4072): No heartbeat from core client for 30 sec - exiting 10:43:27 (4072): No heartbeat from core client for 30 sec - exiting 10:43:29 (4072): No heartbeat from core client for 30 sec - exiting 10:43:30 (4072): No heartbeat from core client for 30 sec - exiting 10:43:31 (4072): No heartbeat from core client for 30 sec - exiting 10:43:32 (4072): No heartbeat from core client for 30 sec - exiting 10:43:33 (4072): No heartbeat from core client for 30 sec - exiting 10:43:34 (4072): No heartbeat from core client for 30 sec - exiting 10:43:35 (4072): No heartbeat from core client for 30 sec - exiting 10:43:36 (4072): No heartbeat from core client for 30 sec - exiting 10:43:37 (4072): No heartbeat from core client for 30 sec - exiting 10:43:38 (4072): No heartbeat from core client for 30 sec - exiting 10:43:39 (4072): No heartbeat from core client for 30 sec - exiting 10:43:41 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:42:57 (2412): No heartbeat from core client for 30 sec - exiting 09:42:58 (2412): No heartbeat from core client for 30 sec - exiting 09:42:59 (2412): No heartbeat from core client for 30 sec - exiting 09:43:00 (2412): No heartbeat from core client for 30 sec - exiting 09:43:01 (2412): No heartbeat from core client for 30 sec - exiting 09:43:02 (2412): No heartbeat from core client for 30 sec - exiting 09:43:04 (2412): No heartbeat from core client for 30 sec - exiting 09:43:05 (2412): No heartbeat from core client for 30 sec - exiting 09:43:06 (2412): No heartbeat from core client for 30 sec - exiting 09:43:07 (2412): No heartbeat from core client for 30 sec - exiting 09:43:08 (2412): No heartbeat from core client for 30 sec - exiting 09:43:09 (2412): No heartbeat from core client for 30 sec - exiting 09:43:10 (2412): No heartbeat from core client for 30 sec - exiting 09:43:11 (2412): No heartbeat from core client for 30 sec - exiting 09:43:12 (2412): No heartbeat from core client for 30 sec - exiting 09:43:13 (2412): No heartbeat from core client for 30 sec - exiting 09:43:15 (2412): No heartbeat from core client for 30 sec - exiting 09:43:16 (2412): No heartbeat from core client for 30 sec - exiting 09:43:17 (2412): No heartbeat from core client for 30 sec - exiting 09:43:18 (2412): No heartbeat from core client for 30 sec - exiting 09:43:19 (2412): No heartbeat from core client for 30 sec - exiting 09:43:20 (2412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:02:16 (4136): No heartbeat from core client for 30 sec - exiting 10:02:17 (4136): No heartbeat from core client for 30 sec - exiting 10:02:19 (4136): No heartbeat from core client for 30 sec - exiting 10:02:20 (4136): No heartbeat from core client for 30 sec - exiting 10:02:21 (4136): No heartbeat from core client for 30 sec - exiting 10:02:22 (4136): No heartbeat from core client for 30 sec - exiting 10:02:23 (4136): No heartbeat from core client for 30 sec - exiting 10:02:24 (4136): No heartbeat from core client for 30 sec - exiting 10:02:25 (4136): No heartbeat from core client for 30 sec - exiting 10:02:26 (4136): No heartbeat from core client for 30 sec - exiting 10:02:27 (4136): No heartbeat from core client for 30 sec - exiting 10:02:28 (4136): No heartbeat from core client for 30 sec - exiting 10:02:30 (4136): No heartbeat from core client for 30 sec - exiting 10:02:31 (4136): No heartbeat from core client for 30 sec - exiting 10:02:32 (4136): No heartbeat from core client for 30 sec - exiting 10:02:33 (4136): No heartbeat from core client for 30 sec - exiting 10:02:34 (4136): No heartbeat from core client for 30 sec - exiting 10:02:35 (4136): No heartbeat from core client for 30 sec - exiting 10:02:36 (4136): No heartbeat from core client for 30 sec - exiting 10:02:37 (4136): No heartbeat from core client for 30 sec - exiting 10:02:38 (4136): No heartbeat from core client for 30 sec - exiting 10:02:39 (4136): No heartbeat from core client for 30 sec - exiting 10:02:40 (4136): No heartbeat from core client for 30 sec - exiting 10:02:42 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6732, selfPID=3044, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:19 (4148): No heartbeat from core client for 30 sec - exiting 10:12:21 (4148): No heartbeat from core client for 30 sec - exiting 10:12:22 (4148): No heartbeat from core client for 30 sec - exiting 10:12:23 (4148): No heartbeat from core client for 30 sec - exiting 10:12:24 (4148): No heartbeat from core client for 30 sec - exiting 10:12:25 (4148): No heartbeat from core client for 30 sec - exiting 10:12:26 (4148): No heartbeat from core client for 30 sec - exiting 10:12:27 (4148): No heartbeat from core client for 30 sec - exiting 10:12:28 (4148): No heartbeat from core client for 30 sec - exiting 10:12:29 (4148): No heartbeat from core client for 30 sec - exiting 10:12:30 (4148): No heartbeat from core client for 30 sec - exiting 10:12:32 (4148): No heartbeat from core client for 30 sec - exiting 10:12:33 (4148): No heartbeat from core client for 30 sec - exiting 10:12:34 (4148): No heartbeat from core client for 30 sec - exiting 10:12:35 (4148): No heartbeat from core client for 30 sec - exiting 10:12:36 (4148): No heartbeat from core client for 30 sec - exiting 10:12:37 (4148): No heartbeat from core client for 30 sec - exiting 10:12:38 (4148): No heartbeat from core client for 30 sec - exiting 10:12:39 (4148): No heartbeat from core client for 30 sec - exiting 10:12:40 (4148): No heartbeat from core client for 30 sec - exiting 10:12:41 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4576, selfPID=4916, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle RCPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6952, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:40:02 (3500): No heartbeat from core client for 30 sec - exiting 10:40:03 (3500): No heartbeat from core client for 30 sec - exiting 10:40:04 (3500): No heartbeat from core client for 30 sec - exiting 10:40:06 (3500): No heartbeat from core client for 30 sec - exiting 10:40:07 (3500): No heartbeat from core client for 30 sec - exiting 10:40:08 (3500): No heartbeat from core client for 30 sec - exiting 10:40:09 (3500): No heartbeat from core client for 30 sec - exiting 10:40:10 (3500): No heartbeat from core client for 30 sec - exiting 10:40:11 (3500): No heartbeat from core client for 30 sec - exiting 10:40:12 (3500): No heartbeat from core client for 30 sec - exiting 10:40:13 (3500): No heartbeat from core client for 30 sec - exiting 10:40:14 (3500): No heartbeat from core client for 30 sec - exiting 10:40:15 (3500): No heartbeat from core client for 30 sec - exiting 10:40:17 (3500): No heartbeat from core client for 30 sec - exiting 10:40:18 (3500): No heartbeat from core client for 30 sec - exiting 10:40:19 (3500): No heartbeat from core client for 30 sec - exiting 10:40:20 (3500): No heartbeat from core client for 30 sec - exiting 10:40:21 (3500): No heartbeat from core client for 30 sec - exiting 10:40:22 (3500): No heartbeat from core client for 30 sec - exiting 10:40:23 (3500): No heartbeat from core client for 30 sec - exiting 10:40:24 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3348, selfPID=3348, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3440, selfPID=3440, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:33:26 (4648): No heartbeat from core client for 30 sec - exiting 09:33:27 (4648): No heartbeat from core client for 30 sec - exiting 09:33:28 (4648): No heartbeat from core client for 30 sec - exiting 09:33:29 (4648): No heartbeat from core client for 30 sec - exiting 09:33:30 (4648): No heartbeat from core client for 30 sec - exiting 09:33:31 (4648): No heartbeat from core client for 30 sec - exiting 09:33:32 (4648): No heartbeat from core client for 30 sec - exiting 09:33:33 (4648): No heartbeat from core client for 30 sec - exiting 09:33:34 (4648): No heartbeat from core client for 30 sec - exiting 09:33:36 (4648): No heartbeat from core client for 30 sec - exiting 09:33:37 (4648): No heartbeat from core client for 30 sec - exiting 09:33:38 (4648): No heartbeat from core client for 30 sec - exiting 09:33:39 (4648): No heartbeat from core client for 30 sec - exiting 09:33:40 (4648): No heartbeat from core client for 30 sec - exiting 09:33:41 (4648): No heartbeat from core client for 30 sec - exiting 09:33:42 (4648): No heartbeat from core client for 30 sec - exiting 09:33:43 (4648): No heartbeat from core client for 30 sec - exiting 09:33:44 (4648): No heartbeat from core client for 30 sec - exiting 09:33:45 (4648): No heartbeat from core client for 30 sec - exiting 09:33:46 (4648): No heartbeat from core client for 30 sec - exiting 09:33:48 (4648): No heartbeat from core client for 30 sec - exiting 09:33:49 (4648): No heartbeat from core client for 30 sec - exiting 09:33:50 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:56:24 (3024): No heartbeat from core client for 30 sec - exiting 08:56:26 (3024): No heartbeat from core client for 30 sec - exiting 08:56:27 (3024): No heartbeat from core client for 30 sec - exiting 08:56:28 (3024): No heartbeat from core client for 30 sec - exiting 08:56:29 (3024): No heartbeat from core client for 30 sec - exiting 08:56:30 (3024): No heartbeat from core client for 30 sec - exiting 08:56:31 (3024): No heartbeat from core client for 30 sec - exiting 08:56:32 (3024): No heartbeat from core client for 30 sec - exiting 08:56:34 (3024): No heartbeat from core client for 30 sec - exiting 08:56:35 (3024): No heartbeat from core client for 30 sec - exiting 08:56:36 (3024): No heartbeat from core client for 30 sec - exiting 08:56:37 (3024): No heartbeat from core client for 30 sec - exiting 08:56:38 (3024): No heartbeat from core client for 30 sec - exiting 08:56:39 (3024): No heartbeat from core client for 30 sec - exiting 08:56:40 (3024): No heartbeat from core client for 30 sec - exiting 08:56:41 (3024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:14:39 (2888): No heartbeat from core client for 30 sec - exiting 08:14:40 (2888): No heartbeat from core client for 30 sec - exiting 08:14:41 (2888): No heartbeat from core client for 30 sec - exiting 08:14:42 (2888): No heartbeat from core client for 30 sec - exiting 08:14:44 (2888): No heartbeat from core client for 30 sec - exiting 08:14:45 (2888): No heartbeat from core client for 30 sec - exiting 08:14:46 (2888): No heartbeat from core client for 30 sec - exiting 08:14:47 (2888): No heartbeat from core client for 30 sec - exiting 08:14:48 (2888): No heartbeat from core client for 30 sec - exiting 08:14:49 (2888): No heartbeat from core client for 30 sec - exiting 08:14:50 (2888): No heartbeat from core client for 30 sec - exiting 08:14:51 (2888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6412, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f727_2012_1_009778516_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f727_2012_1_009778516_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f727_2012_1_009778516_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f727_2012_1_009778516_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f727_2012_1_009778516_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f727_2012_1_009778516_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f727_2012_1_009778516_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 May 2015 23:27:31	1321501	18343974	hadam3p_anz_f727_2012_1_009778516_0	57,899	324,694	5.6079
15 May 2015 04:41:44	1321501	18343974	hadam3p_anz_f727_2012_1_009778516_0	46,379	260,786	5.6229
10 May 2015 04:42:45	1321501	18343974	hadam3p_anz_f727_2012_1_009778516_0	34,859	196,982	5.6508
08 May 2015 19:13:36	1321501	18343974	hadam3p_anz_f727_2012_1_009778516_0	23,339	129,558	5.5511
30 Apr 2015 06:23:03	1321501	18343974	hadam3p_anz_f727_2012_1_009778516_0	11,819	65,605	5.5508