Task 18286369

Name	hadam3p_anz_f8bj_2013_1_009732731_0
Workunit	9804576
Created	8 Apr 2015, 20:56:32 UTC
Sent	19 Apr 2015, 1:54:12 UTC
Report deadline	31 Mar 2016, 7:14:12 UTC
Received	30 Jun 2015, 3:47:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1360388
Run time	3 days 23 hours 35 min 7 sec
CPU time	3 days 21 hours 11 min 57 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	2.14 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:33:22 (13520): No heartbeat from core client for 30 sec - exiting 20:33:23 (13520): No heartbeat from core client for 30 sec - exiting 20:33:24 (13520): No heartbeat from core client for 30 sec - exiting 20:33:25 (13520): No heartbeat from core client for 30 sec - exiting 20:33:26 (13520): No heartbeat from core client for 30 sec - exiting 20:33:27 (13520): No heartbeat from core client for 30 sec - exiting 20:33:28 (13520): No heartbeat from core client for 30 sec - exiting 20:33:29 (13520): No heartbeat from core client for 30 sec - exiting 20:33:30 (13520): No heartbeat from core client for 30 sec - exiting 20:33:31 (13520): No heartbeat from core client for 30 sec - exiting 20:33:32 (13520): No heartbeat from core client for 30 sec - exiting 20:33:33 (13520): No heartbeat from core client for 30 sec - exiting 20:33:34 (13520): No heartbeat from core client for 30 sec - exiting 20:33:35 (13520): No heartbeat from core client for 30 sec - exiting 20:33:36 (13520): No heartbeat from core client for 30 sec - exiting 20:33:37 (13520): No heartbeat from core client for 30 sec - exiting 20:33:38 (13520): No heartbeat from core client for 30 sec - exiting 20:33:39 (13520): No heartbeat from core client for 30 sec - exiting 20:33:40 (13520): No heartbeat from core client for 30 sec - exiting 20:33:41 (13520): No heartbeat from core client for 30 sec - exiting 20:33:42 (13520): No heartbeat from core client for 30 sec - exiting 20:33:43 (13520): No heartbeat from core client for 30 sec - exiting 20:33:44 (13520): No heartbeat from core client for 30 sec - exiting 20:33:45 (13520): No heartbeat from core client for 30 sec - exiting 20:33:46 (13520): No heartbeat from core client for 30 sec - exiting 20:33:47 (13520): No heartbeat from core client for 30 sec - exiting 20:33:48 (13520): No heartbeat from core client for 30 sec - exiting 20:33:49 (13520): No heartbeat from core client for 30 sec - exiting 20:33:50 (13520): No heartbeat from core client for 30 sec - exiting 20:33:51 (13520): No heartbeat from core client for 30 sec - exiting 20:33:52 (13520): No heartbeat from core client for 30 sec - exiting 20:33:53 (13520): No heartbeat from core client for 30 sec - exiting 20:33:54 (13520): No heartbeat from core client for 30 sec - exiting 20:33:55 (13520): No heartbeat from core client for 30 sec - exiting 20:33:56 (13520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:57 (13520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8400, iMonCtr=2 08:49:06 (288): No heartbeat from core client for 30 sec - exiting 08:49:07 (288): No heartbeat from core client for 30 sec - exiting 08:49:08 (288): No heartbeat from core client for 30 sec - exiting 08:49:09 (288): No heartbeat from core client for 30 sec - exiting 08:49:10 (288): No heartbeat from core client for 30 sec - exiting 08:49:11 (288): No heartbeat from core client for 30 sec - exiting 08:49:12 (288): No heartbeat from core client for 30 sec - exiting 08:49:13 (288): No heartbeat from core client for 30 sec - exiting 08:49:14 (288): No heartbeat from core client for 30 sec - exiting 08:49:15 (288): No heartbeat from core client for 30 sec - exiting 08:49:16 (288): No heartbeat from core client for 30 sec - exiting 08:49:17 (288): No heartbeat from core client for 30 sec - exiting 08:49:18 (288): No heartbeat from core client for 30 sec - exiting 08:49:19 (288): No heartbeat from core client for 30 sec - exiting 08:49:20 (288): No heartbeat from core client for 30 sec - exiting 08:49:21 (288): No heartbeat from core client for 30 sec - exiting 08:49:22 (288): No heartbeat from core client for 30 sec - exiting 08:49:23 (288): No heartbeat from core client for 30 sec - exiting 08:49:24 (288): No heartbeat from core client for 30 sec - exiting 08:49:25 (288): No heartbeat from core client for 30 sec - exiting 08:49:26 (288): No heartbeat from core client for 30 sec - exiting 08:49:27 (288): No heartbeat from core client for 30 sec - exiting 08:49:28 (288): No heartbeat from core client for 30 sec - exiting 08:49:29 (288): No heartbeat from core client for 30 sec - exiting 08:49:30 (288): No heartbeat from core client for 30 sec - exiting 08:49:31 (288): No heartbeat from core client for 30 sec - exiting 08:49:32 (288): No heartbeat from core client for 30 sec - exiting 08:49:33 (288): No heartbeat from core client for 30 sec - exiting 08:49:34 (288): No heartbeat from core client for 30 sec - exiting 08:49:35 (288): No heartbeat from core client for 30 sec - exiting 08:49:36 (288): No heartbeat from core client for 30 sec - exiting 08:49:37 (288): No heartbeat from core client for 30 sec - exiting 08:49:38 (288): No heartbeat from core client for 30 sec - exiting 08:49:39 (288): No heartbeat from core client for 30 sec - exiting 08:49:40 (288): No heartbeat from core client for 30 sec - exiting 08:49:41 (288): No heartbeat from core client for 30 sec - exiting 08:49:42 (288): No heartbeat from core client for 30 sec - exiting 08:49:43 (288): No heartbeat from core client for 30 sec - exiting 08:49:44 (288): No heartbeat from core client for 30 sec - exiting 08:49:45 (288): No heartbeat from core client for 30 sec - exiting 08:49:46 (288): No heartbeat from core client for 30 sec - exiting 08:49:47 (288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:45:51 (4216): No heartbeat from core client for 30 sec - exiting 09:45:52 (4216): No heartbeat from core client for 30 sec - exiting 09:45:53 (4216): No heartbeat from core client for 30 sec - exiting 09:45:54 (4216): No heartbeat from core client for 30 sec - exiting 09:45:55 (4216): No heartbeat from core client for 30 sec - exiting 09:45:56 (4216): No heartbeat from core client for 30 sec - exiting 09:45:57 (4216): No heartbeat from core client for 30 sec - exiting 09:45:58 (4216): No heartbeat from core client for 30 sec - exiting 09:45:59 (4216): No heartbeat from core client for 30 sec - exiting 09:46:00 (4216): No heartbeat from core client for 30 sec - exiting 09:46:01 (4216): No heartbeat from core client for 30 sec - exiting 09:46:02 (4216): No heartbeat from core client for 30 sec - exiting 09:46:03 (4216): No heartbeat from core client for 30 sec - exiting 09:46:04 (4216): No heartbeat from core client for 30 sec - exiting 09:46:05 (4216): No heartbeat from core client for 30 sec - exiting 09:46:06 (4216): No heartbeat from core client for 30 sec - exiting 09:46:07 (4216): No heartbeat from core client for 30 sec - exiting 09:46:08 (4216): No heartbeat from core client for 30 sec - exiting 09:46:09 (4216): No heartbeat from core client for 30 sec - exiting 09:46:10 (4216): No heartbeat from core client for 30 sec - exiting 09:46:11 (4216): No heartbeat from core client for 30 sec - exiting 09:46:12 (4216): No heartbeat from core client for 30 sec - exiting 09:46:13 (4216): No heartbeat from core client for 30 sec - exiting 09:46:14 (4216): No heartbeat from core client for 30 sec - exiting 09:46:15 (4216): No heartbeat from core client for 30 sec - exiting 09:46:16 (4216): No heartbeat from core client for 30 sec - exiting 09:46:17 (4216): No heartbeat from core client for 30 sec - exiting 09:46:18 (4216): No heartbeat from core client for 30 sec - exiting 09:46:19 (4216): No heartbeat from core client for 30 sec - exiting 09:46:20 (4216): No heartbeat from core client for 30 sec - exiting 09:46:21 (4216): No heartbeat from core client for 30 sec - exiting 09:46:22 (4216): No heartbeat from core client for 30 sec - exiting 09:46:23 (4216): No heartbeat from core client for 30 sec - exiting 09:46:24 (4216): No heartbeat from core client for 30 sec - exiting 09:46:25 (4216): No heartbeat from core client for 30 sec - exiting 09:46:26 (4216): No heartbeat from core client for 30 sec - exiting 09:46:27 (4216): No heartbeat from core client for 30 sec - exiting 09:46:28 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4880, iMonCtr=2 Model crash detected, will try to restart... 20:54:52 (12632): No heartbeat from core client for 30 sec - exiting 20:54:53 (12632): No heartbeat from core client for 30 sec - exiting 20:54:54 (12632): No heartbeat from core client for 30 sec - exiting 20:54:55 (12632): No heartbeat from core client for 30 sec - exiting 20:54:56 (12632): No heartbeat from core client for 30 sec - exiting 20:54:57 (12632): No heartbeat from core client for 30 sec - exiting 20:54:58 (12632): No heartbeat from core client for 30 sec - exiting 20:54:59 (12632): No heartbeat from core client for 30 sec - exiting 20:55:00 (12632): No heartbeat from core client for 30 sec - exiting 20:55:01 (12632): No heartbeat from core client for 30 sec - exiting 20:55:02 (12632): No heartbeat from core client for 30 sec - exiting 20:55:03 (12632): No heartbeat from core client for 30 sec - exiting 20:55:04 (12632): No heartbeat from core client for 30 sec - exiting 20:55:05 (12632): No heartbeat from core client for 30 sec - exiting 20:55:06 (12632): No heartbeat from core client for 30 sec - exiting 20:55:07 (12632): No heartbeat from core client for 30 sec - exiting 20:55:08 (12632): No heartbeat from core client for 30 sec - exiting 20:55:09 (12632): No heartbeat from core client for 30 sec - exiting 20:55:10 (12632): No heartbeat from core client for 30 sec - exiting 20:55:11 (12632): No heartbeat from core client for 30 sec - exiting 20:55:12 (12632): No heartbeat from core client for 30 sec - exiting 20:55:13 (12632): No heartbeat from core client for 30 sec - exiting 20:55:14 (12632): No heartbeat from core client for 30 sec - exiting 20:55:15 (12632): No heartbeat from core client for 30 sec - exiting 20:55:16 (12632): No heartbeat from core client for 30 sec - exiting 20:55:17 (12632): No heartbeat from core client for 30 sec - exiting 20:55:18 (12632): No heartbeat from core client for 30 sec - exiting 20:55:19 (12632): No heartbeat from core client for 30 sec - exiting 20:55:20 (12632): No heartbeat from core client for 30 sec - exiting 20:55:21 (12632): No heartbeat from core client for 30 sec - exiting 20:55:22 (12632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:21:21 (26432): No heartbeat from core client for 30 sec - exiting 10:21:22 (26432): No heartbeat from core client for 30 sec - exiting 10:21:23 (26432): No heartbeat from core client for 30 sec - exiting 10:21:24 (26432): No heartbeat from core client for 30 sec - exiting 10:21:25 (26432): No heartbeat from core client for 30 sec - exiting 10:21:26 (26432): No heartbeat from core client for 30 sec - exiting 10:21:27 (26432): No heartbeat from core client for 30 sec - exiting 10:21:28 (26432): No heartbeat from core client for 30 sec - exiting 10:21:29 (26432): No heartbeat from core client for 30 sec - exiting 10:21:30 (26432): No heartbeat from core client for 30 sec - exiting 10:21:31 (26432): No heartbeat from core client for 30 sec - exiting 10:21:32 (26432): No heartbeat from core client for 30 sec - exiting 10:21:33 (26432): No heartbeat from core client for 30 sec - exiting 10:21:34 (26432): No heartbeat from core client for 30 sec - exiting 10:21:35 (26432): No heartbeat from core client for 30 sec - exiting 10:21:36 (26432): No heartbeat from core client for 30 sec - exiting 10:21:37 (26432): No heartbeat from core client for 30 sec - exiting 10:21:38 (26432): No heartbeat from core client for 30 sec - exiting 10:21:39 (26432): No heartbeat from core client for 30 sec - exiting 10:21:40 (26432): No heartbeat from core client for 30 sec - exiting 10:21:41 (26432): No heartbeat from core client for 30 sec - exiting 10:21:42 (26432): No heartbeat from core client for 30 sec - exiting 10:21:43 (26432): No heartbeat from core client for 30 sec - exiting 10:21:44 (26432): No heartbeat from core client for 30 sec - exiting 10:21:45 (26432): No heartbeat from core client for 30 sec - exiting 10:21:46 (26432): No heartbeat from core client for 30 sec - exiting 10:21:47 (26432): No heartbeat from core client for 30 sec - exiting 10:21:48 (26432): No heartbeat from core client for 30 sec - exiting 10:21:49 (26432): No heartbeat from core client for 30 sec - exiting 10:21:50 (26432): No heartbeat from core client for 30 sec - exiting 10:21:51 (26432): No heartbeat from core client for 30 sec - exiting 10:21:52 (26432): No heartbeat from core client for 30 sec - exiting 10:21:53 (26432): No heartbeat from core client for 30 sec - exiting 10:21:54 (26432): No heartbeat from core client for 30 sec - exiting 10:21:55 (26432): No heartbeat from core client for 30 sec - exiting 10:21:56 (26432): No heartbeat from core client for 30 sec - exiting 10:21:57 (26432): No heartbeat from core client for 30 sec - exiting 10:21:58 (26432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:48:08 (4164): No heartbeat from core client for 30 sec - exiting 12:48:09 (4164): No heartbeat from core client for 30 sec - exiting 12:48:10 (4164): No heartbeat from core client for 30 sec - exiting 12:48:11 (4164): No heartbeat from core client for 30 sec - exiting 12:48:12 (4164): No heartbeat from core client for 30 sec - exiting 12:48:13 (4164): No heartbeat from core client for 30 sec - exiting 12:48:14 (4164): No heartbeat from core client for 30 sec - exiting 12:48:16 (4164): No heartbeat from core client for 30 sec - exiting 12:48:17 (4164): No heartbeat from core client for 30 sec - exiting 12:48:18 (4164): No heartbeat from core client for 30 sec - exiting 12:48:19 (4164): No heartbeat from core client for 30 sec - exiting 12:48:20 (4164): No heartbeat from core client for 30 sec - exiting 12:48:21 (4164): No heartbeat from core client for 30 sec - exiting 12:48:22 (4164): No heartbeat from core client for 30 sec - exiting 12:48:23 (4164): No heartbeat from core client for 30 sec - exiting 12:48:24 (4164): No heartbeat from core client for 30 sec - exiting 12:48:25 (4164): No heartbeat from core client for 30 sec - exiting 12:48:26 (4164): No heartbeat from core client for 30 sec - exiting 12:48:28 (4164): No heartbeat from core client for 30 sec - exiting 12:48:29 (4164): No heartbeat from core client for 30 sec - exiting 12:48:30 (4164): No heartbeat from core client for 30 sec - exiting 12:48:31 (4164): No heartbeat from core client for 30 sec - exiting 12:48:32 (4164): No heartbeat from core client for 30 sec - exiting 12:48:33 (4164): No heartbeat from core client for 30 sec - exiting 12:48:34 (4164): No heartbeat from core client for 30 sec - exiting 12:48:35 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:30:53 (7892): No heartbeat from core client for 30 sec - exiting 12:30:54 (7892): No heartbeat from core client for 30 sec - exiting 12:30:55 (7892): No heartbeat from core client for 30 sec - exiting 12:30:56 (7892): No heartbeat from core client for 30 sec - exiting 12:30:57 (7892): No heartbeat from core client for 30 sec - exiting 12:30:58 (7892): No heartbeat from core client for 30 sec - exiting 12:30:59 (7892): No heartbeat from core client for 30 sec - exiting 12:31:00 (7892): No heartbeat from core client for 30 sec - exiting 12:31:01 (7892): No heartbeat from core client for 30 sec - exiting 12:31:02 (7892): No heartbeat from core client for 30 sec - exiting 12:31:03 (7892): No heartbeat from core client for 30 sec - exiting 12:31:04 (7892): No heartbeat from core client for 30 sec - exiting 12:31:05 (7892): No heartbeat from core client for 30 sec - exiting 12:31:06 (7892): No heartbeat from core client for 30 sec - exiting 12:31:07 (7892): No heartbeat from core client for 30 sec - exiting 12:31:08 (7892): No heartbeat from core client for 30 sec - exiting 12:31:09 (7892): No heartbeat from core client for 30 sec - exiting 12:31:10 (7892): No heartbeat from core client for 30 sec - exiting 12:31:11 (7892): No heartbeat from core client for 30 sec - exiting 12:31:12 (7892): No heartbeat from core client for 30 sec - exiting 12:31:13 (7892): No heartbeat from core client for 30 sec - exiting 12:31:14 (7892): No heartbeat from core client for 30 sec - exiting 12:31:15 (7892): No heartbeat from core client for 30 sec - exiting 12:31:16 (7892): No heartbeat from core client for 30 sec - exiting 12:31:17 (7892): No heartbeat from core client for 30 sec - exiting 12:31:18 (7892): No heartbeat from core client for 30 sec - exiting 12:31:19 (7892): No heartbeat from core client for 30 sec - exiting 12:31:20 (7892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7844, selfPID=7844, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No PrController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=732, selfPID=6656, iMonCtr=1 Model crash detected, will try to restart... 09:29:55 (2704): No heartbeat from core client for 30 sec - exiting 09:29:56 (2704): No heartbeat from core client for 30 sec - exiting 09:29:57 (2704): No heartbeat from core client for 30 sec - exiting 09:29:58 (2704): No heartbeat from core client for 30 sec - exiting 09:29:59 (2704): No heartbeat from core client for 30 sec - exiting 09:30:00 (2704): No heartbeat from core client for 30 sec - exiting 09:30:01 (2704): No heartbeat from core client for 30 sec - exiting 09:30:02 (2704): No heartbeat from core client for 30 sec - exiting 09:30:03 (2704): No heartbeat from core client for 30 sec - exiting 09:30:04 (2704): No heartbeat from core client for 30 sec - exiting 09:30:05 (2704): No heartbeat from core client for 30 sec - exiting 09:30:06 (2704): No heartbeat from core client for 30 sec - exiting 09:30:07 (2704): No heartbeat from core client for 30 sec - exiting 09:30:08 (2704): No heartbeat from core client for 30 sec - exiting 09:30:09 (2704): No heartbeat from core client for 30 sec - exiting 09:30:10 (2704): No heartbeat from core client for 30 sec - exiting 09:30:11 (2704): No heartbeat from core client for 30 sec - exiting 09:30:12 (2704): No heartbeat from core client for 30 sec - exiting 09:30:13 (2704): No heartbeat from core client for 30 sec - exiting 09:30:14 (2704): No heartbeat from core client for 30 sec - exiting 09:30:15 (2704): No heartbeat from core client for 30 sec - exiting 09:30:16 (2704): No heartbeat from core client for 30 sec - exiting 09:30:17 (2704): No heartbeat from core client for 30 sec - exiting 09:30:18 (2704): No heartbeat from core client for 30 sec - exiting 09:30:19 (2704): No heartbeat from core client for 30 sec - exiting 09:30:20 (2704): No heartbeat from core client for 30 sec - exiting 09:30:21 (2704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:19:53 (5408): No heartbeat from core client for 30 sec - exiting 12:19:55 (5408): No heartbeat from core client for 30 sec - exiting 12:19:56 (5408): No heartbeat from core client for 30 sec - exiting 12:19:57 (5408): No heartbeat from core client for 30 sec - exiting 12:19:58 (5408): No heartbeat from core client for 30 sec - exiting 12:19:59 (5408): No heartbeat from core client for 30 sec - exiting 12:20:00 (5408): No heartbeat from core client for 30 sec - exiting 12:20:01 (5408): No heartbeat from core client for 30 sec - exiting 12:20:02 (5408): No heartbeat from core client for 30 sec - exiting 12:20:03 (5408): No heartbeat from core client for 30 sec - exiting 12:20:04 (5408): No heartbeat from core client for 30 sec - exiting 12:20:06 (5408): No heartbeat from core client for 30 sec - exiting 12:20:07 (5408): No heartbeat from core client for 30 sec - exiting 12:20:08 (5408): No heartbeat from core client for 30 sec - exiting 12:20:09 (5408): No heartbeat from core client for 30 sec - exiting 12:20:10 (5408): No heartbeat from core client for 30 sec - exiting 12:20:11 (5408): No heartbeat from core client for 30 sec - exiting 12:20:12 (5408): No heartbeat from core client for 30 sec - exiting 12:20:13 (5408): No heartbeat from core client for 30 sec - exiting 12:20:14 (5408): No heartbeat from core client for 30 sec - exiting 12:20:15 (5408): No heartbeat from core client for 30 sec - exiting 12:20:16 (5408): No heartbeat from core client for 30 sec - exiting 12:20:18 (5408): No heartbeat from core client for 30 sec - exiting 12:20:19 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:55 (600): No heartbeat from core client for 30 sec - exiting 08:59:56 (600): No heartbeat from core client for 30 sec - exiting 08:59:57 (600): No heartbeat from core client for 30 sec - exiting 08:59:58 (600): No heartbeat from core client for 30 sec - exiting 08:59:59 (600): No heartbeat from core client for 30 sec - exiting 09:00:00 (600): No heartbeat from core client for 30 sec - exiting 09:00:01 (600): No heartbeat from core client for 30 sec - exiting 09:00:02 (600): No heartbeat from core client for 30 sec - exiting 09:00:03 (600): No heartbeat from core client for 30 sec - exiting 09:00:04 (600): No heartbeat from core client for 30 sec - exiting 09:00:05 (600): No heartbeat from core client for 30 sec - exiting 09:00:06 (600): No heartbeat from core client for 30 sec - exiting 09:00:07 (600): No heartbeat from core client for 30 sec - exiting 09:00:08 (600): No heartbeat from core client for 30 sec - exiting 09:00:09 (600): No heartbeat from core client for 30 sec - exiting 09:00:10 (600): No heartbeat from core client for 30 sec - exiting 09:00:11 (600): No heartbeat from core client for 30 sec - exiting 09:00:12 (600): No heartbeat from core client for 30 sec - exiting 09:00:13 (600): No heartbeat from core client for 30 sec - exiting 09:00:14 (600): No heartbeat from core client for 30 sec - exiting 09:00:15 (600): No heartbeat from core client for 30 sec - exiting 09:00:16 (600): No heartbeat from core client for 30 sec - exiting 09:00:17 (600): No heartbeat from core client for 30 sec - exiting 09:00:18 (600): No heartbeat from core client for 30 sec - exiting 09:00:19 (600): No heartbeat from core client for 30 sec - exiting 09:00:20 (600): No heartbeat from core client for 30 sec - exiting 09:00:21 (600): No heartbeat from core client for 30 sec - exiting 09:00:22 (600): No heartbeat from core client for 30 sec - exiting 09:00:23 (600): No heartbeat from core client for 30 sec - exiting 09:00:24 (600): No heartbeat from core client for 30 sec - exiting 09:00:25 (600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4608, selfPID=4608, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2672, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2208, selfPID=4236, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4504, selfPID=4504, iMonCtr=2 CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4840, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4836, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2244, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4404, selfPID=5488, iMonCtr=1 Model crash detected, will try to restarCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24564, selfPID=24564, iMonCtr=2 11:26:50 (4880): No heartbeat from core client for 30 sec - exiting 11:26:51 (4880): No heartbeat from core client for 30 sec - exiting 11:26:52 (4880): No heartbeat from core client for 30 sec - exiting 11:26:53 (4880): No heartbeat from core client for 30 sec - exiting 11:26:54 (4880): No heartbeat from core client for 30 sec - exiting 11:26:55 (4880): No heartbeat from core client for 30 sec - exiting 11:26:56 (4880): No heartbeat from core client for 30 sec - exiting 11:26:57 (4880): No heartbeat from core client for 30 sec - exiting 11:26:58 (4880): No heartbeat from core client for 30 sec - exiting 11:26:59 (4880): No heartbeat from core client for 30 sec - exiting 11:27:00 (4880): No heartbeat from core client for 30 sec - exiting 11:27:01 (4880): No heartbeat from core client for 30 sec - exiting 11:27:02 (4880): No heartbeat from core client for 30 sec - exiting 11:27:03 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2620, selfPID=2620, iMonCtr=2 09:13:37 (5784): No heartbeat from core client for 30 sec - exiting 09:13:38 (5784): No heartbeat from core client for 30 sec - exiting 09:13:39 (5784): No heartbeat from core client for 30 sec - exiting 09:13:40 (5784): No heartbeat from core client for 30 sec - exiting 09:13:41 (5784): No heartbeat from core client for 30 sec - exiting 09:13:42 (5784): No heartbeat from core client for 30 sec - exiting 09:13:44 (5784): No heartbeat from core client for 30 sec - exiting 09:13:45 (5784): No heartbeat from core client for 30 sec - exiting 09:13:46 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:37:38 (4636): No heartbeat from core client for 30 sec - exiting 11:37:39 (4636): No heartbeat from core client for 30 sec - exiting 11:37:40 (4636): No heartbeat from core client for 30 sec - exiting 11:37:42 (4636): No heartbeat from core client for 30 sec - exiting 11:37:43 (4636): No heartbeat from core client for 30 sec - exiting 11:37:44 (4636): No heartbeat from core client for 30 sec - exiting 11:37:45 (4636): No heartbeat from core client for 30 sec - exiting 11:37:46 (4636): No heartbeat from core client for 30 sec - exiting 11:37:47 (4636): No heartbeat from core client for 30 sec - exiting 11:37:48 (4636): No heartbeat from core client for 30 sec - exiting 11:37:49 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:15:15 (4396): No heartbeat from core client for 30 sec - exiting 18:15:16 (4396): No heartbeat from core client for 30 sec - exiting 18:15:17 (4396): No heartbeat from core client for 30 sec - exiting 18:15:18 (4396): No heartbeat from core client for 30 sec - exiting 18:15:19 (4396): No heartbeat from core client for 30 sec - exiting 18:15:20 (4396): No heartbeat from core client for 30 sec - exiting 18:15:21 (4396): No heartbeat from core client for 30 sec - exiting 18:15:22 (4396): No heartbeat from core client for 30 sec - exiting 18:15:23 (4396): No heartbeat from core client for 30 sec - exiting 18:15:24 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:24:08 (6288): No heartbeat from core client for 30 sec - exiting 12:24:10 (6288): No heartbeat from core client for 30 sec - exiting 12:24:11 (6288): No heartbeat from core client for 30 sec - exiting 12:24:12 (6288): No heartbeat from core client for 30 sec - exiting 12:24:13 (6288): No heartbeat from core client for 30 sec - exiting 12:24:14 (6288): No heartbeat from core client for 30 sec - exiting 12:24:15 (6288): No heartbeat from core client for 30 sec - exiting 12:24:16 (6288): No heartbeat from core client for 30 sec - exiting 12:24:17 (6288): No heartbeat from core client for 30 sec - exiting 12:24:18 (6288): No heartbeat from core client for 30 sec - exiting 12:24:19 (6288): No heartbeat from core client for 30 sec - exiting 12:24:20 (6288): No heartbeat from core client for 30 sec - exiting 12:24:22 (6288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:23 (6288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4792, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2508, selfPID=1440, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f8bj_2013_1_009732731_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f8bj_2013_1_009732731_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f8bj_2013_1_009732731_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f8bj_2013_1_009732731_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f8bj_2013_1_009732731_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f8bj_2013_1_009732731_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f8bj_2013_1_009732731_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Jun 2015 14:55:25	1360388	18286369	hadam3p_anz_f8bj_2013_1_009732731_0	57,899	289,677	5.0031
14 Jun 2015 01:34:07	1360388	18286369	hadam3p_anz_f8bj_2013_1_009732731_0	46,379	231,555	4.9927
04 Jun 2015 13:17:28	1360388	18286369	hadam3p_anz_f8bj_2013_1_009732731_0	34,859	176,889	5.0744
29 May 2015 03:44:33	1360388	18286369	hadam3p_anz_f8bj_2013_1_009732731_0	23,339	121,304	5.1975
08 May 2015 19:27:09	1360388	18286369	hadam3p_anz_f8bj_2013_1_009732731_0	11,819	62,309	5.2719