Task 16466536

Name	hadam3p_anz_p2ic_2012_1_008633923_0
Workunit	8780435
Created	3 Apr 2014, 9:53:16 UTC
Sent	10 Apr 2014, 19:47:52 UTC
Report deadline	24 Mar 2015, 1:07:52 UTC
Received	20 Apr 2014, 8:33:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1324001
Run time	7 days 14 hours 8 min 29 sec
CPU time	7 days 13 hours 32 min 40 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	3.33 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> 04:27:03 (5572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:18:19 (4448): No heartbeat from core client for 30 sec - exiting 18:18:20 (4448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:24:53 (7028): No heartbeat from core client for 30 sec - exiting 12:24:54 (7028): No heartbeat from core client for 30 sec - exiting 12:24:55 (7028): No heartbeat from core client for 30 sec - exiting 12:24:56 (7028): No heartbeat from core client for 30 sec - exiting 12:24:57 (7028): No heartbeat from core client for 30 sec - exiting 12:24:58 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:16:14 (3908): No heartbeat from core client for 30 sec - exiting 15:16:15 (3908): No heartbeat from core client for 30 sec - exiting 15:16:16 (3908): No heartbeat from core client for 30 sec - exiting 15:16:17 (3908): No heartbeat from core client for 30 sec - exiting 15:16:18 (3908): No heartbeat from core client for 30 sec - exiting 15:16:19 (3908): No heartbeat from core client for 30 sec - exiting 15:16:21 (3908): No heartbeat from core client for 30 sec - exiting 15:16:22 (3908): No heartbeat from core client for 30 sec - exiting 15:16:23 (3908): No heartbeat from core client for 30 sec - exiting 15:16:24 (3908): No heartbeat from core client for 30 sec - exiting 15:16:25 (3908): No heartbeat from core client for 30 sec - exiting 15:16:26 (3908): No heartbeat from core client for 30 sec - exiting 15:16:27 (3908): No heartbeat from core client for 30 sec - exiting 15:16:28 (3908): No heartbeat from core client for 30 sec - exiting 15:16:29 (3908): No heartbeat from core client for 30 sec - exiting 15:16:30 (3908): No heartbeat from core client for 30 sec - exiting 15:16:31 (3908): No heartbeat from core client for 30 sec - exiting 15:16:33 (3908): No heartbeat from core client for 30 sec - exiting 15:16:34 (3908): No heartbeat from core client for 30 sec - exiting 15:16:35 (3908): No heartbeat from core client for 30 sec - exiting 15:16:36 (3908): No heartbeat from core client for 30 sec - exiting 15:16:37 (3908): No heartbeat from core client for 30 sec - exiting 15:16:38 (3908): No heartbeat from core client for 30 sec - exiting 15:16:39 (3908): No heartbeat from core client for 30 sec - exiting 15:16:40 (3908): No heartbeat from core client for 30 sec - exiting 15:16:41 (3908): No heartbeat from core client for 30 sec - exiting 15:16:42 (3908): No heartbeat from core client for 30 sec - exiting 15:16:44 (3908): No heartbeat from core client for 30 sec - exiting 15:16:45 (3908): No heartbeat from core client for 30 sec - exiting 15:16:46 (3908): No heartbeat from core client for 30 sec - exiting 15:16:47 (3908): No heartbeat from core client for 30 sec - exiting 15:16:48 (3908): No heartbeat from core client for 30 sec - exiting 15:16:49 (3908): No heartbeat from core client for 30 sec - exiting 15:16:50 (3908): No heartbeat from core client for 30 sec - exiting 15:16:51 (3908): No heartbeat from core client for 30 sec - exiting 15:16:52 (3908): No heartbeat from core client for 30 sec - exiting 15:16:53 (3908): No heartbeat from core client for 30 sec - exiting 15:16:54 (3908): No heartbeat from core client for 30 sec - exiting 15:16:56 (3908): No heartbeat from core client for 30 sec - exiting 15:16:57 (3908): No heartbeat from core client for 30 sec - exiting 15:16:58 (3908): No heartbeat from core client for 30 sec - exiting 15:16:59 (3908): No heartbeat from core client for 30 sec - exiting 15:17:00 (3908): No heartbeat from core client for 30 sec - exiting 15:17:01 (3908): No heartbeat from core client for 30 sec - exiting 15:17:02 (3908): No heartbeat from core client for 30 sec - exiting 15:17:03 (3908): No heartbeat from core client for 30 sec - exiting 15:17:04 (3908): No heartbeat from core client for 30 sec - exiting 15:17:05 (3908): No heartbeat from core client for 30 sec - exiting 15:17:06 (3908): No heartbeat from core client for 30 sec - exiting 15:17:08 (3908): No heartbeat from core client for 30 sec - exiting 15:17:09 (3908): No heartbeat from core client for 30 sec - exiting 15:17:10 (3908): No heartbeat from core client for 30 sec - exiting 15:17:11 (3908): No heartbeat from core client for 30 sec - exiting 15:17:12 (3908): No heartbeat from core client for 30 sec - exiting 15:17:13 (3908): No heartbeat from core client for 30 sec - exiting 15:17:14 (3908): No heartbeat from core client for 30 sec - exiting 15:17:15 (3908): No heartbeat from core client for 30 sec - exiting 15:17:16 (3908): No heartbeat from core client for 30 sec - exiting 15:17:17 (3908): No heartbeat from core client for 30 sec - exiting 15:17:19 (3908): No heartbeat from core client for 30 sec - exiting 15:17:20 (3908): No heartbeat from core client for 30 sec - exiting 15:17:21 (3908): No heartbeat from core client for 30 sec - exiting 15:17:22 (3908): No heartbeat from core client for 30 sec - exiting 15:17:23 (3908): No heartbeat from core client for 30 sec - exiting 15:17:24 (3908): No heartbeat from core client for 30 sec - exiting 15:17:25 (3908): No heartbeat from core client for 30 sec - exiting 15:17:26 (3908): No heartbeat from core client for 30 sec - exiting 15:17:27 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:28 (3908): No heartbeat from core client for 30 sec - exiting 15:17:29 (3908): No heartbeat from core client for 30 sec - exiting 15:17:31 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:34:23 (3092): No heartbeat from core client for 30 sec - exiting 15:34:24 (3092): No heartbeat from core client for 30 sec - exiting 15:34:25 (3092): No heartbeat from core client for 30 sec - exiting 15:34:26 (3092): No heartbeat from core client for 30 sec - exiting 15:34:27 (3092): No heartbeat from core client for 30 sec - exiting 15:34:28 (3092): No heartbeat from core client for 30 sec - exiting 15:34:29 (3092): No heartbeat from core client for 30 sec - exiting 15:34:30 (3092): No heartbeat from core client for 30 sec - exiting 15:34:31 (3092): No heartbeat from core client for 30 sec - exiting 15:34:32 (3092): No heartbeat from core client for 30 sec - exiting 15:34:33 (3092): No heartbeat from core client for 30 sec - exiting 15:34:35 (3092): No heartbeat from core client for 30 sec - exiting 15:34:36 (3092): No heartbeat from core client for 30 sec - exiting 15:34:37 (3092): No heartbeat from core client for 30 sec - exiting 15:34:38 (3092): No heartbeat from core client for 30 sec - exiting 15:34:39 (3092): No heartbeat from core client for 30 sec - exiting 15:34:40 (3092): No heartbeat from core client for 30 sec - exiting 15:34:41 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1868, selfPID=1868, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:05:28 (4816): No heartbeat from core client for 30 sec - exiting 18:05:29 (4816): No heartbeat from core client for 30 sec - exiting 18:05:30 (4816): No heartbeat from core client for 30 sec - exiting 18:05:32 (4816): No heartbeat from core client for 30 sec - exiting 18:05:33 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:28:48 (5892): No heartbeat from core client for 30 sec - exiting 18:28:49 (5892): No heartbeat from core client for 30 sec - exiting 18:28:50 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3700, selfPID=3700, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5064, selfPID=5064, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4560, selfPID=4560, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4204, selfPID=4204, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6700, selfPID=6700, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6696, selfPID=6696, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:47:08 (6936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:27:10 (7728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:27:11 (7728): No heartbeat from core client for 30 sec - exiting 15:27:13 (7728): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4704, selfPID=4704, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8672, selfPID=8672, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10152, selfPID=10152, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:53:16 (9868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5492, selfPID=0, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5492, selfPID=5492, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... 23:58:24 (9796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:25 (9796): No heartbeat from core client for 30 sec - exiting 23:58:27 (9796): No heartbeat from core client for 30 sec - exiting 23:58:28 (9796): No heartbeat from core client for 30 sec - exiting 23:58:29 (9796): No heartbeat from core client for 30 sec - exiting 23:58:30 (9796): No heartbeat from core client for 30 sec - exiting 23:58:31 (9796): No heartbeat from core client for 30 sec - exiting 00:08:24 (9028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:08:25 (9028): No heartbeat from core client for 30 sec - exiting 00:18:26 (6828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:28 (6828): No heartbeat from core client for 30 sec - exiting 00:18:29 (6828): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:28:26 (8360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:27 (8360): No heartbeat from core client for 30 sec - exiting 00:28:29 (8360): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:38:27 (9268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:38:28 (9268): No heartbeat from core client for 30 sec - exiting 00:38:30 (9268): No heartbeat from core client for 30 sec - exiting 00:38:31 (9268): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:48:29 (6724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:30 (6724): No heartbeat from core client for 30 sec - exiting 00:48:31 (6724): No heartbeat from core client for 30 sec - exiting 00:58:30 (9204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:31 (9204): No heartbeat from core client for 30 sec - exiting 00:58:32 (9204): No heartbeat from core client for 30 sec - exiting 00:59:45 (9284): No heartbeat from core client for 30 sec - exiting 00:59:46 (9284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:31 (6328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:32 (6328): No heartbeat from core client for 30 sec - exiting 01:08:33 (6328): No heartbeat from core client for 30 sec - exiting 01:08:34 (6328): No heartbeat from core client for 30 sec - exiting 01:10:00 (8940): No heartbeat from core client for 30 sec - exiting 01:10:01 (8940): No heartbeat from core client for 30 sec - exiting 01:10:02 (8940): No heartbeat from core client for 30 sec - exiting 01:10:03 (8940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:32 (9176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:33 (7844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:34 (7844): No heartbeat from core client for 30 sec - exiting 01:28:35 (7844): No heartbeat from core client for 30 sec - exiting 01:29:32 (9896): No heartbeat from core client for 30 sec - exiting 01:29:33 (9896): No heartbeat from core client for 30 sec - exiting 01:29:35 (9896): No heartbeat from core client for 30 sec - exiting 01:29:36 (9896): No heartbeat from core client for 30 sec - exiting 01:29:37 (9896): No heartbeat from core client for 30 sec - exiting 01:29:38 (9896): No heartbeat from core client for 30 sec - exiting 01:29:39 (9896): No heartbeat from core client for 30 sec - exiting 01:29:40 (9896): No heartbeat from core client for 30 sec - exiting 01:29:41 (9896): No heartbeat from core client for 30 sec - exiting 01:29:42 (9896): No heartbeat from core client for 30 sec - exiting 01:29:43 (9896): No heartbeat from core client for 30 sec - exiting 01:29:44 (9896): No heartbeat from core client for 30 sec - exiting 01:29:46 (9896): No heartbeat from core client for 30 sec - exiting 01:29:47 (9896): No heartbeat from core client for 30 sec - exiting 01:29:48 (9896): No heartbeat from core client for 30 sec - exiting 01:29:49 (9896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=10056, iMonCtr=1 Rontrollegional Worker:ssCPDN processning, et runni, bRetVal = 1, checkPID=619heckPelfPID=5336, iMonCtr=1 Model crash detected, will try to restart... 96, selfPID=6196, iMonCtr=2 Leaving CPDN_Main::Monitor... 03:37:46 (9276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:37:48 (9276): No heartbeat from core client for 30 sec - exiting 03:47:48 (7012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:47:49 (7012): No heartbeat from core client for 30 sec - exiting 03:47:50 (7012): No heartbeat from core client for 30 sec - exiting 03:49:19 (8200): No heartbeat from core client for 30 sec - exiting 03:49:20 (8200): No heartbeat from core client for 30 sec - exiting 03:49:21 (8200): No heartbeat from core client for 30 sec - exiting 03:49:22 (8200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:18:12 (6740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:18:14 (6740): No heartbeat from core client for 30 sec - exiting 04:18:15 (6740): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:35:26 (9024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:39:08 (9688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:14:14 (3056): No heartbeat from core client for 30 sec - exiting 14:14:15 (3056): No heartbeat from core client for 30 sec - exiting 14:14:16 (3056): No heartbeat from core client for 30 sec - exiting 14:14:17 (3056): No heartbeat from core client for 30 sec - exiting 14:14:18 (3056): No heartbeat from core client for 30 sec - exiting 14:14:20 (3056): No heartbeat from core client for 30 sec - exiting 14:14:21 (3056): No heartbeat from core client for 30 sec - exiting 14:14:22 (3056): No heartbeat from core client for 30 sec - exiting 14:14:23 (3056): No heartbeat from core client for 30 sec - exiting 14:14:24 (3056): No heartbeat from core client for 30 sec - exiting 14:14:25 (3056): No heartbeat from core client for 30 sec - exiting 14:14:26 (3056): No heartbeat from core client for 30 sec - exiting 14:14:27 (3056): No heartbeat from core client for 30 sec - exiting 14:14:28 (3056): No heartbeat from core client for 30 sec - exiting 14:14:29 (3056): No heartbeat from core client for 30 sec - exiting 14:14:30 (3056): No heartbeat from core client for 30 sec - exiting 14:14:32 (3056): No heartbeat from core client for 30 sec - exiting 14:14:33 (3056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2388, selfPID=2388, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2984, selfPID=2984, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:25:17 (2444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8048, selfPID=8048, iMonCtr=2 00:12:37 (6384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6440, selfPID=6440, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:31:47 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:46 (9256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:48 (9256): No heartbeat from core client for 30 sec - exiting 12:51:58 (9952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:00 (8264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:04:01 (9728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:03 (9040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:04 (9040): No heartbeat from core client for 30 sec - exiting 13:24:04 (8784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:05 (8784): No heartbeat from core client for 30 sec - exiting 13:34:05 (7216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:06 (7216): No heartbeat from core client for 30 sec - exiting 13:44:06 (8356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:44:08 (8356): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 13:59:08 (8636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:09 (8636): No heartbeat from core client for 30 sec - exiting 14:09:09 (8920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:09:10 (8920): No heartbeat from core client for 30 sec - exiting 15:04:13 (7340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:04:15 (7340): No heartbeat from core client for 30 sec - exiting 15:12:29 (10088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:14:29 (10176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:14:31 (10176): No heartbeat from core client for 30 sec - exiting 15:14:32 (10176): No heartbeat from core client for 30 sec - exiting 15:14:33 (10176): No heartbeat from core client for 30 sec - exiting 15:15:28 (8728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7384, selfPID=7384, iMonCtr=2 15:24:30 (8012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:24:31 (8012): No heartbeat from core client for 30 sec - exiting 15:24:32 (8012): No heartbeat from core client for 30 sec - exiting 15:26:20 (9720): No heartbeat from core client for 30 sec - exiting 15:26:21 (9720): No heartbeat from core client for 30 sec - exiting 15:26:22 (9720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:30:20 (3076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=8508, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3128, selfPID=8208, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_p2ic_2012_1_008633923_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_p2ic_2012_1_008633923_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2014 04:32:24	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	115,499	651,838	5.6437
19 Apr 2014 11:35:38	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	103,979	591,170	5.6855
18 Apr 2014 08:36:59	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	92,459	531,711	5.7508
17 Apr 2014 16:10:30	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	80,939	472,928	5.8430
16 Apr 2014 05:45:04	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	69,419	408,953	5.8911
15 Apr 2014 04:08:12	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	57,899	344,828	5.9557
14 Apr 2014 06:45:04	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	46,379	280,950	6.0577
13 Apr 2014 11:46:46	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	34,859	214,676	6.1584
12 Apr 2014 16:52:35	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	23,339	147,058	6.3010
11 Apr 2014 21:43:11	1324001	16466536	hadam3p_anz_p2ic_2012_1_008633923_0	11,819	78,162	6.6132