Task 16403388

Name	hadam3p_anz_nb91_2012_1_008588269_0
Workunit	8734781
Created	25 Mar 2014, 20:09:40 UTC
Sent	25 Mar 2014, 21:31:35 UTC
Report deadline	8 Mar 2015, 2:51:35 UTC
Received	7 Apr 2014, 1:14:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1315213
Run time	4 days 17 hours 58 min 18 sec
CPU time	4 days 9 hours 10 min 43 sec
Validate state	Invalid
Credit	1,006.54
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> 21:04:20 (5740): No heartbeat from core client for 30 sec - exiting 21:04:21 (5740): No heartbeat from core client for 30 sec - exiting 21:06:12 (5740): No heartbeat from core client for 30 sec - exiting 21:06:13 (5740): No heartbeat from core client for 30 sec - exiting 21:06:14 (5740): No heartbeat from core client for 30 sec - exiting 21:06:15 (5740): No heartbeat from core client for 30 sec - exiting 21:06:16 (5740): No heartbeat from core client for 30 sec - exiting 21:06:17 (5740): No heartbeat from core client for 30 sec - exiting 21:06:18 (5740): No heartbeat from core client for 30 sec - exiting 21:06:19 (5740): No heartbeat from core client for 30 sec - exiting 21:06:20 (5740): No heartbeat from core client for 30 sec - exiting 21:06:21 (5740): No heartbeat from core client for 30 sec - exiting 21:06:22 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:46:05 (6088): No heartbeat from core client for 30 sec - exiting 10:46:08 (6088): No heartbeat from core client for 30 sec - exiting 10:46:09 (6088): No heartbeat from core client for 30 sec - exiting 10:46:10 (6088): No heartbeat from core client for 30 sec - exiting 10:46:11 (6088): No heartbeat from core client for 30 sec - exiting 10:46:12 (6088): No heartbeat from core client for 30 sec - exiting 10:46:13 (6088): No heartbeat from core client for 30 sec - exiting 10:46:14 (6088): No heartbeat from core client for 30 sec - exiting 10:46:15 (6088): No heartbeat from core client for 30 sec - exiting 10:46:16 (6088): No heartbeat from core client for 30 sec - exiting 10:46:17 (6088): No heartbeat from core client for 30 sec - exiting 10:46:18 (6088): No heartbeat from core client for 30 sec - exiting 10:46:19 (6088): No heartbeat from core client for 30 sec - exiting 10:46:20 (6088): No heartbeat from core client for 30 sec - exiting 10:46:21 (6088): No heartbeat from core client for 30 sec - exiting 10:46:22 (6088): No heartbeat from core client for 30 sec - exiting 10:46:23 (6088): No heartbeat from core client for 30 sec - exiting 10:46:24 (6088): No heartbeat from core client for 30 sec - exiting 10:46:25 (6088): No heartbeat from core client for 30 sec - exiting 10:46:26 (6088): No heartbeat from core client for 30 sec - exiting 10:46:27 (6088): No heartbeat from core client for 30 sec - exiting 10:46:28 (6088): No heartbeat from core client for 30 sec - exiting 10:46:29 (6088): No heartbeat from core client for 30 sec - exiting 10:46:30 (6088): No heartbeat from core client for 30 sec - exiting 10:46:31 (6088): No heartbeat from core client for 30 sec - exiting 10:46:32 (6088): No heartbeat from core client for 30 sec - exiting 10:46:33 (6088): No heartbeat from core client for 30 sec - exiting 10:46:34 (6088): No heartbeat from core client for 30 sec - exiting 10:46:35 (6088): No heartbeat from core client for 30 sec - exiting 10:46:36 (6088): No heartbeat from core client for 30 sec - exiting 10:46:37 (6088): No heartbeat from core client for 30 sec - exiting 10:46:38 (6088): No heartbeat from core client for 30 sec - exiting 10:46:39 (6088): No heartbeat from core client for 30 sec - exiting 10:46:40 (6088): No heartbeat from core client for 30 sec - exiting 10:46:41 (6088): No heartbeat from core client for 30 sec - exiting 10:46:42 (6088): No heartbeat from core client for 30 sec - exiting 10:46:43 (6088): No heartbeat from core client for 30 sec - exiting 10:46:44 (6088): No heartbeat from core client for 30 sec - exiting 10:46:45 (6088): No heartbeat from core client for 30 sec - exiting 10:46:46 (6088): No heartbeat from core client for 30 sec - exiting 10:46:47 (6088): No heartbeat from core client for 30 sec - exiting 10:46:48 (6088): No heartbeat from core client for 30 sec - exiting 10:46:49 (6088): No heartbeat from core client for 30 sec - exiting 10:46:50 (6088): No heartbeat from core client for 30 sec - exiting 10:46:51 (6088): No heartbeat from core client for 30 sec - exiting 10:46:52 (6088): No heartbeat from core client for 30 sec - exiting 10:46:53 (6088): No heartbeat from core client for 30 sec - exiting 10:46:54 (6088): No heartbeat from core client for 30 sec - exiting 10:46:55 (6088): No heartbeat from core client for 30 sec - exiting 10:46:56 (6088): No heartbeat from core client for 30 sec - exiting 10:46:57 (6088): No heartbeat from core client for 30 sec - exiting 10:46:58 (6088): No heartbeat from core client for 30 sec - exiting 10:46:59 (6088): No heartbeat from core client for 30 sec - exiting 10:47:00 (6088): No heartbeat from core client for 30 sec - exiting 10:47:01 (6088): No heartbeat from core client for 30 sec - exiting 10:47:02 (6088): No heartbeat from core client for 30 sec - exiting 10:47:03 (6088): No heartbeat from core client for 30 sec - exiting 10:47:04 (6088): No heartbeat from core client for 30 sec - exiting 10:47:05 (6088): No heartbeat from core client for 30 sec - exiting 10:47:06 (6088): No heartbeat from core client for 30 sec - exiting 10:47:07 (6088): No heartbeat from core client for 30 sec - exiting 10:47:08 (6088): No heartbeat from core client for 30 sec - exiting 10:47:09 (6088): No heartbeat from core client for 30 sec - exiting 10:47:10 (6088): No heartbeat from core client for 30 sec - exiting 10:47:11 (6088): No heartbeat from core client for 30 sec - exiting 10:47:12 (6088): No heartbeat from core client for 30 sec - exiting 10:47:13 (6088): No heartbeat from core client for 30 sec - exiting 10:47:14 (6088): No heartbeat from core client for 30 sec - exiting 10:47:15 (6088): No heartbeat from core client for 30 sec - exiting 10:47:16 (6088): No heartbeat from core client for 30 sec - exiting 10:47:17 (6088): No heartbeat from core client for 30 sec - exiting 10:47:18 (6088): No heartbeat from core client for 30 sec - exiting 10:47:19 (6088): No heartbeat from core client for 30 sec - exiting 10:48:11 (6088): No heartbeat from core client for 30 sec - exiting 10:48:12 (6088): No heartbeat from core client for 30 sec - exiting 10:48:13 (6088): No heartbeat from core client for 30 sec - exiting 10:48:14 (6088): No heartbeat from core client for 30 sec - exiting 10:48:15 (6088): No heartbeat from core client for 30 sec - exiting 10:48:16 (6088): No heartbeat from core client for 30 sec - exiting 10:48:17 (6088): No heartbeat from core client for 30 sec - exiting 10:48:18 (6088): No heartbeat from core client for 30 sec - exiting 10:48:19 (6088): No heartbeat from core client for 30 sec - exiting 10:48:20 (6088): No heartbeat from core client for 30 sec - exiting 10:48:21 (6088): No heartbeat from core client for 30 sec - exiting 10:48:22 (6088): No heartbeat from core client for 30 sec - exiting 10:48:23 (6088): No heartbeat from core client for 30 sec - exiting 10:48:24 (6088): No heartbeat from core client for 30 sec - exiting 10:48:25 (6088): No heartbeat from core client for 30 sec - exiting 10:48:26 (6088): No heartbeat from core client for 30 sec - exiting 10:48:27 (6088): No heartbeat from core client for 30 sec - exiting 10:48:28 (6088): No heartbeat from core client for 30 sec - exiting 10:48:29 (6088): No heartbeat from core client for 30 sec - exiting 10:48:30 (6088): No heartbeat from core client for 30 sec - exiting 10:48:31 (6088): No heartbeat from core client for 30 sec - exiting 10:48:32 (6088): No heartbeat from core client for 30 sec - exiting 10:48:33 (6088): No heartbeat from core client for 30 sec - exiting 10:48:34 (6088): No heartbeat from core client for 30 sec - exiting 10:48:35 (6088): No heartbeat from core client for 30 sec - exiting 10:48:36 (6088): No heartbeat from core client for 30 sec - exiting 10:48:37 (6088): No heartbeat from core client for 30 sec - exiting 10:48:38 (6088): No heartbeat from core client for 30 sec - exiting 10:48:39 (6088): No heartbeat from core client for 30 sec - exiting 10:48:40 (6088): No heartbeat from core client for 30 sec - exiting 10:48:41 (6088): No heartbeat from core client for 30 sec - exiting 10:48:42 (6088): No heartbeat from core client for 30 sec - exiting 10:48:43 (6088): No heartbeat from core client for 30 sec - exiting 10:48:44 (6088): No heartbeat from core client for 30 sec - exiting 10:48:45 (6088): No heartbeat from core client for 30 sec - exiting 10:48:46 (6088): No heartbeat from core client for 30 sec - exiting 10:48:47 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7868, selfPID=5532, iMonCtr=1 Model crash detected, will try to restart... 11:19:05 (7612): No heartbeat from core client for 30 sec - exiting 11:19:06 (7612): No heartbeat from core client for 30 sec - exiting 11:19:07 (7612): No heartbeat from core client for 30 sec - exiting 11:19:08 (7612): No heartbeat from core client for 30 sec - exiting 11:19:09 (7612): No heartbeat from core client for 30 sec - exiting 11:19:10 (7612): No heartbeat from core client for 30 sec - exiting 11:19:11 (7612): No heartbeat from core client for 30 sec - exiting 11:19:58 (7612): No heartbeat from core client for 30 sec - exiting 11:19:59 (7612): No heartbeat from core client for 30 sec - exiting 11:20:00 (7612): No heartbeat from core client for 30 sec - exiting 11:20:01 (7612): No heartbeat from core client for 30 sec - exiting 11:20:02 (7612): No heartbeat from core client for 30 sec - exiting 11:20:03 (7612): No heartbeat from core client for 30 sec - exiting 11:20:04 (7612): No heartbeat from core client for 30 sec - exiting 11:20:05 (7612): No heartbeat from core client for 30 sec - exiting 11:20:06 (7612): No heartbeat from core client for 30 sec - exiting 11:20:07 (7612): No heartbeat from core client for 30 sec - exiting 11:20:08 (7612): No heartbeat from core client for 30 sec - exiting 11:20:09 (7612): No heartbeat from core client for 30 sec - exiting 11:20:10 (7612): No heartbeat from core client for 30 sec - exiting 11:20:11 (7612): No heartbeat from core client for 30 sec - exiting 11:20:12 (7612): No heartbeat from core client for 30 sec - exiting 11:20:13 (7612): No heartbeat from core client for 30 sec - exiting 11:20:14 (7612): No heartbeat from core client for 30 sec - exiting 11:20:15 (7612): No heartbeat from core client for 30 sec - exiting 11:20:16 (7612): No heartbeat from core client for 30 sec - exiting 11:20:17 (7612): No heartbeat from core client for 30 sec - exiting 11:20:18 (7612): No heartbeat from core client for 30 sec - exiting 11:20:19 (7612): No heartbeat from core client for 30 sec - exiting 11:20:20 (7612): No heartbeat from core client for 30 sec - exiting 11:20:21 (7612): No heartbeat from core client for 30 sec - exiting 11:20:22 (7612): No heartbeat from core client for 30 sec - exiting 11:20:23 (7612): No heartbeat from core client for 30 sec - exiting 11:20:24 (7612): No heartbeat from core client for 30 sec - exiting 11:20:25 (7612): No heartbeat from core client for 30 sec - exiting 11:20:26 (7612): No heartbeat from core client for 30 sec - exiting 11:20:27 (7612): No heartbeat from core client for 30 sec - exiting 11:20:28 (7612): No heartbeat from core client for 30 sec - exiting 11:20:29 (7612): No heartbeat from core client for 30 sec - exiting 11:20:30 (7612): No heartbeat from core client for 30 sec - exiting 11:20:31 (7612): No heartbeat from core client for 30 sec - exiting 11:20:32 (7612): No heartbeat from core client for 30 sec - exiting 11:20:33 (7612): No heartbeat from core client for 30 sec - exiting 11:20:34 (7612): No heartbeat from core client for 30 sec - exiting 11:20:35 (7612): No heartbeat from core client for 30 sec - exiting 11:20:36 (7612): No heartbeat from core client for 30 sec - exiting 11:20:37 (7612): No heartbeat from core client for 30 sec - exiting 11:20:38 (7612): No heartbeat from core client for 30 sec - exiting 11:20:39 (7612): No heartbeat from core client for 30 sec - exiting 11:20:40 (7612): No heartbeat from core client for 30 sec - exiting 11:20:41 (7612): No heartbeat from core client for 30 sec - exiting 11:20:42 (7612): No heartbeat from core client for 30 sec - exiting 11:20:43 (7612): No heartbeat from core client for 30 sec - exiting 11:20:44 (7612): No heartbeat from core client for 30 sec - exiting 11:20:45 (7612): No heartbeat from core client for 30 sec - exiting 11:20:46 (7612): No heartbeat from core client for 30 sec - exiting 11:20:47 (7612): No heartbeat from core client for 30 sec - exiting 11:20:48 (7612): No heartbeat from core client for 30 sec - exiting 11:20:49 (7612): No heartbeat from core client for 30 sec - exiting 11:20:50 (7612): No heartbeat from core client for 30 sec - exiting 11:20:51 (7612): No heartbeat from core client for 30 sec - exiting 11:20:52 (7612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:47:29 (5576): No heartbeat from core client for 30 sec - exiting 09:47:30 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:23:40 (7356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:51 (1212): No heartbeat from core client for 30 sec - exiting 20:24:52 (1212): No heartbeat from core client for 30 sec - exiting 20:24:53 (1212): No heartbeat from core client for 30 sec - exiting 20:24:54 (1212): No heartbeat from core client for 30 sec - exiting 20:24:55 (1212): No heartbeat from core client for 30 sec - exiting 20:24:56 (1212): No heartbeat from core client for 30 sec - exiting 20:24:57 (1212): No heartbeat from core client for 30 sec - exiting 20:24:58 (1212): No heartbeat from core client for 30 sec - exiting 20:24:59 (1212): No heartbeat from core client for 30 sec - exiting 20:25:00 (1212): No heartbeat from core client for 30 sec - exiting 20:25:01 (1212): No heartbeat from core client for 30 sec - exiting 20:25:02 (1212): No heartbeat from core client for 30 sec - exiting 20:25:03 (1212): No heartbeat from core client for 30 sec - exiting 20:25:04 (1212): No heartbeat from core client for 30 sec - exiting 20:25:05 (1212): No heartbeat from core client for 30 sec - exiting 20:25:06 (1212): No heartbeat from core client for 30 sec - exiting 20:25:07 (1212): No heartbeat from core client for 30 sec - exiting 20:25:08 (1212): No heartbeat from core client for 30 sec - exiting 20:25:09 (1212): No heartbeat from core client for 30 sec - exiting 20:25:10 (1212): No heartbeat from core client for 30 sec - exiting 20:25:11 (1212): No heartbeat from core client for 30 sec - exiting 20:25:12 (1212): No heartbeat from core client for 30 sec - exiting 20:25:13 (1212): No heartbeat from core client for 30 sec - exiting 20:25:14 (1212): No heartbeat from core client for 30 sec - exiting 20:25:15 (1212): No heartbeat from core client for 30 sec - exiting 20:25:16 (1212): No heartbeat from core client for 30 sec - exiting 20:25:17 (1212): No heartbeat from core client for 30 sec - exiting 20:25:18 (1212): No heartbeat from core client for 30 sec - exiting 20:25:19 (1212): No heartbeat from core client for 30 sec - exiting 20:25:20 (1212): No heartbeat from core client for 30 sec - exiting 07:14:03 (3200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:35:50 (2984): No heartbeat from core client for 30 sec - exiting 12:35:51 (2984): No heartbeat from core client for 30 sec - exiting 12:35:52 (2984): No heartbeat from core client for 30 sec - exiting 12:35:53 (2984): No heartbeat from core client for 30 sec - exiting 12:35:54 (2984): No heartbeat from core client for 30 sec - exiting 12:35:55 (2984): No heartbeat from core client for 30 sec - exiting 12:35:56 (2984): No heartbeat from core client for 30 sec - exiting 12:35:57 (2984): No heartbeat from core client for 30 sec - exiting 12:35:58 (2984): No heartbeat from core client for 30 sec - exiting 12:35:59 (2984): No heartbeat from core client for 30 sec - exiting 12:36:00 (2984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:09:44 (6356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:45 (6356): No heartbeat from core client for 30 sec - exiting 20:09:46 (6356): No heartbeat from core client for 30 sec - exiting 20:09:47 (6356): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=8048, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9120, selfPID=1420, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 20:10:28 (1420): No heartbeat from core client for 30 sec - exiting 20:10:29 (1420): No heartbeat from core client for 30 sec - exiting 20:10:30 (1420): No heartbeat from core client for 30 sec - exiting 20:10:31 (1420): No heartbeat from core client for 30 sec - exiting 20:10:32 (1420): No heartbeat from core client for 30 sec - exiting 20:10:33 (1420): No heartbeat from core client for 30 sec - exiting 20:10:34 (1420): No heartbeat from core client for 30 sec - exiting 20:10:35 (1420): No heartbeat from core client for 30 sec - exiting 20:10:36 (1420): No heartbeat from core client for 30 sec - exiting 20:10:37 (1420): No heartbeat from core client for 30 sec - exiting 20:10:38 (1420): No heartbeat from core client for 30 sec - exiting 20:10:39 (1420): No heartbeat from core client for 30 sec - exiting 20:10:40 (1420): No heartbeat from core client for 30 sec - exiting 20:10:41 (1420): No heartbeat from core client for 30 sec - exiting 20:10:42 (1420): No heartbeat from core client for 30 sec - exiting 20:10:43 (1420): No heartbeat from core client for 30 sec - exiting 20:10:44 (1420): No heartbeat from core client for 30 sec - exiting 20:10:45 (1420): No heartbeat from core client for 30 sec - exiting 20:10:46 (1420): No heartbeat from core client for 30 sec - exiting 20:10:47 (1420): No heartbeat from core client for 30 sec - exiting 20:10:48 (1420): No heartbeat from core client for 30 sec - exiting 20:10:49 (1420): No heartbeat from core client for 30 sec - exiting 20:10:50 (1420): No heartbeat from core client for 30 sec - exiting 20:10:51 (1420): No heartbeat from core client for 30 sec - exiting 20:10:52 (1420): No heartbeat from core client for 30 sec - exiting 20:10:53 (1420): No heartbeat from core client for 30 sec - exiting 20:10:54 (1420): No heartbeat from core client for 30 sec - exiting 20:10:55 (1420): No heartbeat from core client for 30 sec - exiting 20:10:56 (1420): No heartbeat from core client for 30 sec - exiting 20:10:57 (1420): No heartbeat from core client for 30 sec - exiting 20:10:58 (1420): No heartbeat from core client for 30 sec - exiting 20:10:59 (1420): No heartbeat from core client for 30 sec - exiting 20:11:00 (1420): No heartbeat from core client for 30 sec - exiting 20:11:01 (1420): No heartbeat from core client for 30 sec - exiting 20:11:02 (1420): No heartbeat from core client for 30 sec - exiting 20:11:03 (1420): No heartbeat from core client for 30 sec - exiting 20:11:04 (1420): No heartbeat from core client for 30 sec - exiting 20:11:05 (1420): No heartbeat from core client for 30 sec - exiting 20:11:06 (1420): No heartbeat from core client for 30 sec - exiting 20:11:07 (1420): No heartbeat from core client for 30 sec - exiting 20:11:08 (1420): No heartbeat from core client for 30 sec - exiting 20:11:09 (1420): No heartbeat from core client for 30 sec - exiting 20:11:10 (1420): No heartbeat from core client for 30 sec - exiting 20:11:11 (1420): No heartbeat from core client for 30 sec - exiting 20:11:12 (1420): No heartbeat from core client for 30 sec - exiting 20:11:13 (1420): No heartbeat from core client for 30 sec - exiting 20:11:14 (1420): No heartbeat from core client for 30 sec - exiting 20:11:15 (1420): No heartbeat from core client for 30 sec - exiting 20:11:16 (1420): No heartbeat from core client for 30 sec - exiting Called boinc_finish 20:11:18 (1420): No heartbeat from core client for 30 sec - exiting 20:11:19 (1420): No heartbeat from core client for 30 sec - exiting </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nb91_2012_1_008588269_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Apr 2014 22:32:49	1315213	16403388	hadam3p_anz_nb91_2012_1_008588269_0	23,339	272,349	11.6693
30 Mar 2014 03:36:12	1315213	16403388	hadam3p_anz_nb91_2012_1_008588269_0	11,819	132,472	11.2084