Task 16618917

Name	hadam3p_anz_r4ga_2012_1_008735384_0
Workunit	8881362
Created	8 May 2014, 18:45:59 UTC
Sent	18 May 2014, 4:13:01 UTC
Report deadline	30 Apr 2015, 9:33:01 UTC
Received	24 May 2014, 16:22:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1328141
Run time	2 days 22 hours 45 min 52 sec
CPU time	2 days 15 hours 7 min 47 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	3.96 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>6.8.44</core_client_version> <![CDATA[ <stderr_txt> 22:15:42 (2348): No heartbeat from core client for 30 sec - exiting 22:15:43 (2348): No heartbeat from core client for 30 sec - exiting 22:15:44 (2348): No heartbeat from core client for 30 sec - exiting 22:15:45 (2348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3376, selfPID=3376, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7768, selfPID=7768, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:05:01 (7172): No heartbeat from core client for 30 sec - exiting 14:05:02 (7172): No heartbeat from core client for 30 sec - exiting 14:05:03 (7172): No heartbeat from core client for 30 sec - exiting 14:05:04 (7172): No heartbeat from core client for 30 sec - exiting 14:05:05 (7172): No heartbeat from core client for 30 sec - exiting 14:05:06 (7172): No heartbeat from core client for 30 sec - exiting 14:05:07 (7172): No heartbeat from core client for 30 sec - exiting 14:05:08 (7172): No heartbeat from core client for 30 sec - exiting 14:05:09 (7172): No heartbeat from core client for 30 sec - exiting 14:05:10 (7172): No heartbeat from core client for 30 sec - exiting 14:05:11 (7172): No heartbeat from core client for 30 sec - exiting 14:05:12 (7172): No heartbeat from core client for 30 sec - exiting 14:05:13 (7172): No heartbeat from core client for 30 sec - exiting 14:05:14 (7172): No heartbeat from core client for 30 sec - exiting 14:05:15 (7172): No heartbeat from core client for 30 sec - exiting 14:05:16 (7172): No heartbeat from core client for 30 sec - exiting 14:05:17 (7172): No heartbeat from core client for 30 sec - exiting 14:05:18 (7172): No heartbeat from core client for 30 sec - exiting 14:05:19 (7172): No heartbeat from core client for 30 sec - exiting 14:05:20 (7172): No heartbeat from core client for 30 sec - exiting 14:05:21 (7172): No heartbeat from core client for 30 sec - exiting 14:05:22 (7172): No heartbeat from core client for 30 sec - exiting 14:05:23 (7172): No heartbeat from core client for 30 sec - exiting 14:05:24 (7172): No heartbeat from core client for 30 sec - exiting 14:05:25 (7172): No heartbeat from core client for 30 sec - exiting 14:05:26 (7172): No heartbeat from core client for 30 sec - exiting 14:05:27 (7172): No heartbeat from core client for 30 sec - exiting 14:05:28 (7172): No heartbeat from core client for 30 sec - exiting 14:05:29 (7172): No heartbeat from core client for 30 sec - exiting 14:05:30 (7172): No heartbeat from core client for 30 sec - exiting 14:05:31 (7172): No heartbeat from core client for 30 sec - exiting 14:05:32 (7172): No heartbeat from core client for 30 sec - exiting 14:05:33 (7172): No heartbeat from core client for 30 sec - exiting 14:05:34 (7172): No heartbeat from core client for 30 sec - exiting 14:05:35 (7172): No heartbeat from core client for 30 sec - exiting 14:05:36 (7172): No heartbeat from core client for 30 sec - exiting 14:05:37 (7172): No heartbeat from core client for 30 sec - exiting 14:05:38 (7172): No heartbeat from core client for 30 sec - exiting 14:05:39 (7172): No heartbeat from core client for 30 sec - exiting 14:05:40 (8668): Can't acquire lockfile (32) - waiting 35s 14:05:40 (7172): No heartbeat from core client for 30 sec - exiting 14:05:41 (7172): No heartbeat from core client for 30 sec - exiting 14:05:42 (7172): No heartbeat from core client for 30 sec - exiting 14:05:43 (7172): No heartbeat from core client for 30 sec - exiting 14:05:44 (7172): No heartbeat from core client for 30 sec - exiting 14:05:45 (7172): No heartbeat from core client for 30 sec - exiting 14:05:46 (7172): No heartbeat from core client for 30 sec - exiting 14:05:47 (7172): No heartbeat from core client for 30 sec - exiting 14:05:48 (7172): No heartbeat from core client for 30 sec - exiting 14:05:49 (7172): No heartbeat from core client for 30 sec - exiting 14:05:50 (7172): No heartbeat from core client for 30 sec - exiting 14:05:51 (7172): No heartbeat from core client for 30 sec - exiting 14:05:52 (7172): No heartbeat from core client for 30 sec - exiting 14:05:53 (7172): No heartbeat from core client for 30 sec - exiting 14:05:55 (7172): No heartbeat from core client for 30 sec - exiting 14:05:56 (7172): No heartbeat from core client for 30 sec - exiting 14:05:57 (7172): No heartbeat from core client for 30 sec - exiting 14:05:58 (7172): No heartbeat from core client for 30 sec - exiting 14:05:59 (7172): No heartbeat from core client for 30 sec - exiting 14:06:00 (7172): No heartbeat from core client for 30 sec - exiting 14:06:01 (7172): No heartbeat from core client for 30 sec - exiting 14:06:02 (7172): No heartbeat from core client for 30 sec - exiting 14:06:03 (7172): No heartbeat from core client for 30 sec - exiting 14:06:04 (7172): No heartbeat from core client for 30 sec - exiting 14:06:05 (7172): No heartbeat from core client for 30 sec - exiting 14:06:06 (7172): No heartbeat from core client for 30 sec - exiting 14:06:07 (7172): No heartbeat from core client for 30 sec - exiting 14:06:08 (7172): No heartbeat from core client for 30 sec - exiting 14:06:09 (7172): No heartbeat from core client for 30 sec - exiting 14:06:10 (7172): No heartbeat from core client for 30 sec - exiting 14:06:11 (7172): No heartbeat from core client for 30 sec - exiting 14:06:12 (7172): No heartbeat from core client for 30 sec - exiting 14:06:13 (7172): No heartbeat from core client for 30 sec - exiting 14:06:14 (7172): No heartbeat from core client for 30 sec - exiting 14:06:15 (7172): No heartbeat from core client for 30 sec - exiting 14:06:15 (8668): Can't acquire lockfile (32) - exiting 14:06:15 (8668): Error: The process cannot access the file because it is being used by another process. (0x20) 14:06:16 (8472): Can't acquire lockfile (32) - waiting 35s 14:06:16 (7172): No heartbeat from core client for 30 sec - exiting 14:06:17 (7172): No heartbeat from core client for 30 sec - exiting 14:06:18 (7172): No heartbeat from core client for 30 sec - exiting 14:06:19 (7172): No heartbeat from core client for 30 sec - exiting 14:06:20 (7172): No heartbeat from core client for 30 sec - exiting 14:06:21 (7172): No heartbeat from core client for 30 sec - exiting 14:06:22 (7172): No heartbeat from core client for 30 sec - exiting 14:06:23 (7172): No heartbeat from core client for 30 sec - exiting 14:06:24 (7172): No heartbeat from core client for 30 sec - exiting 14:06:25 (7172): No heartbeat from core client for 30 sec - exiting 14:06:26 (7172): No heartbeat from core client for 30 sec - exiting 14:06:27 (7172): No heartbeat from core client for 30 sec - exiting 14:06:28 (7172): No heartbeat from core client for 30 sec - exiting 14:06:29 (7172): No heartbeat from core client for 30 sec - exiting 14:06:30 (7172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:38:00 (4700): No heartbeat from core client for 30 sec - exiting 14:38:01 (4700): No heartbeat from core client for 30 sec - exiting 14:38:02 (4700): No heartbeat from core client for 30 sec - exiting 14:38:03 (4700): No heartbeat from core client for 30 sec - exiting 14:38:04 (4700): No heartbeat from core client for 30 sec - exiting 14:38:05 (4700): No heartbeat from core client for 30 sec - exiting 14:38:06 (4700): No heartbeat from core client for 30 sec - exiting 14:38:07 (4700): No heartbeat from core client for 30 sec - exiting 14:38:08 (4700): No heartbeat from core client for 30 sec - exiting 14:38:09 (4700): No heartbeat from core client for 30 sec - exiting 14:38:10 (4700): No heartbeat from core client for 30 sec - exiting 14:38:11 (4700): No heartbeat from core client for 30 sec - exiting 14:38:12 (4700): No heartbeat from core client for 30 sec - exiting 14:38:13 (4700): No heartbeat from core client for 30 sec - exiting 14:38:14 (4700): No heartbeat from core client for 30 sec - exiting 14:38:15 (4700): No heartbeat from core client for 30 sec - exiting 14:38:16 (4700): No heartbeat from core client for 30 sec - exiting 14:38:17 (4700): No heartbeat from core client for 30 sec - exiting 14:38:18 (4700): No heartbeat from core client for 30 sec - exiting 14:38:19 (4700): No heartbeat from core client for 30 sec - exiting 14:38:20 (4700): No heartbeat from core client for 30 sec - exiting 14:38:21 (4700): No heartbeat from core client for 30 sec - exiting 14:38:22 (4700): No heartbeat from core client for 30 sec - exiting 14:38:23 (4700): No heartbeat from core client for 30 sec - exiting 14:38:24 (4700): No heartbeat from core client for 30 sec - exiting 14:38:25 (4700): No heartbeat from core client for 30 sec - exiting 14:38:26 (4700): No heartbeat from core client for 30 sec - exiting 14:38:27 (4700): No heartbeat from core client for 30 sec - exiting 14:38:28 (4700): No heartbeat from core client for 30 sec - exiting 14:38:29 (4700): No heartbeat from core client for 30 sec - exiting 14:38:30 (4700): No heartbeat from core client for 30 sec - exiting 14:38:31 (4700): No heartbeat from core client for 30 sec - exiting 14:38:32 (4700): No heartbeat from core client for 30 sec - exiting 14:38:33 (4700): No heartbeat from core client for 30 sec - exiting 14:38:34 (4700): No heartbeat from core client for 30 sec - exiting 14:38:35 (4700): No heartbeat from core client for 30 sec - exiting 14:38:36 (4700): No heartbeat from core client for 30 sec - exiting 14:38:37 (4700): No heartbeat from core client for 30 sec - exiting 14:38:38 (4700): No heartbeat from core client for 30 sec - exiting 14:38:39 (4700): No heartbeat from core client for 30 sec - exiting 14:38:40 (4700): No heartbeat from core client for 30 sec - exiting 14:38:41 (4700): No heartbeat from core client for 30 sec - exiting 14:38:42 (4700): No heartbeat from core client for 30 sec - exiting 14:38:43 (4700): No heartbeat from core client for 30 sec - exiting 14:38:44 (4700): No heartbeat from core client for 30 sec - exiting 14:38:45 (4700): No heartbeat from core client for 30 sec - exiting 14:38:46 (4700): No heartbeat from core client for 30 sec - exiting 14:38:47 (4700): No heartbeat from core client for 30 sec - exiting 14:38:48 (4700): No heartbeat from core client for 30 sec - exiting 14:38:49 (4700): No heartbeat from core client for 30 sec - exiting 14:38:50 (4700): No heartbeat from core client for 30 sec - exiting 14:38:51 (4700): No heartbeat from core client for 30 sec - exiting 14:38:52 (4700): No heartbeat from core client for 30 sec - exiting 14:38:53 (4700): No heartbeat from core client for 30 sec - exiting 14:38:54 (4700): No heartbeat from core client for 30 sec - exiting 14:38:55 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=944, selfPID=944, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4348, selfPID=4348, iMonCtr=2 14:55:14 (6104): No heartbeat from core client for 30 sec - exiting 14:55:15 (6104): No heartbeat from core client for 30 sec - exiting 14:55:16 (6104): No heartbeat from core client for 30 sec - exiting 14:55:17 (6104): No heartbeat from core client for 30 sec - exiting 14:55:18 (6104): No heartbeat from core client for 30 sec - exiting 14:55:19 (6104): No heartbeat from core client for 30 sec - exiting 14:55:20 (6104): No heartbeat from core client for 30 sec - exiting 14:55:21 (6104): No heartbeat from core client for 30 sec - exiting 14:55:22 (6104): No heartbeat from core client for 30 sec - exiting 14:55:23 (6104): No heartbeat from core client for 30 sec - exiting 14:55:24 (6104): No heartbeat from core client for 30 sec - exiting 14:55:25 (6104): No heartbeat from core client for 30 sec - exiting 14:55:26 (6104): No heartbeat from core client for 30 sec - exiting 14:55:27 (6104): No heartbeat from core client for 30 sec - exiting 14:55:28 (6104): No heartbeat from core client for 30 sec - exiting 14:55:29 (6104): No heartbeat from core client for 30 sec - exiting 14:55:30 (6104): No heartbeat from core client for 30 sec - exiting 14:55:31 (6104): No heartbeat from core client for 30 sec - exiting 14:55:32 (6104): No heartbeat from core client for 30 sec - exiting 14:55:33 (6104): No heartbeat from core client for 30 sec - exiting 14:55:34 (6104): No heartbeat from core client for 30 sec - exiting 14:55:35 (6104): No heartbeat from core client for 30 sec - exiting 14:55:36 (6104): No heartbeat from core client for 30 sec - exiting 14:55:37 (6104): No heartbeat from core client for 30 sec - exiting 14:55:38 (6104): No heartbeat from core client for 30 sec - exiting 14:55:39 (6104): No heartbeat from core client for 30 sec - exiting 14:55:40 (6104): No heartbeat from core client for 30 sec - exiting 14:55:41 (6104): No heartbeat from core client for 30 sec - exiting 14:55:42 (6104): No heartbeat from core client for 30 sec - exiting 14:55:43 (6104): No heartbeat from core client for 30 sec - exiting 14:55:44 (6104): No heartbeat from core client for 30 sec - exiting 14:55:45 (6104): No heartbeat from core client for 30 sec - exiting 14:55:46 (6104): No heartbeat from core client for 30 sec - exiting 14:55:47 (6104): No heartbeat from core client for 30 sec - exiting 14:55:48 (6104): No heartbeat from core client for 30 sec - exiting 14:55:49 (6104): No heartbeat from core client for 30 sec - exiting 14:55:50 (6104): No heartbeat from core client for 30 sec - exiting 14:55:51 (6104): No heartbeat from core client for 30 sec - exiting 14:55:52 (6104): No heartbeat from core client for 30 sec - exiting 14:55:53 (6104): No heartbeat from core client for 30 sec - exiting 14:55:54 (6104): No heartbeat from core client for 30 sec - exiting 14:55:55 (6104): No heartbeat from core client for 30 sec - exiting 14:55:56 (6104): No heartbeat from core client for 30 sec - exiting 14:55:57 (6104): No heartbeat from core client for 30 sec - exiting 14:55:58 (6104): No heartbeat from core client for 30 sec - exiting 14:55:59 (6104): No heartbeat from core client for 30 sec - exiting 14:56:00 (6104): No heartbeat from core client for 30 sec - exiting 14:56:01 (6104): No heartbeat from core client for 30 sec - exiting 14:56:02 (6104): No heartbeat from core client for 30 sec - exiting 14:56:03 (6104): No heartbeat from core client for 30 sec - exiting 14:56:04 (6104): No heartbeat from core client for 30 sec - exiting 14:56:05 (6104): No heartbeat from core client for 30 sec - exiting 14:56:06 (6104): No heartbeat from core client for 30 sec - exiting 14:56:07 (6104): No heartbeat from core client for 30 sec - exiting 14:56:08 (6104): No heartbeat from core client for 30 sec - exiting 14:56:09 (6104): No heartbeat from core client for 30 sec - exiting 14:56:10 (6104): No heartbeat from core client for 30 sec - exiting 14:56:11 (6104): No heartbeat from core client for 30 sec - exiting 14:56:12 (6104): No heartbeat from core client for 30 sec - exiting 14:56:13 (6104): No heartbeat from core client for 30 sec - exiting 14:56:14 (6104): No heartbeat from core client for 30 sec - exiting 14:56:15 (6104): No heartbeat from core client for 30 sec - exiting 14:56:16 (6104): No heartbeat from core client for 30 sec - exiting 14:56:17 (6104): No heartbeat from core client for 30 sec - exiting 14:56:18 (6104): No heartbeat from core client for 30 sec - exiting 14:56:19 (6104): No heartbeat from core client for 30 sec - exiting 14:56:20 (6104): No heartbeat from core client for 30 sec - exiting 14:56:21 (6104): No heartbeat from core client for 30 sec - exiting 14:56:22 (6104): No heartbeat from core client for 30 sec - exiting 14:56:23 (6104): No heartbeat from core client for 30 sec - exiting 14:56:24 (6104): No heartbeat from core client for 30 sec - exiting 14:56:25 (6104): No heartbeat from core client for 30 sec - exiting 14:56:26 (6104): No heartbeat from core client for 30 sec - exiting 14:56:27 (6104): No heartbeat from core client for 30 sec - exiting 14:56:28 (6104): No heartbeat from core client for 30 sec - exiting 14:56:29 (6104): No heartbeat from core client for 30 sec - exiting 14:56:30 (6104): No heartbeat from core client for 30 sec - exiting 14:56:31 (6104): No heartbeat from core client for 30 sec - exiting 14:56:32 (6104): No heartbeat from core client for 30 sec - exiting 14:56:33 (6104): No heartbeat from core client for 30 sec - exiting 14:56:34 (6104): No heartbeat from core client for 30 sec - exiting 14:56:35 (6104): No heartbeat from core client for 30 sec - exiting 14:56:36 (6104): No heartbeat from core client for 30 sec - exiting 14:56:37 (6104): No heartbeat from core client for 30 sec - exiting 14:56:38 (6104): No heartbeat from core client for 30 sec - exiting 14:56:39 (6104): No heartbeat from core client for 30 sec - exiting 14:56:40 (6104): No heartbeat from core client for 30 sec - exiting 14:56:41 (6104): No heartbeat from core client for 30 sec - exiting 14:56:42 (6104): No heartbeat from core client for 30 sec - exiting 14:56:43 (6104): No heartbeat from core client for 30 sec - exiting 14:56:44 (6104): No heartbeat from core client for 30 sec - exiting 14:56:45 (6104): No heartbeat from core client for 30 sec - exiting 14:56:46 (6104): No heartbeat from core client for 30 sec - exiting 14:56:47 (6104): No heartbeat from core client for 30 sec - exiting 14:56:48 (6104): No heartbeat from core client for 30 sec - exiting 14:56:49 (6104): No heartbeat from core client for 30 sec - exiting 14:56:50 (6104): No heartbeat from core client for 30 sec - exiting 14:56:51 (6104): No heartbeat from core client for 30 sec - exiting 14:56:52 (6104): No heartbeat from core client for 30 sec - exiting 14:56:53 (6104): No heartbeat from core client for 30 sec - exiting 14:56:54 (6104): No heartbeat from core client for 30 sec - exiting 14:56:55 (6104): No heartbeat from core client for 30 sec - exiting 14:56:56 (6104): No heartbeat from core client for 30 sec - exiting 14:56:57 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7616, selfPID=7616, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4144, selfPID=4144, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8396, selfPID=8396, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7744, selfPID=7744, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3236, selfPID=3236, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:01 (5700): No heartbeat from core client for 30 sec - exiting 13:16:02 (5700): No heartbeat from core client for 30 sec - exiting 13:16:03 (5700): No heartbeat from core client for 30 sec - exiting 13:16:04 (5700): No heartbeat from core client for 30 sec - exiting 13:16:05 (5700): No heartbeat from core client for 30 sec - exiting 13:16:06 (5700): No heartbeat from core client for 30 sec - exiting 13:16:07 (5700): No heartbeat from core client for 30 sec - exiting 13:16:08 (5700): No heartbeat from core client for 30 sec - exiting 13:16:09 (5700): No heartbeat from core client for 30 sec - exiting 13:16:10 (5700): No heartbeat from core client for 30 sec - exiting 13:16:11 (5700): No heartbeat from core client for 30 sec - exiting 13:16:12 (5700): No heartbeat from core client for 30 sec - exiting 13:16:13 (5700): No heartbeat from core client for 30 sec - exiting 13:16:14 (5700): No heartbeat from core client for 30 sec - exiting 13:16:15 (5700): No heartbeat from core client for 30 sec - exiting 13:16:16 (5700): No heartbeat from core client for 30 sec - exiting 13:16:17 (5700): No heartbeat from core client for 30 sec - exiting 13:16:18 (5700): No heartbeat from core client for 30 sec - exiting 13:16:19 (5700): No heartbeat from core client for 30 sec - exiting 13:16:20 (5700): No heartbeat from core client for 30 sec - exiting 13:16:21 (5700): No heartbeat from core client for 30 sec - exiting 13:16:22 (5700): No heartbeat from core client for 30 sec - exiting 13:16:23 (5700): No heartbeat from core client for 30 sec - exiting 13:16:24 (5700): No heartbeat from core client for 30 sec - exiting 13:16:25 (5700): No heartbeat from core client for 30 sec - exiting 13:16:26 (5700): No heartbeat from core client for 30 sec - exiting 13:16:27 (5700): No heartbeat from core client for 30 sec - exiting 13:16:28 (5700): No heartbeat from core client for 30 sec - exiting 13:16:29 (5700): No heartbeat from core client for 30 sec - exiting 13:16:30 (5700): No heartbeat from core client for 30 sec - exiting 13:16:31 (5700): No heartbeat from core client for 30 sec - exiting 13:16:32 (5700): No heartbeat from core client for 30 sec - exiting 13:16:33 (5700): No heartbeat from core client for 30 sec - exiting 13:16:34 (5700): No heartbeat from core client for 30 sec - exiting 13:16:35 (5700): No heartbeat from core client for 30 sec - exiting 13:16:36 (5700): No heartbeat from core client for 30 sec - exiting 13:16:37 (5700): No heartbeat from core client for 30 sec - exiting 13:16:38 (5700): No heartbeat from core client for 30 sec - exiting 13:16:39 (5700): No heartbeat from core client for 30 sec - exiting 13:16:40 (5700): No heartbeat from core client for 30 sec - exiting 13:16:41 (5700): No heartbeat from core client for 30 sec - exiting 13:16:42 (5700): No heartbeat from core client for 30 sec - exiting 13:16:43 (5700): No heartbeat from core client for 30 sec - exiting 13:16:44 (5700): No heartbeat from core client for 30 sec - exiting 13:16:45 (5700): No heartbeat from core client for 30 sec - exiting 13:16:46 (5700): No heartbeat from core client for 30 sec - exiting 13:16:47 (5700): No heartbeat from core client for 30 sec - exiting 13:16:48 (5700): No heartbeat from core client for 30 sec - exiting 13:16:49 (5700): No heartbeat from core client for 30 sec - exiting 13:16:50 (5700): No heartbeat from core client for 30 sec - exiting 13:16:51 (5700): No heartbeat from core client for 30 sec - exiting 13:16:52 (5700): No heartbeat from core client for 30 sec - exiting 13:16:53 (5700): No heartbeat from core client for 30 sec - exiting 13:16:54 (5700): No heartbeat from core client for 30 sec - exiting 13:16:55 (5700): No heartbeat from core client for 30 sec - exiting 13:16:56 (5700): No heartbeat from core client for 30 sec - exiting 13:16:57 (5700): No heartbeat from core client for 30 sec - exiting 13:16:58 (5700): No heartbeat from core client for 30 sec - exiting 13:16:59 (5700): No heartbeat from core client for 30 sec - exiting 13:17:00 (5700): No heartbeat from core client for 30 sec - exiting 13:17:01 (5700): No heartbeat from core client for 30 sec - exiting 13:17:02 (5700): No heartbeat from core client for 30 sec - exiting 13:17:03 (5700): No heartbeat from core client for 30 sec - exiting 13:17:04 (5700): No heartbeat from core client for 30 sec - exiting 13:17:05 (5700): No heartbeat from core client for 30 sec - exiting 13:17:06 (5700): No heartbeat from core client for 30 sec - exiting 13:17:07 (5700): No heartbeat from core client for 30 sec - exiting 13:17:08 (5700): No heartbeat from core client for 30 sec - exiting 13:17:09 (5700): No heartbeat from core client for 30 sec - exiting 13:17:10 (5700): No heartbeat from core client for 30 sec - exiting 13:17:11 (5700): No heartbeat from core client for 30 sec - exiting 13:17:12 (5700): No heartbeat from core client for 30 sec - exiting 13:17:13 (5700): No heartbeat from core client for 30 sec - exiting 13:17:14 (5700): No heartbeat from core client for 30 sec - exiting 13:17:15 (5700): No heartbeat from core client for 30 sec - exiting 13:17:16 (5700): No heartbeat from core client for 30 sec - exiting 13:17:17 (5700): No heartbeat from core client for 30 sec - exiting 13:17:18 (5700): No heartbeat from core client for 30 sec - exiting 13:17:19 (5700): No heartbeat from core client for 30 sec - exiting 13:17:20 (5700): No heartbeat from core client for 30 sec - exiting 13:17:21 (5700): No heartbeat from core client for 30 sec - exiting 13:17:22 (5700): No heartbeat from core client for 30 sec - exiting 13:17:23 (5700): No heartbeat from core client for 30 sec - exiting 13:17:24 (5700): No heartbeat from core client for 30 sec - exiting 13:17:25 (5700): No heartbeat from core client for 30 sec - exiting 13:17:26 (5700): No heartbeat from core client for 30 sec - exiting 13:17:27 (5700): No heartbeat from core client for 30 sec - exiting 13:17:28 (5700): No heartbeat from core client for 30 sec - exiting 13:17:29 (5700): No heartbeat from core client for 30 sec - exiting 13:17:30 (5700): No heartbeat from core client for 30 sec - exiting 13:17:31 (5700): No heartbeat from core client for 30 sec - exiting 13:17:32 (5700): No heartbeat from core client for 30 sec - exiting 13:17:33 (5700): No heartbeat from core client for 30 sec - exiting 13:17:34 (5700): No heartbeat from core client for 30 sec - exiting 13:17:35 (5700): No heartbeat from core client for 30 sec - exiting 13:17:36 (5700): No heartbeat from core client for 30 sec - exiting 13:17:37 (5700): No heartbeat from core client for 30 sec - exiting 13:17:38 (5700): No heartbeat from core client for 30 sec - exiting 13:17:39 (5700): No heartbeat from core client for 30 sec - exiting 13:17:40 (5700): No heartbeat from core client for 30 sec - exiting 13:17:41 (5700): No heartbeat from core client for 30 sec - exiting 13:17:42 (5700): No heartbeat from core client for 30 sec - exiting 13:17:43 (5700): No heartbeat from core client for 30 sec - exiting 13:17:44 (5700): No heartbeat from core client for 30 sec - exiting 13:17:45 (5700): No heartbeat from core client for 30 sec - exiting 13:17:46 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2196, selfPID=2196, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8520, selfPID=8520, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5676, selfPID=5676, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3136, selfPID=3136, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5808, selfPID=5808, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7888, selfPID=7888, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9936, selfPID=9936, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7856, selfPID=7856, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10100, selfPID=10100, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10688, selfPID=10688, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10432, selfPID=8660, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_anz_r4ga_2012_1_008735384_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r4ga_2012_1_008735384_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r4ga_2012_1_008735384_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r4ga_2012_1_008735384_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r4ga_2012_1_008735384_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r4ga_2012_1_008735384_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r4ga_2012_1_008735384_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 May 2014 22:24:15	1328141	16618917	hadam3p_anz_r4ga_2012_1_008735384_0	57,899	196,982	3.4022
22 May 2014 20:27:56	1328141	16618917	hadam3p_anz_r4ga_2012_1_008735384_0	46,379	156,759	3.3800
21 May 2014 20:54:55	1328141	16618917	hadam3p_anz_r4ga_2012_1_008735384_0	34,859	117,149	3.3607
20 May 2014 09:11:58	1328141	16618917	hadam3p_anz_r4ga_2012_1_008735384_0	23,339	78,397	3.3591
20 May 2014 09:11:58	1328141	16618917	hadam3p_anz_r4ga_2012_1_008735384_0	11,819	40,136	3.3959