Task 16640633

Name	hadam3p_anz_r69w_2012_1_008737746_1
Workunit	8883724
Created	16 May 2014, 9:13:46 UTC
Sent	16 May 2014, 9:42:47 UTC
Report deadline	28 Apr 2015, 15:02:47 UTC
Received	30 May 2014, 7:54:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1308837
Run time	4 days 22 hours 11 min 25 sec
CPU time	4 days 12 hours 13 min 38 sec
Validate state	Invalid
Credit	1,006.54
Device peak FLOPS	1.43 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2828, iMonCtr=2 Model crash detected, will try to restart... 09:44:46 (3604): No heartbeat from core client for 30 sec - exiting 09:44:47 (3604): No heartbeat from core client for 30 sec - exiting 09:44:48 (3604): No heartbeat from core client for 30 sec - exiting 09:44:49 (3604): No heartbeat from core client for 30 sec - exiting 09:44:50 (3604): No heartbeat from core client for 30 sec - exiting 09:44:51 (3604): No heartbeat from core client for 30 sec - exiting 09:44:52 (3604): No heartbeat from core client for 30 sec - exiting 09:44:54 (3604): No heartbeat from core client for 30 sec - exiting 09:44:55 (3604): No heartbeat from core client for 30 sec - exiting 09:44:56 (3604): No heartbeat from core client for 30 sec - exiting 09:44:57 (3604): No heartbeat from core client for 30 sec - exiting 09:44:58 (3604): No heartbeat from core client for 30 sec - exiting 09:44:59 (3604): No heartbeat from core client for 30 sec - exiting 09:45:00 (3604): No heartbeat from core client for 30 sec - exiting 09:45:01 (3604): No heartbeat from core client for 30 sec - exiting 09:45:02 (3604): No heartbeat from core client for 30 sec - exiting 09:45:04 (3604): No heartbeat from core client for 30 sec - exiting 09:45:05 (3604): No heartbeat from core client for 30 sec - exiting 09:45:06 (3604): No heartbeat from core client for 30 sec - exiting 09:45:07 (3604): No heartbeat from core client for 30 sec - exiting 09:45:08 (3604): No heartbeat from core client for 30 sec - exiting 09:45:09 (3604): No heartbeat from core client for 30 sec - exiting 09:45:10 (3604): No heartbeat from core client for 30 sec - exiting 09:45:11 (3604): No heartbeat from core client for 30 sec - exiting 09:45:12 (3604): No heartbeat from core client for 30 sec - exiting 09:45:14 (3604): No heartbeat from core client for 30 sec - exiting 09:45:15 (3604): No heartbeat from core client for 30 sec - exiting 09:45:16 (3604): No heartbeat from core client for 30 sec - exiting 09:45:17 (3604): No heartbeat from core client for 30 sec - exiting 09:45:18 (3604): No heartbeat from core client for 30 sec - exiting 09:45:19 (3604): No heartbeat from core client for 30 sec - exiting 09:45:20 (3604): No heartbeat from core client for 30 sec - exiting 09:45:22 (3604): No heartbeat from core client for 30 sec - exiting 09:45:23 (3604): No heartbeat from core client for 30 sec - exiting 09:45:24 (3604): No heartbeat from core client for 30 sec - exiting 09:45:25 (3604): No heartbeat from core client for 30 sec - exiting 09:45:26 (3604): No heartbeat from core client for 30 sec - exiting 09:45:28 (3604): No heartbeat from core client for 30 sec - exiting 09:45:29 (3604): No heartbeat from core client for 30 sec - exiting 09:45:30 (3604): No heartbeat from core client for 30 sec - exiting 09:45:31 (3604): No heartbeat from core client for 30 sec - exiting 09:45:32 (3604): No heartbeat from core client for 30 sec - exiting 09:45:33 (3604): No heartbeat from core client for 30 sec - exiting 09:45:34 (3604): No heartbeat from core client for 30 sec - exiting 09:45:35 (3604): No heartbeat from core client for 30 sec - exiting 09:45:36 (3604): No heartbeat from core client for 30 sec - exiting 09:45:37 (3604): No heartbeat from core client for 30 sec - exiting 09:45:39 (3604): No heartbeat from core client for 30 sec - exiting 09:45:40 (3604): No heartbeat from core client for 30 sec - exiting 09:45:41 (3604): No heartbeat from core client for 30 sec - exiting 09:45:42 (3604): No heartbeat from core client for 30 sec - exiting 09:45:43 (3604): No heartbeat from core client for 30 sec - exiting 09:45:44 (3604): No heartbeat from core client for 30 sec - exiting 09:45:45 (3604): No heartbeat from core client for 30 sec - exiting 09:45:46 (3604): No heartbeat from core client for 30 sec - exiting 09:45:47 (3604): No heartbeat from core client for 30 sec - exiting 09:45:49 (3604): No heartbeat from core client for 30 sec - exiting 09:45:50 (3604): No heartbeat from core client for 30 sec - exiting 09:45:51 (3604): No heartbeat from core client for 30 sec - exiting 09:45:52 (3604): No heartbeat from core client for 30 sec - exiting 09:45:53 (3604): No heartbeat from core client for 30 sec - exiting 09:45:54 (3604): No heartbeat from core client for 30 sec - exiting 09:45:55 (3604): No heartbeat from core client for 30 sec - exiting 09:45:56 (3604): No heartbeat from core client for 30 sec - exiting 09:45:57 (3604): No heartbeat from core client for 30 sec - exiting 09:45:58 (3604): No heartbeat from core client for 30 sec - exiting 09:46:00 (3604): No heartbeat from core client for 30 sec - exiting 09:46:01 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:44:29 (164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3348, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1760, selfPID=2516, iMonCtr=1 Model crash detected, will try to restart... 07:29:03 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:01:46 (4052): No heartbeat from core client for 30 sec - exiting 11:01:47 (4052): No heartbeat from core client for 30 sec - exiting 11:01:48 (4052): No heartbeat from core client for 30 sec - exiting 11:01:50 (4052): No heartbeat from core client for 30 sec - exiting 11:01:51 (4052): No heartbeat from core client for 30 sec - exiting 11:01:52 (4052): No heartbeat from core client for 30 sec - exiting 11:01:53 (4052): No heartbeat from core client for 30 sec - exiting 11:01:54 (4052): No heartbeat from core client for 30 sec - exiting 11:01:55 (4052): No heartbeat from core client for 30 sec - exiting 11:01:56 (4052): No heartbeat from core client for 30 sec - exiting 11:01:57 (4052): No heartbeat from core client for 30 sec - exiting 11:01:58 (4052): No heartbeat from core client for 30 sec - exiting 11:01:59 (4052): No heartbeat from core client for 30 sec - exiting 11:02:00 (4052): No heartbeat from core client for 30 sec - exiting 11:02:02 (4052): No heartbeat from core client for 30 sec - exiting 11:02:03 (4052): No heartbeat from core client for 30 sec - exiting 11:02:04 (4052): No heartbeat from core client for 30 sec - exiting 11:02:05 (4052): No heartbeat from core client for 30 sec - exiting 11:02:06 (4052): No heartbeat from core client for 30 sec - exiting 11:02:07 (4052): No heartbeat from core client for 30 sec - exiting 11:02:08 (4052): No heartbeat from core client for 30 sec - exiting 11:02:09 (4052): No heartbeat from core client for 30 sec - exiting 11:02:10 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:11 (4052): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 01:08:50 (3912): No heartbeat from core client for 30 sec - exiting 01:08:51 (3912): No heartbeat from core client for 30 sec - exiting 01:08:52 (3912): No heartbeat from core client for 30 sec - exiting 01:08:53 (3912): No heartbeat from core client for 30 sec - exiting 01:08:54 (3912): No heartbeat from core client for 30 sec - exiting 01:08:55 (3912): No heartbeat from core client for 30 sec - exiting 01:08:56 (3912): No heartbeat from core client for 30 sec - exiting 01:08:58 (3912): No heartbeat from core client for 30 sec - exiting 01:08:59 (3912): No heartbeat from core client for 30 sec - exiting 01:09:00 (3912): No heartbeat from core client for 30 sec - exiting 01:09:01 (3912): No heartbeat from core client for 30 sec - exiting 01:09:02 (3912): No heartbeat from core client for 30 sec - exiting 01:09:03 (3912): No heartbeat from core client for 30 sec - exiting 01:09:04 (3912): No heartbeat from core client for 30 sec - exiting 01:09:05 (3912): No heartbeat from core client for 30 sec - exiting 01:09:07 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... GGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2368, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2868, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3244, selfPID=1040, iMonCtr=1 Model crash detected, will try to restart... 08:23:41 (1152): No heartbeat from core client for 30 sec - exiting 08:23:42 (1152): No heartbeat from core client for 30 sec - exiting 08:23:43 (1152): No heartbeat from core client for 30 sec - exiting 08:23:44 (1152): No heartbeat from core client for 30 sec - exiting 08:23:45 (1152): No heartbeat from core client for 30 sec - exiting 08:23:46 (1152): No heartbeat from core client for 30 sec - exiting 08:23:47 (1152): No heartbeat from core client for 30 sec - exiting 08:23:48 (1152): No heartbeat from core client for 30 sec - exiting 08:23:49 (1152): No heartbeat from core client for 30 sec - exiting 08:23:51 (1152): No heartbeat from core client for 30 sec - exiting 08:23:52 (1152): No heartbeat from core client for 30 sec - exiting 08:23:53 (1152): No heartbeat from core client for 30 sec - exiting 08:23:54 (1152): No heartbeat from core client for 30 sec - exiting 08:23:55 (1152): No heartbeat from core client for 30 sec - exiting 08:23:56 (1152): No heartbeat from core client for 30 sec - exiting 08:23:57 (1152): No heartbeat from core client for 30 sec - exiting 08:23:58 (1152): No heartbeat from core client for 30 sec - exiting 08:23:59 (1152): No heartbeat from core client for 30 sec - exiting 08:24:00 (1152): No heartbeat from core client for 30 sec - exiting 08:24:01 (1152): No heartbeat from core client for 30 sec - exiting 08:24:03 (1152): No heartbeat from core client for 30 sec - exiting 08:24:04 (1152): No heartbeat from core client for 30 sec - exiting 08:24:05 (1152): No heartbeat from core client for 30 sec - exiting 08:24:06 (1152): No heartbeat from core client for 30 sec - exiting 08:24:07 (1152): No heartbeat from core client for 30 sec - exiting 08:24:08 (1152): No heartbeat from core client for 30 sec - exiting 08:24:09 (1152): No heartbeat from core client for 30 sec - exiting 08:24:10 (1152): No heartbeat from core client for 30 sec - exiting 08:24:11 (1152): No heartbeat from core client for 30 sec - exiting 08:24:12 (1152): No heartbeat from core client for 30 sec - exiting 08:24:14 (1152): No heartbeat from core client for 30 sec - exiting 08:24:15 (1152): No heartbeat from core client for 30 sec - exiting 08:24:16 (1152): No heartbeat from core client for 30 sec - exiting 08:24:17 (1152): No heartbeat from core client for 30 sec - exiting 08:24:18 (1152): No heartbeat from core client for 30 sec - exiting 08:24:19 (1152): No heartbeat from core client for 30 sec - exiting 08:24:20 (1152): No heartbeat from core client for 30 sec - exiting 08:24:21 (1152): No heartbeat from core client for 30 sec - exiting 08:24:22 (1152): No heartbeat from core client for 30 sec - exiting 08:24:23 (1152): No heartbeat from core client for 30 sec - exiting 08:24:25 (1152): No heartbeat from core client for 30 sec - exiting 08:24:26 (1152): No heartbeat from core client for 30 sec - exiting 08:24:27 (1152): No heartbeat from core client for 30 sec - exiting 08:24:28 (1152): No heartbeat from core client for 30 sec - exiting 08:24:29 (1152): No heartbeat from core client for 30 sec - exiting 08:24:30 (1152): No heartbeat from core client for 30 sec - exiting 08:24:31 (1152): No heartbeat from core client for 30 sec - exiting 08:24:32 (1152): No heartbeat from core client for 30 sec - exiting 08:24:33 (1152): No heartbeat from core client for 30 sec - exiting 08:24:34 (1152): No heartbeat from core client for 30 sec - exiting 08:24:35 (1152): No heartbeat from core client for 30 sec - exiting 08:24:37 (1152): No heartbeat from core client for 30 sec - exiting 08:24:38 (1152): No heartbeat from core client for 30 sec - exiting 08:24:39 (1152): No heartbeat from core client for 30 sec - exiting 08:24:40 (1152): No heartbeat from core client for 30 sec - exiting 08:24:41 (1152): No heartbeat from core client for 30 sec - exiting 08:24:42 (1152): No heartbeat from core client for 30 sec - exiting 08:24:43 (1152): No heartbeat from core client for 30 sec - exiting 08:24:44 (1152): No heartbeat from core client for 30 sec - exiting 08:24:45 (1152): No heartbeat from core client for 30 sec - exiting 08:24:46 (1152): No heartbeat from core client for 30 sec - exiting 08:24:48 (1152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Glonbtroller:: CPDN process is not running, exiting, bRetVal l = 1, che= 1, checkPID=0, selfPID=1528, iM onCtr=2 Model crash detected, will try to restart... 07:50:28 (3976): No heartbeat from core client for 30 sec - exiting 07:50:29 (3976): No heartbeat from core client for 30 sec - exiting 07:50:31 (3976): No heartbeat from core client for 30 sec - exiting 07:50:32 (3976): No heartbeat from core client for 30 sec - exiting 07:50:33 (3976): No heartbeat from core client for 30 sec - exiting 07:50:34 (3976): No heartbeat from core client for 30 sec - exiting 07:50:35 (3976): No heartbeat from core client for 30 sec - exiting 07:50:36 (3976): No heartbeat from core client for 30 sec - exiting 07:50:37 (3976): No heartbeat from core client for 30 sec - exiting 07:50:38 (3976): No heartbeat from core client for 30 sec - exiting 07:50:39 (3976): No heartbeat from core client for 30 sec - exiting 07:50:40 (3976): No heartbeat from core client for 30 sec - exiting 07:50:41 (3976): No heartbeat from core client for 30 sec - exiting 07:50:43 (3976): No heartbeat from core client for 30 sec - exiting 07:50:44 (3976): No heartbeat from core client for 30 sec - exiting 07:50:45 (3976): No heartbeat from core client for 30 sec - exiting 07:50:46 (3976): No heartbeat from core client for 30 sec - exiting 07:50:47 (3976): No heartbeat from core client for 30 sec - exiting 07:50:48 (3976): No heartbeat from core client for 30 sec - exiting 07:50:49 (3976): No heartbeat from core client for 30 sec - exiting 07:50:50 (3976): No heartbeat from core client for 30 sec - exiting 07:50:51 (3976): No heartbeat from core client for 30 sec - exiting 07:50:52 (3976): No heartbeat from core client for 30 sec - exiting 07:50:54 (3976): No heartbeat from core client for 30 sec - exiting 07:50:55 (3976): No heartbeat from core client for 30 sec - exiting 07:50:56 (3976): No heartbeat from core client for 30 sec - exiting 07:50:57 (3976): No heartbeat from core client for 30 sec - exiting 07:50:58 (3976): No heartbeat from core client for 30 sec - exiting 07:50:59 (3976): No heartbeat from core client for 30 sec - exiting 07:51:00 (3976): No heartbeat from core client for 30 sec - exiting 07:51:01 (3976): No heartbeat from core client for 30 sec - exiting 07:51:02 (3976): No heartbeat from core client for 30 sec - exiting 07:51:03 (3976): No heartbeat from core client for 30 sec - exiting 07:51:04 (3976): No heartbeat from core client for 30 sec - exiting 07:51:06 (3976): No heartbeat from core client for 30 sec - exiting 07:51:07 (3976): No heartbeat from core client for 30 sec - exiting 07:51:08 (3976): No heartbeat from core client for 30 sec - exiting 07:51:09 (3976): No heartbeat from core client for 30 sec - exiting 07:51:10 (3976): No heartbeat from core client for 30 sec - exiting 07:51:11 (3976): No heartbeat from core client for 30 sec - exiting 07:51:12 (3976): No heartbeat from core client for 30 sec - exiting 07:51:13 (3976): No heartbeat from core client for 30 sec - exiting 07:51:14 (3976): No heartbeat from core client for 30 sec - exiting 07:51:16 (3976): No heartbeat from core client for 30 sec - exiting 07:51:17 (3976): No heartbeat from core client for 30 sec - exiting 07:51:18 (3976): No heartbeat from core client for 30 sec - exiting 07:51:19 (3976): No heartbeat from core client for 30 sec - exiting 07:51:20 (3976): No heartbeat from core client for 30 sec - exiting 07:51:21 (3976): No heartbeat from core client for 30 sec - exiting 07:51:22 (3976): No heartbeat from core client for 30 sec - exiting 07:51:24 (3976): No heartbeat from core client for 30 sec - exiting 07:51:25 (3976): No heartbeat from core client for 30 sec - exiting 07:51:27 (3976): No heartbeat from core client for 30 sec - exiting 07:51:28 (3976): No heartbeat from core client for 30 sec - exiting 07:51:29 (3976): No heartbeat from core client for 30 sec - exiting 07:51:30 (3976): No heartbeat from core client for 30 sec - exiting 07:51:31 (3976): No heartbeat from core client for 30 sec - exiting 07:51:32 (3976): No heartbeat from core client for 30 sec - exiting 07:51:33 (3976): No heartbeat from core client for 30 sec - exiting 07:51:34 (3976): No heartbeat from core client for 30 sec - exiting 07:51:35 (3976): No heartbeat from core client for 30 sec - exiting 07:51:36 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2988, selfPID=708, iMonCtr=1 Model crash detected, will try to restart... 20:01:10 (3964): No heartbeat from core client for 30 sec - exiting 20:01:11 (3964): No heartbeat from core client for 30 sec - exiting 20:01:12 (3964): No heartbeat from core client for 30 sec - exiting 20:01:13 (3964): No heartbeat from core client for 30 sec - exiting 20:01:14 (3964): No heartbeat from core client for 30 sec - exiting 20:01:15 (3964): No heartbeat from core client for 30 sec - exiting 20:01:16 (3964): No heartbeat from core client for 30 sec - exiting 20:01:17 (3964): No heartbeat from core client for 30 sec - exiting 20:01:18 (3964): No heartbeat from core client for 30 sec - exiting 20:01:19 (3964): No heartbeat from core client for 30 sec - exiting 20:01:21 (3964): No heartbeat from core client for 30 sec - exiting 20:01:22 (3964): No heartbeat from core client for 30 sec - exiting 20:01:23 (3964): No heartbeat from core client for 30 sec - exiting 20:01:24 (3964): No heartbeat from core client for 30 sec - exiting 20:01:25 (3964): No heartbeat from core client for 30 sec - exiting 20:01:26 (3964): No heartbeat from core client for 30 sec - exiting 20:01:27 (3964): No heartbeat from core client for 30 sec - exiting 20:01:28 (3964): No heartbeat from core client for 30 sec - exiting 20:01:29 (3964): No heartbeat from core client for 30 sec - exiting 20:01:30 (3964): No heartbeat from core client for 30 sec - exiting 20:01:32 (3964): No heartbeat from core client for 30 sec - exiting 20:01:33 (3964): No heartbeat from core client for 30 sec - exiting 20:01:34 (3964): No heartbeat from core client for 30 sec - exiting 20:01:35 (3964): No heartbeat from core client for 30 sec - exiting 20:01:36 (3964): No heartbeat from core client for 30 sec - exiting 20:01:37 (3964): No heartbeat from core client for 30 sec - exiting 20:01:38 (3964): No heartbeat from core client for 30 sec - exiting 20:01:39 (3964): No heartbeat from core client for 30 sec - exiting 20:01:40 (3964): No heartbeat from core client for 30 sec - exiting 20:01:41 (3964): No heartbeat from core client for 30 sec - exiting 20:01:43 (3964): No heartbeat from core client for 30 sec - exiting 20:01:44 (3964): No heartbeat from core client for 30 sec - exiting 20:01:45 (3964): No heartbeat from core client for 30 sec - exiting 20:01:46 (3964): No heartbeat from core client for 30 sec - exiting 20:01:47 (3964): No heartbeat from core client for 30 sec - exiting 20:01:48 (3964): No heartbeat from core client for 30 sec - exiting 20:01:49 (3964): No heartbeat from core client for 30 sec - exiting 20:01:50 (3964): No heartbeat from core client for 30 sec - exiting 20:01:51 (3964): No heartbeat from core client for 30 sec - exiting 20:01:52 (3964): No heartbeat from core client for 30 sec - exiting 20:01:53 (3964): No heartbeat from core client for 30 sec - exiting 20:01:55 (3964): No heartbeat from core client for 30 sec - exiting 20:01:56 (3964): No heartbeat from core client for 30 sec - exiting 20:01:57 (3964): No heartbeat from core client for 30 sec - exiting 20:01:58 (3964): No heartbeat from core client for 30 sec - exiting 20:01:59 (3964): No heartbeat from core client for 30 sec - exiting 20:02:00 (3964): No heartbeat from core client for 30 sec - exiting 20:02:01 (3964): No heartbeat from core client for 30 sec - exiting 20:02:02 (3964): No heartbeat from core client for 30 sec - exiting 20:02:03 (3964): No heartbeat from core client for 30 sec - exiting 20:02:04 (3964): No heartbeat from core client for 30 sec - exiting 20:02:06 (3964): No heartbeat from core client for 30 sec - exiting 20:02:07 (3964): No heartbeat from core client for 30 sec - exiting 20:02:08 (3964): No heartbeat from core client for 30 sec - exiting 20:02:09 (3964): No heartbeat from core client for 30 sec - exiting 20:02:10 (3964): No heartbeat from core client for 30 sec - exiting 20:02:11 (3964): No heartbeat from core client for 30 sec - exiting 20:02:12 (3964): No heartbeat from core client for 30 sec - exiting 20:02:13 (3964): No heartbeat from core client for 30 sec - exiting 20:02:14 (3964): No heartbeat from core client for 30 sec - exiting 20:02:15 (3964): No heartbeat from core client for 30 sec - exiting 20:02:17 (3964): No heartbeat from core client for 30 sec - exiting 20:02:18 (3964): No heartbeat from core client for 30 sec - exiting 20:02:19 (3964): No heartbeat from core client for 30 sec - exiting 20:02:20 (3964): No heartbeat from core client for 30 sec - exiting 20:02:21 (3964): No heartbeat from core client for 30 sec - exiting 20:02:22 (3964): No heartbeat from core client for 30 sec - exiting 20:02:23 (3964): No heartbeat from core client for 30 sec - exiting 20:02:24 (3964): No heartbeat from core client for 30 sec - exiting 20:02:25 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3496, iMonCtr=2 Model crash detected, will try to restart... 11:29:10 (668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error ferror - Unit 61 - Return code = 32 Model crashed: STWORK : I/O error - PP fixed length header tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=524, selfPID=524, iMonCtr=2 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r69w_2012_1_008737746_1_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 May 2014 16:13:50	1308837	16640633	hadam3p_anz_r69w_2012_1_008737746_1	23,339	330,828	14.1749
20 May 2014 15:32:25	1308837	16640633	hadam3p_anz_r69w_2012_1_008737746_1	11,819	166,866	14.1185