Task 14335890

Name	hadam3p_pnw_8p3u_2006_1_007851040_0
Workunit	8006152
Created	1 Apr 2012, 0:34:26 UTC
Sent	1 Apr 2012, 0:34:32 UTC
Report deadline	14 Mar 2013, 5:54:32 UTC
Received	28 Apr 2012, 13:06:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1179803
Run time	2 days 22 hours 23 min 53 sec
CPU time	2 days 17 hours 13 min 13 sec
Validate state	Invalid
Credit	1,253.67
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4080, selfPID=5676, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6372, selfPID=6372, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=824, selfPID=3372, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7148, selfPID=5380, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5728, selfPID=5728, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6832, selfPID=2244, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1588, selfPID=1588, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:06:59 (5644): No heartbeat from core client for 30 sec - exiting 22:07:00 (5644): No heartbeat from core client for 30 sec - exiting 22:07:01 (5644): No heartbeat from core client for 30 sec - exiting 22:07:02 (5644): No heartbeat from core client for 30 sec - exiting 22:07:03 (5644): No heartbeat from core client for 30 sec - exiting 22:07:04 (5644): No heartbeat from core client for 30 sec - exiting 22:07:05 (5644): No heartbeat from core client for 30 sec - exiting 22:07:06 (5644): No heartbeat from core client for 30 sec - exiting 22:07:07 (5644): No heartbeat from core client for 30 sec - exiting 22:07:08 (5644): No heartbeat from core client for 30 sec - exiting 22:07:09 (5644): No heartbeat from core client for 30 sec - exiting 22:07:11 (5644): No heartbeat from core client for 30 sec - exiting 22:07:12 (5644): No heartbeat from core client for 30 sec - exiting 22:07:13 (5644): No heartbeat from core client for 30 sec - exiting 22:07:14 (5644): No heartbeat from core client for 30 sec - exiting 22:07:15 (5644): No heartbeat from core client for 30 sec - exiting 22:07:16 (5644): No heartbeat from core client for 30 sec - exiting 22:07:17 (5644): No heartbeat from core client for 30 sec - exiting 22:07:18 (5644): No heartbeat from core client for 30 sec - exiting 22:07:19 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:20 (5644): No heartbeat from core client for 30 sec - exiting 10:58:10 (5452): No heartbeat from core client for 30 sec - exiting 10:58:11 (5452): No heartbeat from core client for 30 sec - exiting 10:58:13 (5452): No heartbeat from core client for 30 sec - exiting 10:58:14 (5452): No heartbeat from core client for 30 sec - exiting 10:58:15 (5452): No heartbeat from core client for 30 sec - exiting 10:58:16 (5452): No heartbeat from core client for 30 sec - exiting 10:58:17 (5452): No heartbeat from core client for 30 sec - exiting 10:58:18 (5452): No heartbeat from core client for 30 sec - exiting 10:58:19 (5452): No heartbeat from core client for 30 sec - exiting 10:58:20 (5452): No heartbeat from core client for 30 sec - exiting 10:58:21 (5452): No heartbeat from core client for 30 sec - exiting 10:58:22 (5452): No heartbeat from core client for 30 sec - exiting 10:58:23 (5452): No heartbeat from core client for 30 sec - exiting 10:58:24 (5452): No heartbeat from core client for 30 sec - exiting 10:58:26 (5452): No heartbeat from core client for 30 sec - exiting 10:58:27 (5452): No heartbeat from core client for 30 sec - exiting 10:58:28 (5452): No heartbeat from core client for 30 sec - exiting 10:58:29 (5452): No heartbeat from core client for 30 sec - exiting 10:58:30 (5452): No heartbeat from core client for 30 sec - exiting 10:58:31 (5452): No heartbeat from core client for 30 sec - exiting 10:58:32 (5452): No heartbeat from core client for 30 sec - exiting 10:58:33 (5452): No heartbeat from core client for 30 sec - exiting 10:58:34 (5452): No heartbeat from core client for 30 sec - exiting 10:58:35 (5452): No heartbeat from core client for 30 sec - exiting 10:58:36 (5452): No heartbeat from core client for 30 sec - exiting 10:58:38 (5452): No heartbeat from core client for 30 sec - exiting 10:58:39 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:14:26 (5108): No heartbeat from core client for 30 sec - exiting 21:14:27 (5108): No heartbeat from core client for 30 sec - exiting 21:14:28 (5108): No heartbeat from core client for 30 sec - exiting 21:14:29 (5108): No heartbeat from core client for 30 sec - exiting 21:14:30 (5108): No heartbeat from core client for 30 sec - exiting 21:14:31 (5108): No heartbeat from core client for 30 sec - exiting 21:14:32 (5108): No heartbeat from core client for 30 sec - exiting 21:14:34 (5108): No heartbeat from core client for 30 sec - exiting 21:14:35 (5108): No heartbeat from core client for 30 sec - exiting 21:14:36 (5108): No heartbeat from core client for 30 sec - exiting 21:14:37 (5108): No heartbeat from core client for 30 sec - exiting 21:14:38 (5108): No heartbeat from core client for 30 sec - exiting 21:14:39 (5108): No heartbeat from core client for 30 sec - exiting 21:14:40 (5108): No heartbeat from core client for 30 sec - exiting 21:14:41 (5108): No heartbeat from core client for 30 sec - exiting 21:14:42 (5108): No heartbeat from core client for 30 sec - exiting 21:14:43 (5108): No heartbeat from core client for 30 sec - exiting 21:14:44 (5108): No heartbeat from core client for 30 sec - exiting 21:14:45 (5108): No heartbeat from core client for 30 sec - exiting 21:14:46 (5108): No heartbeat from core client for 30 sec - exiting 21:14:47 (5108): No heartbeat from core client for 30 sec - exiting 21:14:48 (5108): No heartbeat from core client for 30 sec - exiting 21:14:49 (5108): No heartbeat from core client for 30 sec - exiting 21:14:50 (5108): No heartbeat from core client for 30 sec - exiting 21:14:51 (5108): No heartbeat from core client for 30 sec - exiting 21:14:52 (5108): No heartbeat from core client for 30 sec - exiting 21:14:53 (5108): No heartbeat from core client for 30 sec - exiting 21:14:55 (5108): No heartbeat from core client for 30 sec - exiting 21:14:56 (5108): No heartbeat from core client for 30 sec - exiting 21:14:57 (5108): No heartbeat from core client for 30 sec - exiting 21:14:58 (5108): No heartbeat from core client for 30 sec - exiting 21:14:59 (5108): No heartbeat from core client for 30 sec - exiting 21:15:00 (5108): No heartbeat from core client for 30 sec - exiting 21:15:01 (5108): No heartbeat from core client for 30 sec - exiting 21:15:02 (5108): No heartbeat from core client for 30 sec - exiting 21:15:03 (5108): No heartbeat from core client for 30 sec - exiting 21:15:04 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5784, selfPID=5784, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6252, selfPID=5584, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:04:05 (4252): No heartbeat from core client for 30 sec - exiting 08:04:06 (4252): No heartbeat from core client for 30 sec - exiting 08:04:07 (4252): No heartbeat from core client for 30 sec - exiting 08:04:08 (4252): No heartbeat from core client for 30 sec - exiting 08:04:09 (4252): No heartbeat from core client for 30 sec - exiting 08:04:10 (4252): No heartbeat from core client for 30 sec - exiting 08:04:12 (4252): No heartbeat from core client for 30 sec - exiting 08:04:13 (4252): No heartbeat from core client for 30 sec - exiting 08:04:14 (4252): No heartbeat from core client for 30 sec - exiting 08:04:15 (4252): No heartbeat from core client for 30 sec - exiting 08:04:16 (4252): No heartbeat from core client for 30 sec - exiting 08:04:17 (4252): No heartbeat from core client for 30 sec - exiting 08:04:18 (4252): No heartbeat from core client for 30 sec - exiting 08:04:19 (4252): No heartbeat from core client for 30 sec - exiting 08:04:20 (4252): No heartbeat from core client for 30 sec - exiting 08:04:21 (4252): No heartbeat from core client for 30 sec - exiting 08:04:22 (4252): No heartbeat from core client for 30 sec - exiting 08:04:23 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:09:03 (4344): No heartbeat from core client for 30 sec - exiting 18:09:04 (4344): No heartbeat from core client for 30 sec - exiting 18:09:05 (4344): No heartbeat from core client for 30 sec - exiting 18:09:06 (4344): No heartbeat from core client for 30 sec - exiting 18:09:07 (4344): No heartbeat from core client for 30 sec - exiting 18:09:08 (4344): No heartbeat from core client for 30 sec - exiting 18:09:09 (4344): No heartbeat from core client for 30 sec - exiting 18:09:10 (4344): No heartbeat from core client for 30 sec - exiting 18:09:12 (4344): No heartbeat from core client for 30 sec - exiting 18:09:13 (4344): No heartbeat from core client for 30 sec - exiting 18:09:14 (4344): No heartbeat from core client for 30 sec - exiting 18:09:15 (4344): No heartbeat from core client for 30 sec - exiting 18:09:16 (4344): No heartbeat from core client for 30 sec - exiting 18:09:17 (4344): No heartbeat from core client for 30 sec - exiting 18:09:18 (4344): No heartbeat from core client for 30 sec - exiting 18:09:19 (4344): No heartbeat from core client for 30 sec - exiting 18:09:20 (4344): No heartbeat from core client for 30 sec - exiting 18:09:21 (4344): No heartbeat from core client for 30 sec - exiting 18:09:22 (4344): No heartbeat from core client for 30 sec - exiting 18:09:24 (4344): No heartbeat from core client for 30 sec - exiting 18:09:25 (4344): No heartbeat from core client for 30 sec - exiting 18:09:26 (4344): No heartbeat from core client for 30 sec - exiting 18:09:27 (4344): No heartbeat from core client for 30 sec - exiting 18:09:28 (4344): No heartbeat from core client for 30 sec - exiting 18:09:29 (4344): No heartbeat from core client for 30 sec - exiting 18:09:30 (4344): No heartbeat from core client for 30 sec - exiting 18:09:31 (4344): No heartbeat from core client for 30 sec - exiting 18:09:32 (4344): No heartbeat from core client for 30 sec - exiting 18:09:33 (4344): No heartbeat from core client for 30 sec - exiting 18:09:34 (4344): No heartbeat from core client for 30 sec - exiting 18:09:36 (4344): No heartbeat from core client for 30 sec - exiting 18:09:37 (4344): No heartbeat from core client for 30 sec - exiting 18:09:38 (4344): No heartbeat from core client for 30 sec - exiting 18:09:39 (4344): No heartbeat from core client for 30 sec - exiting 18:09:40 (4344): No heartbeat from core client for 30 sec - exiting 18:09:41 (4344): No heartbeat from core client for 30 sec - exiting 18:09:42 (4344): No heartbeat from core client for 30 sec - exiting 18:09:43 (4344): No heartbeat from core client for 30 sec - exiting 18:09:44 (4344): No heartbeat from core client for 30 sec - exiting 18:09:45 (4344): No heartbeat from core client for 30 sec - exiting 18:09:46 (4344): No heartbeat from core client for 30 sec - exiting 18:09:48 (4344): No heartbeat from core client for 30 sec - exiting 18:09:49 (4344): No heartbeat from core client for 30 sec - exiting 18:09:50 (4344): No heartbeat from core client for 30 sec - exiting 18:09:51 (4344): No heartbeat from core client for 30 sec - exiting 18:09:52 (4344): No heartbeat from core client for 30 sec - exiting 18:09:53 (4344): No heartbeat from core client for 30 sec - exiting 18:09:54 (4344): No heartbeat from core client for 30 sec - exiting 18:09:55 (4344): No heartbeat from core client for 30 sec - exiting 18:09:56 (4344): No heartbeat from core client for 30 sec - exiting 18:09:57 (4344): No heartbeat from core client for 30 sec - exiting 18:09:58 (4344): No heartbeat from core client for 30 sec - exiting 18:09:59 (4344): No heartbeat from core client for 30 sec - exiting 18:10:01 (4344): No heartbeat from core client for 30 sec - exiting 18:10:02 (4344): No heartbeat from core client for 30 sec - exiting 18:10:03 (4344): No heartbeat from core client for 30 sec - exiting 18:10:04 (4344): No heartbeat from core client for 30 sec - exiting 18:10:05 (4344): No heartbeat from core client for 30 sec - exiting 18:10:06 (4344): No heartbeat from core client for 30 sec - exiting 18:10:07 (4344): No heartbeat from core client for 30 sec - exiting 18:10:08 (4344): No heartbeat from core client for 30 sec - exiting 18:10:09 (4344): No heartbeat from core client for 30 sec - exiting 18:10:10 (4344): No heartbeat from core client for 30 sec - exiting 18:10:12 (4344): No heartbeat from core client for 30 sec - exiting 18:10:13 (4344): No heartbeat from core client for 30 sec - exiting 18:10:14 (4344): No heartbeat from core client for 30 sec - exiting 18:10:15 (4344): No heartbeat from core client for 30 sec - exiting 18:10:16 (4344): No heartbeat from core client for 30 sec - exiting 18:10:17 (4344): No heartbeat from core client for 30 sec - exiting 18:10:18 (4344): No heartbeat from core client for 30 sec - exiting 18:10:19 (4344): No heartbeat from core client for 30 sec - exiting 18:10:20 (4344): No heartbeat from core client for 30 sec - exiting 18:10:21 (4344): No heartbeat from core client for 30 sec - exiting 18:10:22 (4344): No heartbeat from core client for 30 sec - exiting 18:10:24 (4344): No heartbeat from core client for 30 sec - exiting 18:10:25 (4344): No heartbeat from core client for 30 sec - exiting 18:10:26 (4344): No heartbeat from core client for 30 sec - exiting 18:10:27 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:28 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:11:03 (1236): No heartbeat from core client for 30 sec - exiting 10:11:04 (1236): No heartbeat from core client for 30 sec - exiting 10:11:05 (1236): No heartbeat from core client for 30 sec - exiting 10:11:06 (1236): No heartbeat from core client for 30 sec - exiting 10:11:07 (1236): No heartbeat from core client for 30 sec - exiting 10:11:08 (1236): No heartbeat from core client for 30 sec - exiting 10:11:09 (1236): No heartbeat from core client for 30 sec - exiting 10:11:11 (1236): No heartbeat from core client for 30 sec - exiting 10:11:12 (1236): No heartbeat from core client for 30 sec - exiting 10:11:13 (1236): No heartbeat from core client for 30 sec - exiting 10:11:14 (1236): No heartbeat from core client for 30 sec - exiting 10:11:15 (1236): No heartbeat from core client for 30 sec - exiting 10:11:16 (1236): No heartbeat from core client for 30 sec - exiting 10:11:17 (1236): No heartbeat from core client for 30 sec - exiting 10:11:18 (1236): No heartbeat from core client for 30 sec - exiting 10:11:19 (1236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:49 (4908): No heartbeat from core client for 30 sec - exiting 18:06:51 (4908): No heartbeat from core client for 30 sec - exiting 18:06:52 (4908): No heartbeat from core client for 30 sec - exiting 18:06:53 (4908): No heartbeat from core client for 30 sec - exiting 18:06:54 (4908): No heartbeat from core client for 30 sec - exiting 18:06:55 (4908): No heartbeat from core client for 30 sec - exiting 18:06:56 (4908): No heartbeat from core client for 30 sec - exiting 18:06:57 (4908): No heartbeat from core client for 30 sec - exiting 18:06:58 (4908): No heartbeat from core client for 30 sec - exiting 18:06:59 (4908): No heartbeat from core client for 30 sec - exiting 18:07:01 (4908): No heartbeat from core client for 30 sec - exiting 18:07:02 (4908): No heartbeat from core client for 30 sec - exiting 18:07:03 (4908): No heartbeat from core client for 30 sec - exiting 18:07:04 (4908): No heartbeat from core client for 30 sec - exiting 18:07:05 (4908): No heartbeat from core client for 30 sec - exiting 18:07:06 (4908): No heartbeat from core client for 30 sec - exiting 18:07:07 (4908): No heartbeat from core client for 30 sec - exiting 18:07:08 (4908): No heartbeat from core client for 30 sec - exiting 18:07:09 (4908): No heartbeat from core client for 30 sec - exiting 18:07:11 (4908): No heartbeat from core client for 30 sec - exiting 18:07:12 (4908): No heartbeat from core client for 30 sec - exiting 18:07:13 (4908): No heartbeat from core client for 30 sec - exiting 18:07:14 (4908): No heartbeat from core client for 30 sec - exiting 18:07:15 (4908): No heartbeat from core client for 30 sec - exiting 18:07:16 (4908): No heartbeat from core client for 30 sec - exiting 18:07:17 (4908): No heartbeat from core client for 30 sec - exiting 18:07:18 (4908): No heartbeat from core client for 30 sec - exiting 18:07:19 (4908): No heartbeat from core client for 30 sec - exiting 18:07:20 (4908): No heartbeat from core client for 30 sec - exiting 18:07:22 (4908): No heartbeat from core client for 30 sec - exiting 18:07:23 (4908): No heartbeat from core client for 30 sec - exiting 18:07:24 (4908): No heartbeat from core client for 30 sec - exiting 18:07:25 (4908): No heartbeat from core client for 30 sec - exiting 18:07:26 (4908): No heartbeat from core client for 30 sec - exiting 18:07:27 (4908): No heartbeat from core client for 30 sec - exiting 18:07:28 (4908): No heartbeat from core client for 30 sec - exiting 18:07:30 (4908): No heartbeat from core client for 30 sec - exiting 18:07:31 (4908): No heartbeat from core client for 30 sec - exiting 18:07:32 (4908): No heartbeat from core client for 30 sec - exiting 18:07:33 (4908): No heartbeat from core client for 30 sec - exiting 18:07:34 (4908): No heartbeat from core client for 30 sec - exiting 18:07:35 (4908): No heartbeat from core client for 30 sec - exiting 18:07:36 (4908): No heartbeat from core client for 30 sec - exiting 18:07:37 (4908): No heartbeat from core client for 30 sec - exiting 18:07:38 (4908): No heartbeat from core client for 30 sec - exiting 18:07:40 (4908): No heartbeat from core client for 30 sec - exiting 18:07:41 (4908): No heartbeat from core client for 30 sec - exiting 18:07:42 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:43 (4908): No heartbeat from core client for 30 sec - exiting 21:15:44 (5948): No heartbeat from core client for 30 sec - exiting 21:15:45 (5948): No heartbeat from core client for 30 sec - exiting 21:15:46 (5948): No heartbeat from core client for 30 sec - exiting 21:15:47 (5948): No heartbeat from core client for 30 sec - exiting 21:15:49 (5948): No heartbeat from core client for 30 sec - exiting 21:15:50 (5948): No heartbeat from core client for 30 sec - exiting 21:15:51 (5948): No heartbeat from core client for 30 sec - exiting 21:15:52 (5948): No heartbeat from core client for 30 sec - exiting 21:15:53 (5948): No heartbeat from core client for 30 sec - exiting 21:15:54 (5948): No heartbeat from core client for 30 sec - exiting 21:15:55 (5948): No heartbeat from core client for 30 sec - exiting 21:15:56 (5948): No heartbeat from core client for 30 sec - exiting 21:15:57 (5948): No heartbeat from core client for 30 sec - exiting 21:15:58 (5948): No heartbeat from core client for 30 sec - exiting 21:15:59 (5948): No heartbeat from core client for 30 sec - exiting 21:16:01 (5948): No heartbeat from core client for 30 sec - exiting 21:16:02 (5948): No heartbeat from core client for 30 sec - exiting 21:16:03 (5948): No heartbeat from core client for 30 sec - exiting 21:16:04 (5948): No heartbeat from core client for 30 sec - exiting 21:16:05 (5948): No heartbeat from core client for 30 sec - exiting 21:16:06 (5948): No heartbeat from core client for 30 sec - exiting 21:16:07 (5948): No heartbeat from core client for 30 sec - exiting 21:16:08 (5948): No heartbeat from core client for 30 sec - exiting 21:16:09 (5948): No heartbeat from core client for 30 sec - exiting 21:16:10 (5948): No heartbeat from core client for 30 sec - exiting 21:16:11 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6140, selfPID=6040, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_8p3u_2006_1_007851040_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8p3u_2006_1_007851040_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8p3u_2006_1_007851040_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8p3u_2006_1_007851040_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8p3u_2006_1_007851040_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8p3u_2006_1_007851040_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8p3u_2006_1_007851040_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Apr 2012 15:18:11	1179803	14335890	hadam3p_pnw_8p3u_2006_1_007851040_0	57,696	203,496	3.5270
16 Apr 2012 13:44:51	1179803	14335890	hadam3p_pnw_8p3u_2006_1_007851040_0	46,176	163,553	3.5419
15 Apr 2012 16:07:16	1179803	14335890	hadam3p_pnw_8p3u_2006_1_007851040_0	34,656	122,459	3.5336
11 Apr 2012 15:56:59	1179803	14335890	hadam3p_pnw_8p3u_2006_1_007851040_0	23,136	82,269	3.5559
02 Apr 2012 19:54:35	1179803	14335890	hadam3p_pnw_8p3u_2006_1_007851040_0	11,616	42,420	3.6519