Task 15153563

Name	hadam3p_eu_9c9s_1969_1_008156524_0
Workunit	8311648
Created	20 Aug 2012, 5:12:25 UTC
Sent	27 Aug 2012, 1:23:11 UTC
Report deadline	9 Aug 2013, 6:43:11 UTC
Received	17 Sep 2012, 7:02:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1096534
Run time	2 days 14 hours 46 min 19 sec
CPU time	2 days 8 hours 35 min 41 sec
Validate state	Invalid
Credit	1,591.48
Device peak FLOPS	3.15 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=2 08:57:19 (628): No heartbeat from core client for 30 sec - exiting 08:57:20 (628): No heartbeat from core client for 30 sec - exiting 08:57:21 (628): No heartbeat from core client for 30 sec - exiting 08:57:22 (628): No heartbeat from core client for 30 sec - exiting 08:57:23 (628): No heartbeat from core client for 30 sec - exiting 08:57:24 (628): No heartbeat from core client for 30 sec - exiting 08:57:25 (628): No heartbeat from core client for 30 sec - exiting 08:57:26 (628): No heartbeat from core client for 30 sec - exiting 08:57:27 (628): No heartbeat from core client for 30 sec - exiting 08:57:28 (628): No heartbeat from core client for 30 sec - exiting 08:57:29 (628): No heartbeat from core client for 30 sec - exiting 08:57:30 (628): No heartbeat from core client for 30 sec - exiting 08:57:31 (628): No heartbeat from core client for 30 sec - exiting 08:57:32 (628): No heartbeat from core client for 30 sec - exiting 08:57:33 (628): No heartbeat from core client for 30 sec - exiting 08:57:34 (628): No heartbeat from core client for 30 sec - exiting 08:57:35 (628): No heartbeat from core client for 30 sec - exiting 08:57:36 (628): No heartbeat from core client for 30 sec - exiting 08:57:37 (628): No heartbeat from core client for 30 sec - exiting 08:57:38 (628): No heartbeat from core client for 30 sec - exiting 08:57:39 (628): No heartbeat from core client for 30 sec - exiting 08:57:40 (628): No heartbeat from core client for 30 sec - exiting 08:57:41 (628): No heartbeat from core client for 30 sec - exiting 08:57:42 (628): No heartbeat from core client for 30 sec - exiting 08:57:43 (628): No heartbeat from core client for 30 sec - exiting 08:57:44 (628): No heartbeat from core client for 30 sec - exiting 08:57:45 (628): No heartbeat from core client for 30 sec - exiting 08:57:46 (628): No heartbeat from core client for 30 sec - exiting 08:57:47 (628): No heartbeat from core client for 30 sec - exiting 08:57:48 (628): No heartbeat from core client for 30 sec - exiting 08:57:49 (628): No heartbeat from core client for 30 sec - exiting 08:57:50 (628): No heartbeat from core client for 30 sec - exiting 08:57:51 (628): No heartbeat from core client for 30 sec - exiting 08:57:52 (628): No heartbeat from core client for 30 sec - exiting 08:57:53 (628): No heartbeat from core client for 30 sec - exiting 08:57:54 (628): No heartbeat from core client for 30 sec - exiting 08:57:55 (628): No heartbeat from core client for 30 sec - exiting 08:57:56 (628): No heartbeat from core client for 30 sec - exiting 08:57:57 (628): No heartbeat from core client for 30 sec - exiting 08:57:58 (628): No heartbeat from core client for 30 sec - exiting 08:57:59 (628): No heartbeat from core client for 30 sec - exiting 08:58:00 (628): No heartbeat from core client for 30 sec - exiting 08:58:01 (628): No heartbeat from core client for 30 sec - exiting 08:58:02 (628): No heartbeat from core client for 30 sec - exiting 08:58:03 (628): No heartbeat from core client for 30 sec - exiting 08:58:04 (628): No heartbeat from core client for 30 sec - exiting 08:58:05 (628): No heartbeat from core client for 30 sec - exiting 08:58:06 (628): No heartbeat from core client for 30 sec - exiting 08:58:07 (628): No heartbeat from core client for 30 sec - exiting 08:58:08 (628): No heartbeat from core client for 30 sec - exiting 08:58:09 (628): No heartbeat from core client for 30 sec - exiting 08:58:10 (628): No heartbeat from core client for 30 sec - exiting 08:58:11 (628): No heartbeat from core client for 30 sec - exiting 08:58:12 (628): No heartbeat from core client for 30 sec - exiting 08:58:13 (628): No heartbeat from core client for 30 sec - exiting 08:58:14 (628): No heartbeat from core client for 30 sec - exiting 08:58:15 (628): No heartbeat from core client for 30 sec - exiting 08:58:16 (628): No heartbeat from core client for 30 sec - exiting 08:58:17 (628): No heartbeat from core client for 30 sec - exiting 08:58:18 (628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2880, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=2 10:00:06 (4080): No heartbeat from core client for 30 sec - exiting 10:00:07 (4080): No heartbeat from core client for 30 sec - exiting 10:00:08 (4080): No heartbeat from core client for 30 sec - exiting 10:00:09 (4080): No heartbeat from core client for 30 sec - exiting 10:00:10 (4080): No heartbeat from core client for 30 sec - exiting 10:00:11 (4080): No heartbeat from core client for 30 sec - exiting 10:00:12 (4080): No heartbeat from core client for 30 sec - exiting 10:00:13 (4080): No heartbeat from core client for 30 sec - exiting 10:00:14 (4080): No heartbeat from core client for 30 sec - exiting 10:00:15 (4080): No heartbeat from core client for 30 sec - exiting 10:00:16 (4080): No heartbeat from core client for 30 sec - exiting 10:00:17 (4080): No heartbeat from core client for 30 sec - exiting 10:00:18 (4080): No heartbeat from core client for 30 sec - exiting 10:00:19 (4080): No heartbeat from core client for 30 sec - exiting 10:00:20 (4080): No heartbeat from core client for 30 sec - exiting 10:00:21 (4080): No heartbeat from core client for 30 sec - exiting 10:00:22 (4080): No heartbeat from core client for 30 sec - exiting 10:00:23 (4080): No heartbeat from core client for 30 sec - exiting 10:00:24 (4080): No heartbeat from core client for 30 sec - exiting 10:00:25 (4080): No heartbeat from core client for 30 sec - exiting 10:00:26 (4080): No heartbeat from core client for 30 sec - exiting 10:00:27 (4080): No heartbeat from core client for 30 sec - exiting 10:00:28 (4080): No heartbeat from core client for 30 sec - exiting 10:00:29 (4080): No heartbeat from core client for 30 sec - exiting 10:00:30 (4080): No heartbeat from core client for 30 sec - exiting 10:00:31 (4080): No heartbeat from core client for 30 sec - exiting 10:00:32 (4080): No heartbeat from core client for 30 sec - exiting 10:00:33 (4080): No heartbeat from core client for 30 sec - exiting 10:00:34 (4080): No heartbeat from core client for 30 sec - exiting 10:00:35 (4080): No heartbeat from core client for 30 sec - exiting 10:00:36 (4080): No heartbeat from core client for 30 sec - exiting 10:00:37 (4080): No heartbeat from core client for 30 sec - exiting 10:00:38 (4080): No heartbeat from core client for 30 sec - exiting 10:00:39 (4080): No heartbeat from core client for 30 sec - exiting 10:00:40 (4080): No heartbeat from core client for 30 sec - exiting 10:00:41 (4080): No heartbeat from core client for 30 sec - exiting 10:00:42 (4080): No heartbeat from core client for 30 sec - exiting 10:00:43 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:06:07 (2432): No heartbeat from core client for 30 sec - exiting 09:06:08 (2432): No heartbeat from core client for 30 sec - exiting 09:06:09 (2432): No heartbeat from core client for 30 sec - exiting 09:06:10 (2432): No heartbeat from core client for 30 sec - exiting 09:06:11 (2432): No heartbeat from core client for 30 sec - exiting 09:06:12 (2432): No heartbeat from core client for 30 sec - exiting 09:06:13 (2432): No heartbeat from core client for 30 sec - exiting 09:06:14 (2432): No heartbeat from core client for 30 sec - exiting 09:06:15 (2432): No heartbeat from core client for 30 sec - exiting 09:06:16 (2432): No heartbeat from core client for 30 sec - exiting 09:06:18 (2432): No heartbeat from core client for 30 sec - exiting 09:06:19 (2432): No heartbeat from core client for 30 sec - exiting 09:06:20 (2432): No heartbeat from core client for 30 sec - exiting 09:06:21 (2432): No heartbeat from core client for 30 sec - exiting 09:06:22 (2432): No heartbeat from core client for 30 sec - exiting 09:06:23 (2432): No heartbeat from core client for 30 sec - exiting 09:06:24 (2432): No heartbeat from core client for 30 sec - exiting 09:06:25 (2432): No heartbeat from core client for 30 sec - exiting 09:06:26 (2432): No heartbeat from core client for 30 sec - exiting 09:06:27 (2432): No heartbeat from core client for 30 sec - exiting 09:06:28 (2432): No heartbeat from core client for 30 sec - exiting 09:06:29 (2432): No heartbeat from core client for 30 sec - exiting 09:06:30 (2432): No heartbeat from core client for 30 sec - exiting 09:06:31 (2432): No heartbeat from core client for 30 sec - exiting 09:06:32 (2432): No heartbeat from core client for 30 sec - exiting 09:06:33 (2432): No heartbeat from core client for 30 sec - exiting 09:06:34 (2432): No heartbeat from core client for 30 sec - exiting 09:06:35 (2432): No heartbeat from core client for 30 sec - exiting 09:06:36 (2432): No heartbeat from core client for 30 sec - exiting 09:06:37 (2432): No heartbeat from core client for 30 sec - exiting 09:06:38 (2432): No heartbeat from core client for 30 sec - exiting 09:06:39 (2432): No heartbeat from core client for 30 sec - exiting 09:06:40 (2432): No heartbeat from core client for 30 sec - exiting 09:06:41 (2432): No heartbeat from core client for 30 sec - exiting 09:06:42 (2432): No heartbeat from core client for 30 sec - exiting 09:06:43 (2432): No heartbeat from core client for 30 sec - exiting 09:06:44 (2432): No heartbeat from core client for 30 sec - exiting 09:06:45 (2432): No heartbeat from core client for 30 sec - exiting 09:06:46 (2432): No heartbeat from core client for 30 sec - exiting 09:06:47 (2432): No heartbeat from core client for 30 sec - exiting 09:06:48 (2432): No heartbeat from core client for 30 sec - exiting 09:06:49 (2432): No heartbeat from core client for 30 sec - exiting 09:06:50 (2432): No heartbeat from core client for 30 sec - exiting 09:06:51 (2432): No heartbeat from core client for 30 sec - exiting 09:06:52 (2432): No heartbeat from core client for 30 sec - exiting 09:06:53 (2432): No heartbeat from core client for 30 sec - exiting 09:06:54 (2432): No heartbeat from core client for 30 sec - exiting 09:06:55 (2432): No heartbeat from core client for 30 sec - exiting 09:06:56 (2432): No heartbeat from core client for 30 sec - exiting 09:06:57 (2432): No heartbeat from core client for 30 sec - exiting 09:06:58 (2432): No heartbeat from core client for 30 sec - exiting 09:06:59 (2432): No heartbeat from core client for 30 sec - exiting 09:07:00 (2432): No heartbeat from core client for 30 sec - exiting 09:07:01 (2432): No heartbeat from core client for 30 sec - exiting 09:07:02 (2432): No heartbeat from core client for 30 sec - exiting 09:07:03 (2432): No heartbeat from core client for 30 sec - exiting 09:07:04 (2432): No heartbeat from core client for 30 sec - exiting 09:07:05 (2432): No heartbeat from core client for 30 sec - exiting 09:07:06 (2432): No heartbeat from core client for 30 sec - exiting 09:07:07 (2432): No heartbeat from core client for 30 sec - exiting 09:07:08 (2432): No heartbeat from core client for 30 sec - exiting 09:07:09 (2432): No heartbeat from core client for 30 sec - exiting 09:07:10 (2432): No heartbeat from core client for 30 sec - exiting 09:07:11 (2432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4140, selfPID=3548, iMonCtr=1 Model crash detected, will try to restart... 09:06:28 (1320): No heartbeat from core client for 30 sec - exiting 09:06:29 (1320): No heartbeat from core client for 30 sec - exiting 09:06:30 (1320): No heartbeat from core client for 30 sec - exiting 09:06:31 (1320): No heartbeat from core client for 30 sec - exiting 09:06:32 (1320): No heartbeat from core client for 30 sec - exiting 09:06:33 (1320): No heartbeat from core client for 30 sec - exiting 09:06:34 (1320): No heartbeat from core client for 30 sec - exiting 09:06:35 (1320): No heartbeat from core client for 30 sec - exiting 09:06:36 (1320): No heartbeat from core client for 30 sec - exiting 09:06:37 (1320): No heartbeat from core client for 30 sec - exiting 09:06:38 (1320): No heartbeat from core client for 30 sec - exiting 09:06:39 (1320): No heartbeat from core client for 30 sec - exiting 09:06:40 (1320): No heartbeat from core client for 30 sec - exiting 09:06:41 (1320): No heartbeat from core client for 30 sec - exiting 09:06:42 (1320): No heartbeat from core client for 30 sec - exiting 09:06:43 (1320): No heartbeat from core client for 30 sec - exiting 09:06:44 (1320): No heartbeat from core client for 30 sec - exiting 09:06:45 (1320): No heartbeat from core client for 30 sec - exiting 09:06:46 (1320): No heartbeat from core client for 30 sec - exiting 09:06:47 (1320): No heartbeat from core client for 30 sec - exiting 09:06:48 (1320): No heartbeat from core client for 30 sec - exiting 09:06:49 (1320): No heartbeat from core client for 30 sec - exiting 09:06:50 (1320): No heartbeat from core client for 30 sec - exiting 09:06:51 (1320): No heartbeat from core client for 30 sec - exiting 09:06:52 (1320): No heartbeat from core client for 30 sec - exiting 09:06:53 (1320): No heartbeat from core client for 30 sec - exiting 09:06:54 (1320): No heartbeat from core client for 30 sec - exiting 09:06:55 (1320): No heartbeat from core client for 30 sec - exiting 09:06:56 (1320): No heartbeat from core client for 30 sec - exiting 09:06:57 (1320): No heartbeat from core client for 30 sec - exiting 09:06:58 (1320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4148, iMonCtr=2 Model crash detected, will try to restart... 09:09:28 (3332): No heartbeat from core client for 30 sec - exiting 09:09:29 (3332): No heartbeat from core client for 30 sec - exiting 09:09:30 (3332): No heartbeat from core client for 30 sec - exiting 09:09:31 (3332): No heartbeat from core client for 30 sec - exiting 09:09:32 (3332): No heartbeat from core client for 30 sec - exiting 09:09:33 (3332): No heartbeat from core client for 30 sec - exiting 09:09:34 (3332): No heartbeat from core client for 30 sec - exiting 09:09:35 (3332): No heartbeat from core client for 30 sec - exiting 09:09:36 (3332): No heartbeat from core client for 30 sec - exiting 09:09:37 (3332): No heartbeat from core client for 30 sec - exiting 09:09:38 (3332): No heartbeat from core client for 30 sec - exiting 09:09:39 (3332): No heartbeat from core client for 30 sec - exiting 09:09:40 (3332): No heartbeat from core client for 30 sec - exiting 09:09:41 (3332): No heartbeat from core client for 30 sec - exiting 09:09:42 (3332): No heartbeat from core client for 30 sec - exiting 09:09:43 (3332): No heartbeat from core client for 30 sec - exiting 09:09:44 (3332): No heartbeat from core client for 30 sec - exiting 09:09:45 (3332): No heartbeat from core client for 30 sec - exiting 09:09:46 (3332): No heartbeat from core client for 30 sec - exiting 09:09:47 (3332): No heartbeat from core client for 30 sec - exiting 09:09:48 (3332): No heartbeat from core client for 30 sec - exiting 09:09:49 (3332): No heartbeat from core client for 30 sec - exiting 09:09:50 (3332): No heartbeat from core client for 30 sec - exiting 09:09:51 (3332): No heartbeat from core client for 30 sec - exiting 09:09:52 (3332): No heartbeat from core client for 30 sec - exiting 09:09:53 (3332): No heartbeat from core client for 30 sec - exiting 09:09:54 (3332): No heartbeat from core client for 30 sec - exiting 09:09:55 (3332): No heartbeat from core client for 30 sec - exiting 09:09:56 (3332): No heartbeat from core client for 30 sec - exiting 09:09:57 (3332): No heartbeat from core client for 30 sec - exiting 09:09:58 (3332): No heartbeat from core client for 30 sec - exiting 09:09:59 (3332): No heartbeat from core client for 30 sec - exiting 09:10:00 (3332): No heartbeat from core client for 30 sec - exiting 09:10:01 (3332): No heartbeat from core client for 30 sec - exiting 09:10:02 (3332): No heartbeat from core client for 30 sec - exiting 09:10:03 (3332): No heartbeat from core client for 30 sec - exiting 09:10:04 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5680, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5720, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4176, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4240, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:57:49 (1900): No heartbeat from core client for 30 sec - exiting 08:57:50 (1900): No heartbeat from core client for 30 sec - exiting 08:57:51 (1900): No heartbeat from core client for 30 sec - exiting 08:57:52 (1900): No heartbeat from core client for 30 sec - exiting 08:57:53 (1900): No heartbeat from core client for 30 sec - exiting 08:57:54 (1900): No heartbeat from core client for 30 sec - exiting 08:57:55 (1900): No heartbeat from core client for 30 sec - exiting 08:57:56 (1900): No heartbeat from core client for 30 sec - exiting 08:57:57 (1900): No heartbeat from core client for 30 sec - exiting 08:57:58 (1900): No heartbeat from core client for 30 sec - exiting 08:57:59 (1900): No heartbeat from core client for 30 sec - exiting 08:58:00 (1900): No heartbeat from core client for 30 sec - exiting 08:58:01 (1900): No heartbeat from core client for 30 sec - exiting 08:58:02 (1900): No heartbeat from core client for 30 sec - exiting 08:58:03 (1900): No heartbeat from core client for 30 sec - exiting 08:58:04 (1900): No heartbeat from core client for 30 sec - exiting 08:58:05 (1900): No heartbeat from core client for 30 sec - exiting 08:58:06 (1900): No heartbeat from core client for 30 sec - exiting 08:58:07 (1900): No heartbeat from core client for 30 sec - exiting 08:58:08 (1900): No heartbeat from core client for 30 sec - exiting 08:58:09 (1900): No heartbeat from core client for 30 sec - exiting 08:58:10 (1900): No heartbeat from core client for 30 sec - exiting 08:58:11 (1900): No heartbeat from core client for 30 sec - exiting 08:58:12 (1900): No heartbeat from core client for 30 sec - exiting 08:58:13 (1900): No heartbeat from core client for 30 sec - exiting 08:58:14 (1900): No heartbeat from core client for 30 sec - exiting 08:58:15 (1900): No heartbeat from core client for 30 sec - exiting 08:58:16 (1900): No heartbeat from core client for 30 sec - exiting 08:58:17 (1900): No heartbeat from core client for 30 sec - exiting 08:58:18 (1900): No heartbeat from core client for 30 sec - exiting 08:58:19 (1900): No heartbeat from core client for 30 sec - exiting 08:58:20 (1900): No heartbeat from core client for 30 sec - exiting 08:58:21 (1900): No heartbeat from core client for 30 sec - exiting 08:58:22 (1900): No heartbeat from core client for 30 sec - exiting 08:58:23 (1900): No heartbeat from core client for 30 sec - exiting 08:58:24 (1900): No heartbeat from core client for 30 sec - exiting 08:58:25 (1900): No heartbeat from core client for 30 sec - exiting 08:58:26 (1900): No heartbeat from core client for 30 sec - exiting 08:58:27 (1900): No heartbeat from core client for 30 sec - exiting 08:58:28 (1900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:51:09 (3000): No heartbeat from core client for 30 sec - exiting 09:51:10 (3000): No heartbeat from core client for 30 sec - exiting 09:51:11 (3000): No heartbeat from core client for 30 sec - exiting 09:51:12 (3000): No heartbeat from core client for 30 sec - exiting 09:51:13 (3000): No heartbeat from core client for 30 sec - exiting 09:51:14 (3000): No heartbeat from core client for 30 sec - exiting 09:51:15 (3000): No heartbeat from core client for 30 sec - exiting 09:51:16 (3000): No heartbeat from core client for 30 sec - exiting 09:51:17 (3000): No heartbeat from core client for 30 sec - exiting 09:51:18 (3000): No heartbeat from core client for 30 sec - exiting 09:51:19 (3000): No heartbeat from core client for 30 sec - exiting 09:51:20 (3000): No heartbeat from core client for 30 sec - exiting 09:51:21 (3000): No heartbeat from core client for 30 sec - exiting 09:51:22 (3000): No heartbeat from core client for 30 sec - exiting 09:51:23 (3000): No heartbeat from core client for 30 sec - exiting 09:51:24 (3000): No heartbeat from core client for 30 sec - exiting 09:51:25 (3000): No heartbeat from core client for 30 sec - exiting 09:51:26 (3000): No heartbeat from core client for 30 sec - exiting 09:51:27 (3000): No heartbeat from core client for 30 sec - exiting 09:51:28 (3000): No heartbeat from core client for 30 sec - exiting 09:51:29 (3000): No heartbeat from core client for 30 sec - exiting 09:51:30 (3000): No heartbeat from core client for 30 sec - exiting 09:51:31 (3000): No heartbeat from core client for 30 sec - exiting 09:51:32 (3000): No heartbeat from core client for 30 sec - exiting 09:51:33 (3000): No heartbeat from core client for 30 sec - exiting 09:51:34 (3000): No heartbeat from core client for 30 sec - exiting 09:51:35 (3000): No heartbeat from core client for 30 sec - exiting 09:51:36 (3000): No heartbeat from core client for 30 sec - exiting 09:51:37 (3000): No heartbeat from core client for 30 sec - exiting 09:51:38 (3000): No heartbeat from core client for 30 sec - exiting 09:51:39 (3000): No heartbeat from core client for 30 sec - exiting 09:51:40 (3000): No heartbeat from core client for 30 sec - exiting 09:51:41 (3000): No heartbeat from core client for 30 sec - exiting 09:51:42 (3000): No heartbeat from core client for 30 sec - exiting 09:51:43 (3000): No heartbeat from core client for 30 sec - exiting 09:51:44 (3000): No heartbeat from core client for 30 sec - exiting 09:51:45 (3000): No heartbeat from core client for 30 sec - exiting 09:51:46 (3000): No heartbeat from core client for 30 sec - exiting 09:51:47 (3000): No heartbeat from core client for 30 sec - exiting 09:51:48 (3000): No heartbeat from core client for 30 sec - exiting 09:51:49 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5000, selfPID=2488, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... cpdnmonitor: cannot open input file E:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_9c9s_1969_1_008156524/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_9c9s_1969_1_008156524/dataout/region_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_9c9s_1969_1_008156524_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9c9s_1969_1_008156524_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9c9s_1969_1_008156524_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9c9s_1969_1_008156524_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Sep 2012 08:04:20	1096534	15153563	hadam3p_eu_9c9s_1969_1_008156524_0	92,256	181,603	1.9685
10 Sep 2012 08:36:49	1096534	15153563	hadam3p_eu_9c9s_1969_1_008156524_0	80,736	158,498	1.9632
06 Sep 2012 08:38:08	1096534	15153563	hadam3p_eu_9c9s_1969_1_008156524_0	69,216	135,416	1.9564
04 Sep 2012 07:00:45	1096534	15153563	hadam3p_eu_9c9s_1969_1_008156524_0	57,696	112,402	1.9482
03 Sep 2012 22:43:18	1096534	15153563	hadam3p_eu_9c9s_1969_1_008156524_0	46,176	90,085	1.9509
03 Sep 2012 13:22:16	1096534	15153563	hadam3p_eu_9c9s_1969_1_008156524_0	34,656	67,316	1.9424
30 Aug 2012 07:40:42	1096534	15153563	hadam3p_eu_9c9s_1969_1_008156524_0	23,136	44,675	1.9310
27 Aug 2012 09:26:31	1096534	15153563	hadam3p_eu_9c9s_1969_1_008156524_0	11,616	21,969	1.8913