Task 15704909

Name	hadam3p_eu_qdnp_2011_1_008343490_0
Workunit	8494351
Created	5 Apr 2013, 13:48:58 UTC
Sent	6 Apr 2013, 9:56:47 UTC
Report deadline	19 Mar 2014, 15:16:47 UTC
Received	12 May 2013, 17:15:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-2 (0xFFFFFFFE) Unknown error code
Computer ID	1160100
Run time	2 days 3 hours 22 min 18 sec
CPU time	1 days 23 hours 46 min 18 sec
Validate state	Invalid
Credit	2,187.67
Device peak FLOPS	3.42 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -2 (0xfffffffe) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:16:13 (2588): No heartbeat from core client for 30 sec - exiting 11:16:14 (2588): No heartbeat from core client for 30 sec - exiting 11:16:15 (2588): No heartbeat from core client for 30 sec - exiting 11:16:16 (2588): No heartbeat from core client for 30 sec - exiting 11:16:17 (2588): No heartbeat from core client for 30 sec - exiting 11:16:19 (2588): No heartbeat from core client for 30 sec - exiting 11:16:20 (2588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:57:18 (3476): No heartbeat from core client for 30 sec - exiting 16:57:19 (3476): No heartbeat from core client for 30 sec - exiting 16:57:20 (3476): No heartbeat from core client for 30 sec - exiting 16:57:21 (3476): No heartbeat from core client for 30 sec - exiting 16:57:23 (3476): No heartbeat from core client for 30 sec - exiting 16:57:24 (3476): No heartbeat from core client for 30 sec - exiting 16:57:25 (3476): No heartbeat from core client for 30 sec - exiting 16:57:26 (3476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2560, selfPID=2700, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:45:05 (3372): No heartbeat from core client for 30 sec - exiting 08:45:06 (3372): No heartbeat from core client for 30 sec - exiting 08:45:07 (3372): No heartbeat from core client for 30 sec - exiting 08:45:08 (3372): No heartbeat from core client for 30 sec - exiting 08:45:09 (3372): No heartbeat from core client for 30 sec - exiting 08:45:10 (3372): No heartbeat from core client for 30 sec - exiting 08:45:11 (3372): No heartbeat from core client for 30 sec - exiting 08:45:12 (3372): No heartbeat from core client for 30 sec - exiting 08:45:13 (3372): No heartbeat from core client for 30 sec - exiting 08:45:14 (3372): No heartbeat from core client for 30 sec - exiting 08:45:15 (3372): No heartbeat from core client for 30 sec - exiting 08:45:17 (3372): No heartbeat from core client for 30 sec - exiting 08:45:18 (3372): No heartbeat from core client for 30 sec - exiting 08:45:19 (3372): No heartbeat from core client for 30 sec - exiting 08:45:20 (3372): No heartbeat from core client for 30 sec - exiting 08:45:21 (3372): No heartbeat from core client for 30 sec - exiting 08:45:22 (3372): No heartbeat from core client for 30 sec - exiting 08:45:23 (3372): No heartbeat from core client for 30 sec - exiting 08:45:24 (3372): No heartbeat from core client for 30 sec - exiting 08:45:25 (3372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=244, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=968, selfPID=1796, iMonCtr=1 Model crash detected, will try to restart... 23:04:17 (5056): No heartbeat from core client for 30 sec - exiting 23:04:18 (5056): No heartbeat from core client for 30 sec - exiting 23:04:19 (5056): No heartbeat from core client for 30 sec - exiting 23:04:20 (5056): No heartbeat from core client for 30 sec - exiting 23:04:22 (5056): No heartbeat from core client for 30 sec - exiting 23:04:23 (5056): No heartbeat from core client for 30 sec - exiting 23:04:24 (5056): No heartbeat from core client for 30 sec - exiting 23:04:25 (5056): No heartbeat from core client for 30 sec - exiting 23:04:26 (5056): No heartbeat from core client for 30 sec - exiting 23:04:27 (5056): No heartbeat from core client for 30 sec - exiting 23:04:28 (5056): No heartbeat from core client for 30 sec - exiting 23:04:29 (5056): No heartbeat from core client for 30 sec - exiting 23:04:30 (5056): No heartbeat from core client for 30 sec - exiting 23:04:31 (5056): No heartbeat from core client for 30 sec - exiting 23:04:32 (5056): No heartbeat from core client for 30 sec - exiting 23:04:34 (5056): No heartbeat from core client for 30 sec - exiting 23:04:35 (5056): No heartbeat from core client for 30 sec - exiting 23:04:36 (5056): No heartbeat from core client for 30 sec - exiting 23:04:37 (5056): No heartbeat from core client for 30 sec - exiting 23:04:38 (5056): No heartbeat from core client for 30 sec - exiting 23:04:39 (5056): No heartbeat from core client for 30 sec - exiting 23:04:40 (5056): No heartbeat from core client for 30 sec - exiting 23:04:41 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:46:43 (2572): No heartbeat from core client for 30 sec - exiting 11:46:44 (2572): No heartbeat from core client for 30 sec - exiting 11:46:45 (2572): No heartbeat from core client for 30 sec - exiting 11:46:47 (2572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:13:48 (4408): No heartbeat from core client for 30 sec - exiting 12:13:50 (4408): No heartbeat from core client for 30 sec - exiting 12:13:51 (4408): No heartbeat from core client for 30 sec - exiting 12:13:52 (4408): No heartbeat from core client for 30 sec - exiting 12:13:53 (4408): No heartbeat from core client for 30 sec - exiting 12:13:54 (4408): No heartbeat from core client for 30 sec - exiting 12:13:55 (4408): No heartbeat from core client for 30 sec - exiting 12:13:56 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:38:29 (4912): No heartbeat from core client for 30 sec - exiting 18:38:31 (4912): No heartbeat from core client for 30 sec - exiting 18:38:32 (4912): No heartbeat from core client for 30 sec - exiting 18:38:33 (4912): No heartbeat from core client for 30 sec - exiting 18:38:34 (4912): No heartbeat from core client for 30 sec - exiting 18:38:35 (4912): No heartbeat from core client for 30 sec - exiting 18:38:36 (4912): No heartbeat from core client for 30 sec - exiting 18:38:37 (4912): No heartbeat from core client for 30 sec - exiting 18:38:38 (4912): No heartbeat from core client for 30 sec - exiting 18:38:39 (4912): No heartbeat from core client for 30 sec - exiting 18:38:41 (4912): No heartbeat from core client for 30 sec - exiting 18:38:42 (4912): No heartbeat from core client for 30 sec - exiting 18:38:43 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:22:16 (4476): No heartbeat from core client for 30 sec - exiting 15:22:17 (4476): No heartbeat from core client for 30 sec - exiting 15:22:18 (4476): No heartbeat from core client for 30 sec - exiting 15:22:19 (4476): No heartbeat from core client for 30 sec - exiting 15:22:21 (4476): No heartbeat from core client for 30 sec - exiting 15:22:22 (4476): No heartbeat from core client for 30 sec - exiting 15:22:23 (4476): No heartbeat from core client for 30 sec - exiting 15:22:24 (4476): No heartbeat from core client for 30 sec - exiting 15:22:25 (4476): No heartbeat from core client for 30 sec - exiting 15:22:26 (4476): No heartbeat from core client for 30 sec - exiting 15:22:27 (4476): No heartbeat from core client for 30 sec - exiting 15:22:28 (4476): No heartbeat from core client for 30 sec - exiting 15:22:29 (4476): No heartbeat from core client for 30 sec - exiting 15:22:30 (4476): No heartbeat from core client for 30 sec - exiting 15:22:31 (4476): No heartbeat from core client for 30 sec - exiting 15:22:33 (4476): No heartbeat from core client for 30 sec - exiting 15:22:34 (4476): No heartbeat from core client for 30 sec - exiting 15:22:35 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:07:53 (3040): No heartbeat from core client for 30 sec - exiting 20:07:55 (3040): No heartbeat from core client for 30 sec - exiting 20:07:56 (3040): No heartbeat from core client for 30 sec - exiting 20:07:57 (3040): No heartbeat from core client for 30 sec - exiting 20:07:58 (3040): No heartbeat from core client for 30 sec - exiting 20:07:59 (3040): No heartbeat from core client for 30 sec - exiting 20:08:00 (3040): No heartbeat from core client for 30 sec - exiting 20:08:01 (3040): No heartbeat from core client for 30 sec - exiting 20:08:02 (3040): No heartbeat from core client for 30 sec - exiting 20:08:03 (3040): No heartbeat from core client for 30 sec - exiting 20:08:04 (3040): No heartbeat from core client for 30 sec - exiting 20:08:05 (3040): No heartbeat from core client for 30 sec - exiting 20:08:07 (3040): No heartbeat from core client for 30 sec - exiting 20:08:08 (3040): No heartbeat from core client for 30 sec - exiting 20:08:09 (3040): No heartbeat from core client for 30 sec - exiting 20:08:10 (3040): No heartbeat from core client for 30 sec - exiting 20:08:11 (3040): No heartbeat from core client for 30 sec - exiting 20:08:12 (3040): No heartbeat from core client for 30 sec - exiting 20:08:13 (3040): No heartbeat from core client for 30 sec - exiting 20:08:14 (3040): No heartbeat from core client for 30 sec - exiting 20:08:15 (3040): No heartbeat from core client for 30 sec - exiting 20:08:16 (3040): No heartbeat from core client for 30 sec - exiting 20:08:17 (3040): No heartbeat from core client for 30 sec - exiting 20:08:19 (3040): No heartbeat from core client for 30 sec - exiting 20:08:20 (3040): No heartbeat from core client for 30 sec - exiting 20:08:21 (3040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3324, selfPID=3324, iMonCtr=2 21:42:00 (2284): No heartbeat from core client for 30 sec - exiting 21:42:02 (2284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:41:17 (2928): No heartbeat from core client for 30 sec - exiting 22:41:19 (2928): No heartbeat from core client for 30 sec - exiting 22:41:20 (2928): No heartbeat from core client for 30 sec - exiting 22:41:21 (2928): No heartbeat from core client for 30 sec - exiting 22:41:22 (2928): No heartbeat from core client for 30 sec - exiting 22:41:23 (2928): No heartbeat from core client for 30 sec - exiting 22:41:24 (2928): No heartbeat from core client for 30 sec - exiting 22:41:25 (2928): No heartbeat from core client for 30 sec - exiting 22:41:27 (2928): No heartbeat from core client for 30 sec - exiting 22:41:28 (2928): No heartbeat from core client for 30 sec - exiting 22:41:29 (2928): No heartbeat from core client for 30 sec - exiting 22:41:30 (2928): No heartbeat from core client for 30 sec - exiting 22:41:31 (2928): No heartbeat from core client for 30 sec - exiting 22:41:32 (2928): No heartbeat from core client for 30 sec - exiting 22:41:33 (2928): No heartbeat from core client for 30 sec - exiting 22:41:34 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:41:35 (2928): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2688, iMonCtr=2 23:02:28 (4896): No heartbeat from core client for 30 sec - exiting 23:02:29 (4896): No heartbeat from core client for 30 sec - exiting 23:02:30 (4896): No heartbeat from core client for 30 sec - exiting 23:02:32 (4896): No heartbeat from core client for 30 sec - exiting 23:02:33 (4896): No heartbeat from core client for 30 sec - exiting 23:02:34 (4896): No heartbeat from core client for 30 sec - exiting 23:02:35 (4896): No heartbeat from core client for 30 sec - exiting 23:02:36 (4896): No heartbeat from core client for 30 sec - exiting 23:02:37 (4896): No heartbeat from core client for 30 sec - exiting 23:02:38 (4896): No heartbeat from core client for 30 sec - exiting 23:02:39 (4896): No heartbeat from core client for 30 sec - exiting 23:02:40 (4896): No heartbeat from core client for 30 sec - exiting 23:02:41 (4896): No heartbeat from core client for 30 sec - exiting 23:02:42 (4896): No heartbeat from core client for 30 sec - exiting 23:02:44 (4896): No heartbeat from core client for 30 sec - exiting 23:02:45 (4896): No heartbeat from core client for 30 sec - exiting 23:02:46 (4896): No heartbeat from core client for 30 sec - exiting 23:02:47 (4896): No heartbeat from core client for 30 sec - exiting 23:02:48 (4896): No heartbeat from core client for 30 sec - exiting 23:02:49 (4896): No heartbeat from core client for 30 sec - exiting 23:02:50 (4896): No heartbeat from core client for 30 sec - exiting 23:02:51 (4896): No heartbeat from core client for 30 sec - exiting 23:02:52 (4896): No heartbeat from core client for 30 sec - exiting 23:02:53 (4896): No heartbeat from core client for 30 sec - exiting 23:02:54 (4896): No heartbeat from core client for 30 sec - exiting 23:02:56 (4896): No heartbeat from core client for 30 sec - exiting 23:02:57 (4896): No heartbeat from core client for 30 sec - exiting 23:02:58 (4896): No heartbeat from core client for 30 sec - exiting 23:02:59 (4896): No heartbeat from core client for 30 sec - exiting 23:03:00 (4896): No heartbeat from core client for 30 sec - exiting 23:03:01 (4896): No heartbeat from core client for 30 sec - exiting 23:03:02 (4896): No heartbeat from core client for 30 sec - exiting 23:03:03 (4896): No heartbeat from core client for 30 sec - exiting 23:03:04 (4896): No heartbeat from core client for 30 sec - exiting 23:03:05 (4896): No heartbeat from core client for 30 sec - exiting 23:03:06 (4896): No heartbeat from core client for 30 sec - exiting 23:03:08 (4896): No heartbeat from core client for 30 sec - exiting 23:03:09 (4896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3336, selfPID=3840, iMonCtr=1 Model crash detected, will try to restart... 23:25:30 (3056): No heartbeat from core client for 30 sec - exiting 23:25:31 (3056): No heartbeat from core client for 30 sec - exiting 23:25:33 (3056): No heartbeat from core client for 30 sec - exiting 23:25:34 (3056): No heartbeat from core client for 30 sec - exiting 23:25:35 (3056): No heartbeat from core client for 30 sec - exiting 23:25:36 (3056): No heartbeat from core client for 30 sec - exiting 23:25:37 (3056): No heartbeat from core client for 30 sec - exiting 23:25:38 (3056): No heartbeat from core client for 30 sec - exiting 23:25:39 (3056): No heartbeat from core client for 30 sec - exiting 23:25:40 (3056): No heartbeat from core client for 30 sec - exiting 23:25:41 (3056): No heartbeat from core client for 30 sec - exiting 23:25:42 (3056): No heartbeat from core client for 30 sec - exiting 23:25:43 (3056): No heartbeat from core client for 30 sec - exiting 23:25:45 (3056): No heartbeat from core client for 30 sec - exiting 23:25:46 (3056): No heartbeat from core client for 30 sec - exiting 23:25:47 (3056): No heartbeat from core client for 30 sec - exiting 23:25:48 (3056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:25:49 (3056): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:41:46 (3376): No heartbeat from core client for 30 sec - exiting 23:41:47 (3376): No heartbeat from core client for 30 sec - exiting 23:41:48 (3376): No heartbeat from core client for 30 sec - exiting 23:41:49 (3376): No heartbeat from core client for 30 sec - exiting 23:41:50 (3376): No heartbeat from core client for 30 sec - exiting 23:41:51 (3376): No heartbeat from core client for 30 sec - exiting 23:41:52 (3376): No heartbeat from core client for 30 sec - exiting 23:41:53 (3376): No heartbeat from core client for 30 sec - exiting 23:41:54 (3376): No heartbeat from core client for 30 sec - exiting 23:41:56 (3376): No heartbeat from core client for 30 sec - exiting 23:41:57 (3376): No heartbeat from core client for 30 sec - exiting 23:41:58 (3376): No heartbeat from core client for 30 sec - exiting 23:41:59 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:00 (3376): No heartbeat from core client for 30 sec - exiting 00:31:41 (2236): No heartbeat from core client for 30 sec - exiting 00:31:42 (2236): No heartbeat from core client for 30 sec - exiting 00:31:43 (2236): No heartbeat from core client for 30 sec - exiting 00:31:44 (2236): No heartbeat from core client for 30 sec - exiting 00:31:45 (2236): No heartbeat from core client for 30 sec - exiting 00:31:47 (2236): No heartbeat from core client for 30 sec - exiting 00:31:48 (2236): No heartbeat from core client for 30 sec - exiting 00:31:49 (2236): No heartbeat from core client for 30 sec - exiting 00:31:50 (2236): No heartbeat from core client for 30 sec - exiting 00:31:51 (2236): No heartbeat from core client for 30 sec - exiting 00:31:52 (2236): No heartbeat from core client for 30 sec - exiting 00:31:53 (2236): No heartbeat from core client for 30 sec - exiting 00:31:54 (2236): No heartbeat from core client for 30 sec - exiting 00:31:55 (2236): No heartbeat from core client for 30 sec - exiting 00:31:56 (2236): No heartbeat from core client for 30 sec - exiting 00:31:58 (2236): No heartbeat from core client for 30 sec - exiting 00:31:59 (2236): No heartbeat from core client for 30 sec - exiting 00:32:00 (2236): No heartbeat from core client for 30 sec - exiting 00:32:01 (2236): No heartbeat from core client for 30 sec - exiting 00:32:02 (2236): No heartbeat from core client for 30 sec - exiting 00:32:03 (2236): No heartbeat from core client for 30 sec - exiting 00:32:04 (2236): No heartbeat from core client for 30 sec - exiting 00:32:05 (2236): No heartbeat from core client for 30 sec - exiting 00:32:06 (2236): No heartbeat from core client for 30 sec - exiting 00:32:07 (2236): No heartbeat from core client for 30 sec - exiting 00:32:08 (2236): No heartbeat from core client for 30 sec - exiting 00:32:10 (2236): No heartbeat from core client for 30 sec - exiting 00:32:11 (2236): No heartbeat from core client for 30 sec - exiting 00:32:12 (2236): No heartbeat from core client for 30 sec - exiting 00:32:13 (2236): No heartbeat from core client for 30 sec - exiting 00:32:14 (2236): No heartbeat from core client for 30 sec - exiting 00:32:15 (2236): No heartbeat from core client for 30 sec - exiting 00:32:16 (2236): No heartbeat from core client for 30 sec - exiting 00:32:17 (2236): No heartbeat from core client for 30 sec - exiting 00:32:18 (2236): No heartbeat from core client for 30 sec - exiting 00:32:19 (2236): No heartbeat from core client for 30 sec - exiting 00:32:20 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:14:51 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:09:41 (4112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:47 (2676): No heartbeat from core client for 30 sec - exiting 19:20:48 (2676): No heartbeat from core client for 30 sec - exiting 19:20:50 (2676): No heartbeat from core client for 30 sec - exiting 19:20:51 (2676): No heartbeat from core client for 30 sec - exiting 19:20:52 (2676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:06:19 (4056): No heartbeat from core client for 30 sec - exiting 21:06:20 (4056): No heartbeat from core client for 30 sec - exiting 21:06:21 (4056): No heartbeat from core client for 30 sec - exiting 21:06:22 (4056): No heartbeat from core client for 30 sec - exiting 21:06:24 (4056): No heartbeat from core client for 30 sec - exiting 21:06:25 (4056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 16:43:28 (4860): No heartbeat from core client for 30 sec - exiting 16:43:29 (4860): No heartbeat from core client for 30 sec - exiting 16:43:30 (4860): No heartbeat from core client for 30 sec - exiting 16:43:31 (4860): No heartbeat from core client for 30 sec - exiting 16:43:33 (4860): No heartbeat from core client for 30 sec - exiting 16:43:34 (4860): No heartbeat from core client for 30 sec - exiting 16:43:35 (4860): No heartbeat from core client for 30 sec - exiting 16:43:36 (4860): No heartbeat from core client for 30 sec - exiting 16:43:37 (4860): No heartbeat from core client for 30 sec - exiting 16:43:38 (4860): No heartbeat from core client for 30 sec - exiting 16:43:39 (4860): No heartbeat from core client for 30 sec - exiting 16:43:40 (4860): No heartbeat from core client for 30 sec - exiting 16:43:41 (4860): No heartbeat from core client for 30 sec - exiting 16:43:42 (4860): No heartbeat from core client for 30 sec - exiting 16:43:43 (4860): No heartbeat from core client for 30 sec - exiting 16:43:45 (4860): No heartbeat from core client for 30 sec - exiting 16:43:46 (4860): No heartbeat from core client for 30 sec - exiting 16:43:47 (4860): No heartbeat from core client for 30 sec - exiting 16:43:48 (4860): No heartbeat from core client for 30 sec - exiting 16:43:49 (4860): No heartbeat from core client for 30 sec - exiting 16:43:50 (4860): No heartbeat from core client for 30 sec - exiting 16:43:51 (4860): No heartbeat from core client for 30 sec - exiting 16:43:52 (4860): No heartbeat from core client for 30 sec - exiting 16:43:53 (4860): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Could not launch model process. Last Error=1018 Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 May 2013 19:41:02	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	126,816	158,977	1.2536
01 May 2013 14:25:35	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	115,296	144,557	1.2538
30 Apr 2013 23:41:23	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	103,776	130,233	1.2549
30 Apr 2013 15:30:51	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	92,256	115,436	1.2513
20 Apr 2013 17:57:55	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	80,736	101,017	1.2512
19 Apr 2013 11:24:33	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	69,216	86,768	1.2536
16 Apr 2013 21:37:47	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	57,696	72,258	1.2524
14 Apr 2013 12:27:46	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	46,176	57,471	1.2446
12 Apr 2013 16:00:57	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	34,656	43,161	1.2454
10 Apr 2013 10:18:45	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	23,136	28,953	1.2514
06 Apr 2013 15:50:44	1160100	15704909	hadam3p_eu_qdnp_2011_1_008343490_0	11,616	14,679	1.2637