Task 15486285

Name	hadcm3n_3fx4_1940_40_008258709_0
Workunit	8413833
Created	20 Dec 2012, 11:52:19 UTC
Sent	20 Dec 2012, 11:52:23 UTC
Report deadline	21 Mar 2013, 19:19:34 UTC
Received	25 Dec 2012, 0:59:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1241343
Run time	23 hours 4 min 56 sec
CPU time	20 hours 11 min 3 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	2.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:50:19 (8968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:14 (7880): No heartbeat from core client for 30 sec - exiting 19:56:15 (7880): No heartbeat from core client for 30 sec - exiting 19:56:16 (7880): No heartbeat from core client for 30 sec - exiting 19:56:17 (7880): No heartbeat from core client for 30 sec - exiting 19:56:18 (7880): No heartbeat from core client for 30 sec - exiting 19:56:19 (7880): No heartbeat from core client for 30 sec - exiting 19:56:20 (7880): No heartbeat from core client for 30 sec - exiting 19:56:21 (7880): No heartbeat from core client for 30 sec - exiting 19:56:22 (7880): No heartbeat from core client for 30 sec - exiting 19:56:23 (7880): No heartbeat from core client for 30 sec - exiting 19:56:24 (7880): No heartbeat from core client for 30 sec - exiting 19:56:25 (7880): No heartbeat from core client for 30 sec - exiting 19:56:26 (7880): No heartbeat from core client for 30 sec - exiting 19:56:27 (7880): No heartbeat from core client for 30 sec - exiting 19:56:28 (7880): No heartbeat from core client for 30 sec - exiting 19:56:29 (7880): No heartbeat from core client for 30 sec - exiting 19:56:30 (7880): No heartbeat from core client for 30 sec - exiting 19:56:31 (7880): No heartbeat from core client for 30 sec - exiting 19:56:32 (7880): No heartbeat from core client for 30 sec - exiting 19:56:33 (7880): No heartbeat from core client for 30 sec - exiting 19:56:34 (7880): No heartbeat from core client for 30 sec - exiting 19:56:35 (7880): No heartbeat from core client for 30 sec - exiting 19:56:36 (7880): No heartbeat from core client for 30 sec - exiting 19:56:37 (7880): No heartbeat from core client for 30 sec - exiting 19:56:38 (7880): No heartbeat from core client for 30 sec - exiting 19:56:39 (7880): No heartbeat from core client for 30 sec - exiting 19:56:40 (7880): No heartbeat from core client for 30 sec - exiting 19:56:41 (7880): No heartbeat from core client for 30 sec - exiting 19:56:42 (7880): No heartbeat from core client for 30 sec - exiting 19:56:43 (7880): No heartbeat from core client for 30 sec - exiting 19:56:44 (7880): No heartbeat from core client for 30 sec - exiting 19:56:45 (7880): No heartbeat from core client for 30 sec - exiting 19:56:46 (7880): No heartbeat from core client for 30 sec - exiting 19:56:47 (7880): No heartbeat from core client for 30 sec - exiting 19:56:48 (7880): No heartbeat from core client for 30 sec - exiting 19:56:49 (7880): No heartbeat from core client for 30 sec - exiting 19:56:50 (7880): No heartbeat from core client for 30 sec - exiting 19:56:51 (7880): No heartbeat from core client for 30 sec - exiting 19:56:52 (7880): No heartbeat from core client for 30 sec - exiting 19:56:53 (7880): No heartbeat from core client for 30 sec - exiting 19:56:54 (7880): No heartbeat from core client for 30 sec - exiting 19:56:55 (7880): No heartbeat from core client for 30 sec - exiting 19:56:56 (7880): No heartbeat from core client for 30 sec - exiting 19:56:57 (7880): No heartbeat from core client for 30 sec - exiting 19:56:58 (7880): No heartbeat from core client for 30 sec - exiting 19:56:59 (7880): No heartbeat from core client for 30 sec - exiting 19:57:00 (7880): No heartbeat from core client for 30 sec - exiting 19:57:01 (7880): No heartbeat from core client for 30 sec - exiting 19:57:02 (7880): No heartbeat from core client for 30 sec - exiting 19:57:03 (7880): No heartbeat from core client for 30 sec - exiting 19:57:04 (7880): No heartbeat from core client for 30 sec - exiting 19:57:05 (7880): No heartbeat from core client for 30 sec - exiting 19:57:06 (7880): No heartbeat from core client for 30 sec - exiting 19:57:07 (7880): No heartbeat from core client for 30 sec - exiting 19:57:08 (7880): No heartbeat from core client for 30 sec - exiting 19:57:09 (7880): No heartbeat from core client for 30 sec - exiting 19:57:10 (7880): No heartbeat from core client for 30 sec - exiting 19:57:11 (7880): No heartbeat from core client for 30 sec - exiting 19:57:12 (7880): No heartbeat from core client for 30 sec - exiting 19:57:13 (7880): No heartbeat from core client for 30 sec - exiting 19:57:14 (7880): No heartbeat from core client for 30 sec - exiting 19:57:15 (7880): No heartbeat from core client for 30 sec - exiting 19:57:16 (7880): No heartbeat from core client for 30 sec - exiting 19:57:17 (7880): No heartbeat from core client for 30 sec - exiting 19:57:18 (7880): No heartbeat from core client for 30 sec - exiting 19:57:19 (7880): No heartbeat from core client for 30 sec - exiting 19:57:20 (7880): No heartbeat from core client for 30 sec - exiting 19:57:21 (7880): No heartbeat from core client for 30 sec - exiting 19:57:22 (7880): No heartbeat from core client for 30 sec - exiting 19:57:23 (7880): No heartbeat from core client for 30 sec - exiting 19:57:24 (7880): No heartbeat from core client for 30 sec - exiting 19:57:25 (7880): No heartbeat from core client for 30 sec - exiting 19:57:26 (7880): No heartbeat from core client for 30 sec - exiting 19:57:27 (7880): No heartbeat from core client for 30 sec - exiting 19:57:28 (7880): No heartbeat from core client for 30 sec - exiting 19:57:29 (7880): No heartbeat from core client for 30 sec - exiting 19:57:30 (7880): No heartbeat from core client for 30 sec - exiting 19:57:31 (7880): No heartbeat from core client for 30 sec - exiting 19:57:32 (7880): No heartbeat from core client for 30 sec - exiting 19:57:33 (7880): No heartbeat from core client for 30 sec - exiting 19:57:34 (7880): No heartbeat from core client for 30 sec - exiting 19:57:35 (7880): No heartbeat from core client for 30 sec - exiting 19:57:36 (7880): No heartbeat from core client for 30 sec - exiting 19:57:37 (7880): No heartbeat from core client for 30 sec - exiting 19:57:38 (7880): No heartbeat from core client for 30 sec - exiting 19:57:39 (7880): No heartbeat from core client for 30 sec - exiting 19:57:40 (7880): No heartbeat from core client for 30 sec - exiting 19:57:41 (7880): No heartbeat from core client for 30 sec - exiting 19:57:42 (7880): No heartbeat from core client for 30 sec - exiting 19:57:43 (7880): No heartbeat from core client for 30 sec - exiting 19:57:44 (7880): No heartbeat from core client for 30 sec - exiting 19:57:45 (7880): No heartbeat from core client for 30 sec - exiting 19:57:46 (7880): No heartbeat from core client for 30 sec - exiting 19:57:47 (7880): No heartbeat from core client for 30 sec - exiting 19:57:48 (7880): No heartbeat from core client for 30 sec - exiting 19:57:49 (7880): No heartbeat from core client for 30 sec - exiting 19:57:50 (7880): No heartbeat from core client for 30 sec - exiting 19:57:51 (7880): No heartbeat from core client for 30 sec - exiting 19:57:52 (7880): No heartbeat from core client for 30 sec - exiting 19:57:53 (7880): No heartbeat from core client for 30 sec - exiting 19:57:54 (7880): No heartbeat from core client for 30 sec - exiting 19:57:55 (7880): No heartbeat from core client for 30 sec - exiting 19:57:56 (7880): No heartbeat from core client for 30 sec - exiting 19:57:57 (7880): No heartbeat from core client for 30 sec - exiting 19:57:58 (7880): No heartbeat from core client for 30 sec - exiting 19:57:59 (7880): No heartbeat from core client for 30 sec - exiting 19:58:00 (7880): No heartbeat from core client for 30 sec - exiting 19:58:01 (7880): No heartbeat from core client for 30 sec - exiting 19:58:02 (7880): No heartbeat from core client for 30 sec - exiting 19:58:03 (7880): No heartbeat from core client for 30 sec - exiting 19:58:04 (7880): No heartbeat from core client for 30 sec - exiting 19:58:05 (7880): No heartbeat from core client for 30 sec - exiting 19:58:06 (7880): No heartbeat from core client for 30 sec - exiting 19:58:07 (7880): No heartbeat from core client for 30 sec - exiting 19:58:08 (7880): No heartbeat from core client for 30 sec - exiting 19:58:09 (7880): No heartbeat from core client for 30 sec - exiting 19:58:10 (7880): No heartbeat from core client for 30 sec - exiting 19:58:11 (7880): No heartbeat from core client for 30 sec - exiting 19:58:12 (7880): No heartbeat from core client for 30 sec - exiting 19:58:13 (7880): No heartbeat from core client for 30 sec - exiting 19:58:14 (7880): No heartbeat from core client for 30 sec - exiting 19:58:15 (7880): No heartbeat from core client for 30 sec - exiting 19:58:16 (7880): No heartbeat from core client for 30 sec - exiting 19:58:17 (7880): No heartbeat from core client for 30 sec - exiting 19:58:18 (7880): No heartbeat from core client for 30 sec - exiting 19:58:19 (7880): No heartbeat from core client for 30 sec - exiting 19:58:20 (7880): No heartbeat from core client for 30 sec - exiting 19:58:21 (7880): No heartbeat from core client for 30 sec - exiting 19:58:22 (7880): No heartbeat from core client for 30 sec - exiting 19:58:23 (7880): No heartbeat from core client for 30 sec - exiting 19:58:25 (7880): No heartbeat from core client for 30 sec - exiting 19:58:26 (7880): No heartbeat from core client for 30 sec - exiting 19:58:27 (7880): No heartbeat from core client for 30 sec - exiting 19:58:28 (7880): No heartbeat from core client for 30 sec - exiting 19:58:29 (7880): No heartbeat from core client for 30 sec - exiting 19:58:30 (7880): No heartbeat from core client for 30 sec - exiting 19:58:31 (7880): No heartbeat from core client for 30 sec - exiting 19:58:32 (7880): No heartbeat from core client for 30 sec - exiting 19:58:33 (7880): No heartbeat from core client for 30 sec - exiting 19:58:34 (7880): No heartbeat from core client for 30 sec - exiting 19:58:35 (7880): No heartbeat from core client for 30 sec - exiting 19:58:36 (7880): No heartbeat from core client for 30 sec - exiting 19:58:37 (7880): No heartbeat from core client for 30 sec - exiting 19:58:38 (7880): No heartbeat from core client for 30 sec - exiting 19:58:39 (7880): No heartbeat from core client for 30 sec - exiting 19:58:40 (7880): No heartbeat from core client for 30 sec - exiting 19:58:41 (7880): No heartbeat from core client for 30 sec - exiting 19:58:42 (7880): No heartbeat from core client for 30 sec - exiting 19:58:43 (7880): No heartbeat from core client for 30 sec - exiting 19:58:44 (7880): No heartbeat from core client for 30 sec - exiting 19:58:45 (7880): No heartbeat from core client for 30 sec - exiting 19:58:46 (7880): No heartbeat from core client for 30 sec - exiting 19:58:47 (7880): No heartbeat from core client for 30 sec - exiting 19:58:48 (7880): No heartbeat from core client for 30 sec - exiting 19:58:49 (7880): No heartbeat from core client for 30 sec - exiting 19:58:50 (7880): No heartbeat from core client for 30 sec - exiting 19:58:51 (7880): No heartbeat from core client for 30 sec - exiting 19:58:52 (7880): No heartbeat from core client for 30 sec - exiting 19:58:53 (7880): No heartbeat from core client for 30 sec - exiting 19:58:54 (7880): No heartbeat from core client for 30 sec - exiting 19:58:55 (7880): No heartbeat from core client for 30 sec - exiting 19:58:56 (7880): No heartbeat from core client for 30 sec - exiting 19:58:57 (7880): No heartbeat from core client for 30 sec - exiting 19:58:58 (7880): No heartbeat from core client for 30 sec - exiting 19:58:59 (7880): No heartbeat from core client for 30 sec - exiting 19:59:00 (7880): No heartbeat from core client for 30 sec - exiting 19:59:01 (7880): No heartbeat from core client for 30 sec - exiting 19:59:02 (7880): No heartbeat from core client for 30 sec - exiting 19:59:03 (7880): No heartbeat from core client for 30 sec - exiting 19:59:04 (7880): No heartbeat from core client for 30 sec - exiting 19:59:05 (7880): No heartbeat from core client for 30 sec - exiting 19:59:06 (7880): No heartbeat from core client for 30 sec - exiting 19:59:07 (7880): No heartbeat from core client for 30 sec - exiting 19:59:08 (7880): No heartbeat from core client for 30 sec - exiting 19:59:09 (7880): No heartbeat from core client for 30 sec - exiting 19:59:10 (7880): No heartbeat from core client for 30 sec - exiting 19:59:11 (7880): No heartbeat from core client for 30 sec - exiting 19:59:12 (7880): No heartbeat from core client for 30 sec - exiting 19:59:13 (7880): No heartbeat from core client for 30 sec - exiting 19:59:14 (7880): No heartbeat from core client for 30 sec - exiting 19:59:15 (7880): No heartbeat from core client for 30 sec - exiting 19:59:16 (7880): No heartbeat from core client for 30 sec - exiting 19:59:17 (7880): No heartbeat from core client for 30 sec - exiting 19:59:18 (7880): No heartbeat from core client for 30 sec - exiting 19:59:19 (7880): No heartbeat from core client for 30 sec - exiting 19:59:20 (7880): No heartbeat from core client for 30 sec - exiting 19:59:21 (7880): No heartbeat from core client for 30 sec - exiting 19:59:22 (7880): No heartbeat from core client for 30 sec - exiting 19:59:23 (7880): No heartbeat from core client for 30 sec - exiting 19:59:24 (7880): No heartbeat from core client for 30 sec - exiting 19:59:25 (7880): No heartbeat from core client for 30 sec - exiting 19:59:26 (7880): No heartbeat from core client for 30 sec - exiting 19:59:27 (7880): No heartbeat from core client for 30 sec - exiting 19:59:28 (7880): No heartbeat from core client for 30 sec - exiting 19:59:29 (7880): No heartbeat from core client for 30 sec - exiting 19:59:30 (7880): No heartbeat from core client for 30 sec - exiting 19:59:31 (7880): No heartbeat from core client for 30 sec - exiting 19:59:32 (7880): No heartbeat from core client for 30 sec - exiting 19:59:33 (7880): No heartbeat from core client for 30 sec - exiting 19:59:34 (7880): No heartbeat from core client for 30 sec - exiting 19:59:35 (7880): No heartbeat from core client for 30 sec - exiting 19:59:36 (7880): No heartbeat from core client for 30 sec - exiting 19:59:37 (7880): No heartbeat from core client for 30 sec - exiting 19:59:38 (7880): No heartbeat from core client for 30 sec - exiting 19:59:39 (7880): No heartbeat from core client for 30 sec - exiting 19:59:40 (7880): No heartbeat from core client for 30 sec - exiting 19:59:41 (7880): No heartbeat from core client for 30 sec - exiting 19:59:42 (7880): No heartbeat from core client for 30 sec - exiting 19:59:43 (7880): No heartbeat from core client for 30 sec - exiting 19:59:44 (7880): No heartbeat from core client for 30 sec - exiting 19:59:45 (7880): No heartbeat from core client for 30 sec - exiting 19:59:46 (7880): No heartbeat from core client for 30 sec - exiting 19:59:47 (7880): No heartbeat from core client for 30 sec - exiting 19:59:48 (7880): No heartbeat from core client for 30 sec - exiting 19:59:49 (7880): No heartbeat from core client for 30 sec - exiting 19:59:50 (7880): No heartbeat from core client for 30 sec - exiting 19:59:51 (7880): No heartbeat from core client for 30 sec - exiting 19:59:52 (7880): No heartbeat from core client for 30 sec - exiting 19:59:53 (7880): No heartbeat from core client for 30 sec - exiting 19:59:54 (7880): No heartbeat from core client for 30 sec - exiting 19:59:55 (7880): No heartbeat from core client for 30 sec - exiting 19:59:56 (7880): No heartbeat from core client for 30 sec - exiting 19:59:57 (7880): No heartbeat from core client for 30 sec - exiting 19:59:58 (7880): No heartbeat from core client for 30 sec - exiting 19:59:59 (7880): No heartbeat from core client for 30 sec - exiting 20:00:00 (7880): No heartbeat from core client for 30 sec - exiting 20:00:01 (7880): No heartbeat from core client for 30 sec - exiting 20:00:02 (7880): No heartbeat from core client for 30 sec - exiting 20:00:03 (7880): No heartbeat from core client for 30 sec - exiting 20:00:04 (7880): No heartbeat from core client for 30 sec - exiting 20:00:05 (7880): No heartbeat from core client for 30 sec - exiting 20:00:06 (7880): No heartbeat from core client for 30 sec - exiting 20:00:07 (7880): No heartbeat from core client for 30 sec - exiting 20:00:08 (7880): No heartbeat from core client for 30 sec - exiting 20:00:09 (7880): No heartbeat from core client for 30 sec - exiting 20:00:10 (7880): No heartbeat from core client for 30 sec - exiting 20:00:11 (7880): No heartbeat from core client for 30 sec - exiting 20:00:12 (7880): No heartbeat from core client for 30 sec - exiting 20:00:13 (7880): No heartbeat from core client for 30 sec - exiting 20:00:14 (7880): No heartbeat from core client for 30 sec - exiting 20:00:15 (7880): No heartbeat from core client for 30 sec - exiting 20:00:16 (7880): No heartbeat from core client for 30 sec - exiting 20:00:17 (7880): No heartbeat from core client for 30 sec - exiting 20:00:18 (7880): No heartbeat from core client for 30 sec - exiting 20:00:19 (7880): No heartbeat from core client for 30 sec - exiting 20:00:20 (7880): No heartbeat from core client for 30 sec - exiting 20:00:21 (7880): No heartbeat from core client for 30 sec - exiting 20:00:22 (7880): No heartbeat from core client for 30 sec - exiting 20:00:23 (7880): No heartbeat from core client for 30 sec - exiting 20:00:24 (7880): No heartbeat from core client for 30 sec - exiting 20:00:25 (7880): No heartbeat from core client for 30 sec - exiting 20:00:26 (7880): No heartbeat from core client for 30 sec - exiting 20:00:27 (7880): No heartbeat from core client for 30 sec - exiting 20:00:28 (7880): No heartbeat from core client for 30 sec - exiting 20:00:29 (7880): No heartbeat from core client for 30 sec - exiting 20:00:30 (7880): No heartbeat from core client for 30 sec - exiting 20:00:31 (7880): No heartbeat from core client for 30 sec - exiting 20:00:32 (7880): No heartbeat from core client for 30 sec - exiting 20:00:33 (7880): No heartbeat from core client for 30 sec - exiting 20:00:34 (7880): No heartbeat from core client for 30 sec - exiting 20:00:35 (7880): No heartbeat from core client for 30 sec - exiting 20:00:36 (7880): No heartbeat from core client for 30 sec - exiting 20:00:37 (7880): No heartbeat from core client for 30 sec - exiting 20:00:38 (7880): No heartbeat from core client for 30 sec - exiting 20:00:39 (7880): No heartbeat from core client for 30 sec - exiting 20:00:40 (7880): No heartbeat from core client for 30 sec - exiting 20:00:41 (7880): No heartbeat from core client for 30 sec - exiting 20:00:42 (7880): No heartbeat from core client for 30 sec - exiting 20:00:43 (7880): No heartbeat from core client for 30 sec - exiting 20:00:44 (7880): No heartbeat from core client for 30 sec - exiting 20:00:45 (7880): No heartbeat from core client for 30 sec - exiting 20:00:46 (7880): No heartbeat from core client for 30 sec - exiting 20:00:47 (7880): No heartbeat from core client for 30 sec - exiting 20:00:48 (7880): No heartbeat from core client for 30 sec - exiting 20:00:49 (7880): No heartbeat from core client for 30 sec - exiting 20:00:50 (7880): No heartbeat from core client for 30 sec - exiting 20:00:51 (7880): No heartbeat from core client for 30 sec - exiting 20:00:52 (7880): No heartbeat from core client for 30 sec - exiting 20:00:53 (7880): No heartbeat from core client for 30 sec - exiting 20:00:54 (7880): No heartbeat from core client for 30 sec - exiting 20:00:55 (7880): No heartbeat from core client for 30 sec - exiting 20:00:56 (7880): No heartbeat from core client for 30 sec - exiting 20:00:57 (7880): No heartbeat from core client for 30 sec - exiting 20:00:58 (7880): No heartbeat from core client for 30 sec - exiting 20:00:59 (7880): No heartbeat from core client for 30 sec - exiting 20:01:00 (7880): No heartbeat from core client for 30 sec - exiting 20:01:01 (7880): No heartbeat from core client for 30 sec - exiting 20:01:02 (7880): No heartbeat from core client for 30 sec - exiting 20:01:03 (7880): No heartbeat from core client for 30 sec - exiting 20:01:04 (7880): No heartbeat from core client for 30 sec - exiting 20:01:05 (7880): No heartbeat from core client for 30 sec - exiting 20:01:06 (7880): No heartbeat from core client for 30 sec - exiting 20:01:07 (7880): No heartbeat from core client for 30 sec - exiting 20:01:08 (7880): No heartbeat from core client for 30 sec - exiting 20:01:09 (7880): No heartbeat from core client for 30 sec - exiting 20:01:10 (7880): No heartbeat from core client for 30 sec - exiting 20:08:36 (7880): No heartbeat from core client for 30 sec - exiting 20:08:37 (7880): No heartbeat from core client for 30 sec - exiting 20:08:38 (7880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2780, selfPID=2780, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:08:58 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:16:25 (7904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6592, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Dec 2012 19:42:33	1241343	15486285	hadcm3n_3fx4_1940_40_008258709_0	25,920	58,755	2.2668