Task 13552362

Name	hadcm3n_yj4q_1900_40_007523334_0
Workunit	7720809
Created	28 Oct 2011, 13:22:07 UTC
Sent	31 Oct 2011, 14:56:46 UTC
Report deadline	30 Jan 2012, 22:23:57 UTC
Received	7 Aug 2012, 12:55:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1176799
Run time	3 days 20 hours 37 min 38 sec
CPU time	3 days 17 hours 4 min 23 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	1.51 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5920, iMonCtr=1 Model crash detected, will try to restart... 07:44:59 (5432): No heartbeat from core client for 30 sec - exiting 07:45:00 (5432): No heartbeat from core client for 30 sec - exiting 07:45:01 (5432): No heartbeat from core client for 30 sec - exiting 07:45:02 (5432): No heartbeat from core client for 30 sec - exiting 07:45:04 (5432): No heartbeat from core client for 30 sec - exiting 07:45:05 (5432): No heartbeat from core client for 30 sec - exiting 07:45:06 (5432): No heartbeat from core client for 30 sec - exiting 07:45:07 (5432): No heartbeat from core client for 30 sec - exiting 07:45:08 (5432): No heartbeat from core client for 30 sec - exiting 07:45:09 (5432): No heartbeat from core client for 30 sec - exiting 07:45:10 (5432): No heartbeat from core client for 30 sec - exiting 07:45:11 (5432): No heartbeat from core client for 30 sec - exiting 07:45:12 (5432): No heartbeat from core client for 30 sec - exiting 07:45:13 (5432): No heartbeat from core client for 30 sec - exiting 07:45:14 (5432): No heartbeat from core client for 30 sec - exiting 07:45:16 (5432): No heartbeat from core client for 30 sec - exiting 07:45:17 (5432): No heartbeat from core client for 30 sec - exiting 07:45:18 (5432): No heartbeat from core client for 30 sec - exiting 07:45:19 (5432): No heartbeat from core client for 30 sec - exiting 07:45:20 (5432): No heartbeat from core client for 30 sec - exiting 07:45:21 (5432): No heartbeat from core client for 30 sec - exiting 07:45:22 (5432): No heartbeat from core client for 30 sec - exiting 07:45:23 (5432): No heartbeat from core client for 30 sec - exiting 07:45:24 (5432): No heartbeat from core client for 30 sec - exiting 07:45:25 (5432): No heartbeat from core client for 30 sec - exiting 07:45:26 (5432): No heartbeat from core client for 30 sec - exiting 07:45:28 (5432): No heartbeat from core client for 30 sec - exiting 07:45:29 (5432): No heartbeat from core client for 30 sec - exiting 07:45:30 (5432): No heartbeat from core client for 30 sec - exiting 07:45:31 (5432): No heartbeat from core client for 30 sec - exiting 07:45:32 (5432): No heartbeat from core client for 30 sec - exiting 07:45:33 (5432): No heartbeat from core client for 30 sec - exiting 07:45:34 (5432): No heartbeat from core client for 30 sec - exiting 07:45:35 (5432): No heartbeat from core client for 30 sec - exiting 07:45:36 (5432): No heartbeat from core client for 30 sec - exiting 07:45:37 (5432): No heartbeat from core client for 30 sec - exiting 07:45:38 (5432): No heartbeat from core client for 30 sec - exiting 07:45:40 (5432): No heartbeat from core client for 30 sec - exiting 07:45:41 (5432): No heartbeat from core client for 30 sec - exiting 07:45:42 (5432): No heartbeat from core client for 30 sec - exiting 07:45:43 (5432): No heartbeat from core client for 30 sec - exiting 07:45:44 (5432): No heartbeat from core client for 30 sec - exiting 07:45:45 (5432): No heartbeat from core client for 30 sec - exiting 07:45:46 (5432): No heartbeat from core client for 30 sec - exiting 07:45:47 (5432): No heartbeat from core client for 30 sec - exiting 07:45:48 (5432): No heartbeat from core client for 30 sec - exiting 07:45:49 (5432): No heartbeat from core client for 30 sec - exiting 07:45:50 (5432): No heartbeat from core client for 30 sec - exiting 07:45:52 (5432): No heartbeat from core client for 30 sec - exiting 07:45:53 (5432): No heartbeat from core client for 30 sec - exiting 07:45:54 (5432): No heartbeat from core client for 30 sec - exiting 07:45:55 (5432): No heartbeat from core client for 30 sec - exiting 07:45:56 (5432): No heartbeat from core client for 30 sec - exiting 07:45:57 (5432): No heartbeat from core client for 30 sec - exiting 07:45:58 (5432): No heartbeat from core client for 30 sec - exiting 07:45:59 (5432): No heartbeat from core client for 30 sec - exiting 07:46:00 (5432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:59:07 (3260): No heartbeat from core client for 30 sec - exiting 08:59:08 (3260): No heartbeat from core client for 30 sec - exiting 08:59:10 (3260): No heartbeat from core client for 30 sec - exiting 08:59:11 (3260): No heartbeat from core client for 30 sec - exiting 08:59:12 (3260): No heartbeat from core client for 30 sec - exiting 08:59:13 (3260): No heartbeat from core client for 30 sec - exiting 08:59:14 (3260): No heartbeat from core client for 30 sec - exiting 08:59:15 (3260): No heartbeat from core client for 30 sec - exiting 08:59:16 (3260): No heartbeat from core client for 30 sec - exiting 08:59:17 (3260): No heartbeat from core client for 30 sec - exiting 08:59:18 (3260): No heartbeat from core client for 30 sec - exiting 08:59:19 (3260): No heartbeat from core client for 30 sec - exiting 08:59:20 (3260): No heartbeat from core client for 30 sec - exiting 08:59:22 (3260): No heartbeat from core client for 30 sec - exiting 08:59:23 (3260): No heartbeat from core client for 30 sec - exiting 08:59:24 (3260): No heartbeat from core client for 30 sec - exiting 08:59:25 (3260): No heartbeat from core client for 30 sec - exiting 08:59:26 (3260): No heartbeat from core client for 30 sec - exiting 08:59:27 (3260): No heartbeat from core client for 30 sec - exiting 08:59:28 (3260): No heartbeat from core client for 30 sec - exiting 08:59:29 (3260): No heartbeat from core client for 30 sec - exiting 08:59:30 (3260): No heartbeat from core client for 30 sec - exiting 08:59:31 (3260): No heartbeat from core client for 30 sec - exiting 08:59:32 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:47:02 (7776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:56 (7856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:54:26 (7856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:54:44 (4548): No heartbeat from core client for 30 sec - exiting 15:54:45 (4548): No heartbeat from core client for 30 sec - exiting 15:54:46 (4548): No heartbeat from core client for 30 sec - exiting 15:54:47 (4548): No heartbeat from core client for 30 sec - exiting 15:54:48 (4548): No heartbeat from core client for 30 sec - exiting 15:54:49 (4548): No heartbeat from core client for 30 sec - exiting 15:54:50 (4548): No heartbeat from core client for 30 sec - exiting 15:54:51 (4548): No heartbeat from core client for 30 sec - exiting 15:54:53 (4548): No heartbeat from core client for 30 sec - exiting 15:54:54 (4548): No heartbeat from core client for 30 sec - exiting 15:54:55 (4548): No heartbeat from core client for 30 sec - exiting 15:54:56 (4548): No heartbeat from core client for 30 sec - exiting 15:54:57 (4548): No heartbeat from core client for 30 sec - exiting 15:54:58 (4548): No heartbeat from core client for 30 sec - exiting 15:54:59 (4548): No heartbeat from core client for 30 sec - exiting 15:55:00 (4548): No heartbeat from core client for 30 sec - exiting 15:55:01 (4548): No heartbeat from core client for 30 sec - exiting 15:55:02 (4548): No heartbeat from core client for 30 sec - exiting 15:55:03 (4548): No heartbeat from core client for 30 sec - exiting 15:55:04 (4548): No heartbeat from core client for 30 sec - exiting 15:55:05 (4548): No heartbeat from core client for 30 sec - exiting 15:55:07 (4548): No heartbeat from core client for 30 sec - exiting 15:55:08 (4548): No heartbeat from core client for 30 sec - exiting 15:55:09 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:10 (4548): No heartbeat from core client for 30 sec - exiting 15:55:11 (4548): No heartbeat from core client for 30 sec - exiting 15:55:12 (4548): No heartbeat from core client for 30 sec - exiting 15:55:13 (4548): No heartbeat from core client for 30 sec - exiting 15:55:14 (4548): No heartbeat from core client for 30 sec - exiting 15:55:15 (4548): No heartbeat from core client for 30 sec - exiting 15:55:16 (4548): No heartbeat from core client for 30 sec - exiting 15:55:17 (4548): No heartbeat from core client for 30 sec - exiting 15:55:19 (4548): No heartbeat from core client for 30 sec - exiting 15:55:20 (4548): No heartbeat from core client for 30 sec - exiting 15:21:03 (5804): No heartbeat from core client for 30 sec - exiting 15:21:04 (5804): No heartbeat from core client for 30 sec - exiting 15:21:06 (5804): No heartbeat from core client for 30 sec - exiting 15:21:07 (5804): No heartbeat from core client for 30 sec - exiting 15:21:08 (5804): No heartbeat from core client for 30 sec - exiting 15:21:09 (5804): No heartbeat from core client for 30 sec - exiting 15:21:10 (5804): No heartbeat from core client for 30 sec - exiting 15:21:11 (5804): No heartbeat from core client for 30 sec - exiting 15:21:12 (5804): No heartbeat from core client for 30 sec - exiting 15:21:13 (5804): No heartbeat from core client for 30 sec - exiting 15:21:14 (5804): No heartbeat from core client for 30 sec - exiting 15:21:15 (5804): No heartbeat from core client for 30 sec - exiting 15:21:16 (5804): No heartbeat from core client for 30 sec - exiting 15:21:18 (5804): No heartbeat from core client for 30 sec - exiting 15:21:19 (5804): No heartbeat from core client for 30 sec - exiting 15:21:20 (5804): No heartbeat from core client for 30 sec - exiting 15:21:21 (5804): No heartbeat from core client for 30 sec - exiting 15:21:22 (5804): No heartbeat from core client for 30 sec - exiting 15:21:23 (5804): No heartbeat from core client for 30 sec - exiting 15:21:24 (5804): No heartbeat from core client for 30 sec - exiting 15:21:25 (5804): No heartbeat from core client for 30 sec - exiting 15:21:26 (5804): No heartbeat from core client for 30 sec - exiting 15:21:28 (5804): No heartbeat from core client for 30 sec - exiting 15:21:29 (5804): No heartbeat from core client for 30 sec - exiting 15:21:30 (5804): No heartbeat from core client for 30 sec - exiting 15:21:31 (5804): No heartbeat from core client for 30 sec - exiting 15:21:32 (5804): No heartbeat from core client for 30 sec - exiting 15:21:33 (5804): No heartbeat from core client for 30 sec - exiting 15:21:34 (5804): No heartbeat from core client for 30 sec - exiting 15:21:35 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6200, selfPID=6200, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6632, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... 12:20:50 (6452): No heartbeat from core client for 30 sec - exiting 12:20:52 (6452): No heartbeat from core client for 30 sec - exiting 12:20:53 (6452): No heartbeat from core client for 30 sec - exiting 12:20:54 (6452): No heartbeat from core client for 30 sec - exiting 12:20:55 (6452): No heartbeat from core client for 30 sec - exiting 12:20:56 (6452): No heartbeat from core client for 30 sec - exiting 12:20:57 (6452): No heartbeat from core client for 30 sec - exiting 12:20:58 (6452): No heartbeat from core client for 30 sec - exiting 12:20:59 (6452): No heartbeat from core client for 30 sec - exiting 12:21:00 (6452): No heartbeat from core client for 30 sec - exiting 12:21:02 (6452): No heartbeat from core client for 30 sec - exiting 12:21:03 (6452): No heartbeat from core client for 30 sec - exiting 12:21:04 (6452): No heartbeat from core client for 30 sec - exiting 12:21:05 (6452): No heartbeat from core client for 30 sec - exiting 12:21:06 (6452): No heartbeat from core client for 30 sec - exiting 12:21:07 (6452): No heartbeat from core client for 30 sec - exiting 12:21:08 (6452): No heartbeat from core client for 30 sec - exiting 12:21:09 (6452): No heartbeat from core client for 30 sec - exiting 12:21:10 (6452): No heartbeat from core client for 30 sec - exiting 12:21:11 (6452): No heartbeat from core client for 30 sec - exiting 12:21:13 (6452): No heartbeat from core client for 30 sec - exiting 12:21:14 (6452): No heartbeat from core client for 30 sec - exiting 12:21:15 (6452): No heartbeat from core client for 30 sec - exiting 12:21:16 (6452): No heartbeat from core client for 30 sec - exiting 12:21:17 (6452): No heartbeat from core client for 30 sec - exiting 12:21:18 (6452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:19 (6452): No heartbeat from core client for 30 sec - exiting 12:21:20 (6452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:38:27 (7804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:01:18 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:53:42 (6424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:30:55 (8952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:56 (8952): No heartbeat from core client for 30 sec - exiting 07:30:57 (8952): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8304, iMonCtr=1 Model crash detected, will try to restart... 07:38:21 (8304): No heartbeat from core client for 30 sec - exiting 07:38:22 (8304): No heartbeat from core client for 30 sec - exiting 07:38:23 (8304): No heartbeat from core client for 30 sec - exiting 07:38:24 (8304): No heartbeat from core client for 30 sec - exiting 07:38:25 (8304): No heartbeat from core client for 30 sec - exiting 07:38:26 (8304): No heartbeat from core client for 30 sec - exiting 07:38:27 (8304): No heartbeat from core client for 30 sec - exiting 07:38:28 (8304): No heartbeat from core client for 30 sec - exiting 07:38:29 (8304): No heartbeat from core client for 30 sec - exiting 07:38:30 (8304): No heartbeat from core client for 30 sec - exiting 07:38:31 (8304): No heartbeat from core client for 30 sec - exiting 07:38:32 (8304): No heartbeat from core client for 30 sec - exiting 07:38:33 (8304): No heartbeat from core client for 30 sec - exiting 07:38:34 (8304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:35 (8304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 13:25:02 (368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:49:42 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:11:06 (7564): No heartbeat from core client for 30 sec - exiting 14:11:07 (7564): No heartbeat from core client for 30 sec - exiting 14:11:08 (7564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:32:53 (7128): No heartbeat from core client for 30 sec - exiting 14:32:54 (7128): No heartbeat from core client for 30 sec - exiting 14:32:55 (7128): No heartbeat from core client for 30 sec - exiting 14:32:56 (7128): No heartbeat from core client for 30 sec - exiting 14:32:57 (7128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:28:22 (8572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:44:42 (10020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:55:01 (1160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:05:15 (2744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:09:51 (8856): No heartbeat from core client for 30 sec - exiting 19:09:52 (8856): No heartbeat from core client for 30 sec - exiting 19:09:53 (8856): No heartbeat from core client for 30 sec - exiting 19:09:54 (8856): No heartbeat from core client for 30 sec - exiting 19:09:55 (8856): No heartbeat from core client for 30 sec - exiting 19:09:56 (8856): No heartbeat from core client for 30 sec - exiting 19:09:57 (8856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:25:07 (2028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:29:18 (8188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:34:58 (7680): No heartbeat from core client for 30 sec - exiting 07:35:00 (7680): No heartbeat from core client for 30 sec - exiting 07:35:01 (7680): No heartbeat from core client for 30 sec - exiting 07:35:02 (7680): No heartbeat from core client for 30 sec - exiting 07:35:03 (7680): No heartbeat from core client for 30 sec - exiting 07:35:04 (7680): No heartbeat from core client for 30 sec - exiting 07:35:05 (7680): No heartbeat from core client for 30 sec - exiting 07:35:06 (7680): No heartbeat from core client for 30 sec - exiting 07:35:08 (7680): No heartbeat from core client for 30 sec - exiting 07:35:09 (7680): No heartbeat from core client for 30 sec - exiting 07:35:10 (7680): No heartbeat from core client for 30 sec - exiting 07:35:11 (7680): No heartbeat from core client for 30 sec - exiting 07:35:12 (7680): No heartbeat from core client for 30 sec - exiting 07:35:13 (7680): No heartbeat from core client for 30 sec - exiting 07:35:14 (7680): No heartbeat from core client for 30 sec - exiting 07:35:15 (7680): No heartbeat from core client for 30 sec - exiting 07:35:17 (7680): No heartbeat from core client for 30 sec - exiting 07:35:18 (7680): No heartbeat from core client for 30 sec - exiting 07:35:19 (7680): No heartbeat from core client for 30 sec - exiting 07:35:20 (7680): No heartbeat from core client for 30 sec - exiting 07:35:21 (7680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 07:51:44 (4400): No heartbeat from core client for 30 sec - exiting 07:51:45 (4400): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jul 2012 18:15:17	1176799	13552362	hadcm3n_yj4q_1900_40_007523334_0	77,760	249,159	3.2042
24 Jul 2012 15:20:43	1176799	13552362	hadcm3n_yj4q_1900_40_007523334_0	51,840	164,081	3.1651
16 Jul 2012 20:27:16	1176799	13552362	hadcm3n_yj4q_1900_40_007523334_0	25,920	82,405	3.1792