Task 14037412

Name	hadcm3n_t4ov_1940_40_007743049_2
Workunit	7898157
Created	31 Jan 2012, 8:55:21 UTC
Sent	31 Jan 2012, 9:11:14 UTC
Report deadline	1 May 2012, 16:38:25 UTC
Received	17 Feb 2012, 10:06:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1189159
Run time	4 days 22 hours 49 min 47 sec
CPU time	2 days 20 hours 46 min 32 sec
Validate state	Invalid
Credit	1,866.24
Device peak FLOPS	2.50 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:15:40 (16912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:15:41 (16912): No heartbeat from core client for 30 sec - exiting 16:15:42 (16912): No heartbeat from core client for 30 sec - exiting 16:15:43 (16912): No heartbeat from core client for 30 sec - exiting 16:15:44 (16912): No heartbeat from core client for 30 sec - exiting 16:15:45 (16912): No heartbeat from core client for 30 sec - exiting 16:15:46 (16912): No heartbeat from core client for 30 sec - exiting 16:15:47 (16912): No heartbeat from core client for 30 sec - exiting 16:15:48 (16912): No heartbeat from core client for 30 sec - exiting 16:15:49 (16912): No heartbeat from core client for 30 sec - exiting 16:15:50 (16912): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:56:50 (9520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:45:47 (15968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:29 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:30 (5632): No heartbeat from core client for 30 sec - exiting 05:40:31 (5632): No heartbeat from core client for 30 sec - exiting 05:40:32 (5632): No heartbeat from core client for 30 sec - exiting 06:42:49 (14996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:42:50 (14996): No heartbeat from core client for 30 sec - exiting 06:42:51 (14996): No heartbeat from core client for 30 sec - exiting 06:42:52 (14996): No heartbeat from core client for 30 sec - exiting 06:42:53 (14996): No heartbeat from core client for 30 sec - exiting 06:42:54 (14996): No heartbeat from core client for 30 sec - exiting 06:42:55 (14996): No heartbeat from core client for 30 sec - exiting 06:42:56 (14996): No heartbeat from core client for 30 sec - exiting 06:42:57 (14996): No heartbeat from core client for 30 sec - exiting 06:42:58 (14996): No heartbeat from core client for 30 sec - exiting 06:42:59 (14996): No heartbeat from core client for 30 sec - exiting 07:52:51 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:52 (5668): No heartbeat from core client for 30 sec - exiting 07:52:53 (5668): No heartbeat from core client for 30 sec - exiting 07:52:54 (5668): No heartbeat from core client for 30 sec - exiting 07:52:55 (5668): No heartbeat from core client for 30 sec - exiting 07:52:56 (5668): No heartbeat from core client for 30 sec - exiting 07:52:57 (5668): No heartbeat from core client for 30 sec - exiting 07:52:58 (5668): No heartbeat from core client for 30 sec - exiting 07:52:59 (5668): No heartbeat from core client for 30 sec - exiting 07:53:00 (5668): No heartbeat from core client for 30 sec - exiting 07:53:01 (5668): No heartbeat from core client for 30 sec - exiting 09:11:01 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:30 (12680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:42:22 (13440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:23 (13440): No heartbeat from core client for 30 sec - exiting 09:42:24 (13440): No heartbeat from core client for 30 sec - exiting 09:42:25 (13440): No heartbeat from core client for 30 sec - exiting 09:42:26 (13440): No heartbeat from core client for 30 sec - exiting 09:42:27 (13440): No heartbeat from core client for 30 sec - exiting 09:42:28 (13440): No heartbeat from core client for 30 sec - exiting 09:42:29 (13440): No heartbeat from core client for 30 sec - exiting 09:42:30 (13440): No heartbeat from core client for 30 sec - exiting 09:42:31 (13440): No heartbeat from core client for 30 sec - exiting 09:59:02 (13048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:55 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:34 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:08:27 (15828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:28 (15828): No heartbeat from core client for 30 sec - exiting 14:08:29 (15828): No heartbeat from core client for 30 sec - exiting 14:08:30 (15828): No heartbeat from core client for 30 sec - exiting 14:08:31 (15828): No heartbeat from core client for 30 sec - exiting 14:08:32 (15828): No heartbeat from core client for 30 sec - exiting 14:08:33 (15828): No heartbeat from core client for 30 sec - exiting 14:08:34 (15828): No heartbeat from core client for 30 sec - exiting 14:08:35 (15828): No heartbeat from core client for 30 sec - exiting 14:08:36 (15828): No heartbeat from core client for 30 sec - exiting 14:08:37 (15828): No heartbeat from core client for 30 sec - exiting 14:16:36 (17344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:37 (17344): No heartbeat from core client for 30 sec - exiting 14:16:38 (17344): No heartbeat from core client for 30 sec - exiting 14:16:39 (17344): No heartbeat from core client for 30 sec - exiting 14:16:40 (17344): No heartbeat from core client for 30 sec - exiting 14:16:41 (17344): No heartbeat from core client for 30 sec - exiting 14:16:42 (17344): No heartbeat from core client for 30 sec - exiting 14:16:43 (17344): No heartbeat from core client for 30 sec - exiting 14:16:44 (17344): No heartbeat from core client for 30 sec - exiting 14:16:45 (17344): No heartbeat from core client for 30 sec - exiting 14:16:46 (17344): No heartbeat from core client for 30 sec - exiting 14:57:01 (16196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:25:18 (1460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:17 (14072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:18 (14072): No heartbeat from core client for 30 sec - exiting 17:26:19 (14072): No heartbeat from core client for 30 sec - exiting 17:26:20 (14072): No heartbeat from core client for 30 sec - exiting 17:26:21 (14072): No heartbeat from core client for 30 sec - exiting 17:26:22 (14072): No heartbeat from core client for 30 sec - exiting 17:26:23 (14072): No heartbeat from core client for 30 sec - exiting 17:26:24 (14072): No heartbeat from core client for 30 sec - exiting 17:26:25 (14072): No heartbeat from core client for 30 sec - exiting 17:26:26 (14072): No heartbeat from core client for 30 sec - exiting 17:26:27 (14072): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:30:27 (8448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:30:28 (8448): No heartbeat from core client for 30 sec - exiting 17:30:29 (8448): No heartbeat from core client for 30 sec - exiting 17:30:30 (8448): No heartbeat from core client for 30 sec - exiting 17:30:31 (8448): No heartbeat from core client for 30 sec - exiting 17:30:32 (8448): No heartbeat from core client for 30 sec - exiting 17:30:33 (8448): No heartbeat from core client for 30 sec - exiting 17:30:34 (8448): No heartbeat from core client for 30 sec - exiting 17:30:35 (8448): No heartbeat from core client for 30 sec - exiting 17:30:36 (8448): No heartbeat from core client for 30 sec - exiting 17:30:37 (8448): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:18:51 (10604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:37 (9532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:41 (16136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:43:37 (15116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:38 (12480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:53 (12092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:26:19 (14796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:41 (16864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:10:01 (1288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:02 (1288): No heartbeat from core client for 30 sec - exiting 01:10:03 (1288): No heartbeat from core client for 30 sec - exiting 01:10:04 (1288): No heartbeat from core client for 30 sec - exiting 01:10:05 (1288): No heartbeat from core client for 30 sec - exiting 01:10:06 (1288): No heartbeat from core client for 30 sec - exiting 01:10:07 (1288): No heartbeat from core client for 30 sec - exiting 01:10:08 (1288): No heartbeat from core client for 30 sec - exiting 01:10:09 (1288): No heartbeat from core client for 30 sec - exiting 01:10:10 (1288): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 01:21:26 (13424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:21:28 (13424): No heartbeat from core client for 30 sec - exiting 01:21:29 (13424): No heartbeat from core client for 30 sec - exiting 01:21:30 (13424): No heartbeat from core client for 30 sec - exiting 01:21:31 (13424): No heartbeat from core client for 30 sec - exiting 01:21:32 (13424): No heartbeat from core client for 30 sec - exiting 01:21:33 (13424): No heartbeat from core client for 30 sec - exiting 01:21:34 (13424): No heartbeat from core client for 30 sec - exiting 01:21:35 (13424): No heartbeat from core client for 30 sec - exiting 01:21:36 (13424): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:40:31 (8548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:41:12 (10252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:37:48 (8052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:25:00 (10012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:01 (10012): No heartbeat from core client for 30 sec - exiting 12:25:02 (10012): No heartbeat from core client for 30 sec - exiting 12:25:03 (10012): No heartbeat from core client for 30 sec - exiting 12:25:05 (10012): No heartbeat from core client for 30 sec - exiting 12:25:06 (10012): No heartbeat from core client for 30 sec - exiting 12:25:07 (10012): No heartbeat from core client for 30 sec - exiting 12:25:08 (10012): No heartbeat from core client for 30 sec - exiting 12:25:10 (10012): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6088, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 14:06:01 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:21:40 (10264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:22:47 (17924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:48 (17924): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:24:23 (344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:24:24 (344): No heartbeat from core client for 30 sec - exiting 14:24:25 (344): No heartbeat from core client for 30 sec - exiting 14:24:26 (344): No heartbeat from core client for 30 sec - exiting 14:24:27 (344): No heartbeat from core client for 30 sec - exiting 14:24:28 (344): No heartbeat from core client for 30 sec - exiting 14:24:29 (344): No heartbeat from core client for 30 sec - exiting 14:24:30 (344): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:28:02 (1028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:23:06 (16860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:22:42 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:19:05 (14024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:19:06 (14024): No heartbeat from core client for 30 sec - exiting 06:19:07 (14024): No heartbeat from core client for 30 sec - exiting 06:19:08 (14024): No heartbeat from core client for 30 sec - exiting 06:19:09 (14024): No heartbeat from core client for 30 sec - exiting 06:19:10 (14024): No heartbeat from core client for 30 sec - exiting 06:19:11 (14024): No heartbeat from core client for 30 sec - exiting 06:19:12 (14024): No heartbeat from core client for 30 sec - exiting 06:19:13 (14024): No heartbeat from core client for 30 sec - exiting 06:19:14 (14024): No heartbeat from core client for 30 sec - exiting 06:19:15 (14024): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:24:23 (31016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:24 (31016): No heartbeat from core client for 30 sec - exiting 06:24:25 (31016): No heartbeat from core client for 30 sec - exiting 06:24:26 (31016): No heartbeat from core client for 30 sec - exiting 06:24:27 (31016): No heartbeat from core client for 30 sec - exiting 06:24:28 (31016): No heartbeat from core client for 30 sec - exiting 06:24:29 (31016): No heartbeat from core client for 30 sec - exiting 06:24:30 (31016): No heartbeat from core client for 30 sec - exiting 06:24:31 (31016): No heartbeat from core client for 30 sec - exiting 06:24:32 (31016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:44:42 (43676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:11:46 (4736): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:18:45 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:46 (2856): No heartbeat from core client for 30 sec - exiting 20:18:47 (2856): No heartbeat from core client for 30 sec - exiting 20:18:48 (2856): No heartbeat from core client for 30 sec - exiting 20:18:49 (2856): No heartbeat from core client for 30 sec - exiting 20:57:53 (2072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:02 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:44 (656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:45 (656): No heartbeat from core client for 30 sec - exiting 21:34:46 (656): No heartbeat from core client for 30 sec - exiting 21:34:47 (656): No heartbeat from core client for 30 sec - exiting 21:34:48 (656): No heartbeat from core client for 30 sec - exiting 21:34:49 (656): No heartbeat from core client for 30 sec - exiting 21:34:50 (656): No heartbeat from core client for 30 sec - exiting 21:34:51 (656): No heartbeat from core client for 30 sec - exiting 21:34:52 (656): No heartbeat from core client for 30 sec - exiting 21:34:53 (656): No heartbeat from core client for 30 sec - exiting 21:34:54 (656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:58:26 (2552): No heartbeat from core client for 30 sec - exiting 03:58:27 (2552): No heartbeat from core client for 30 sec - exiting 03:58:28 (2552): No heartbeat from core client for 30 sec - exiting 03:58:29 (2552): No heartbeat from core client for 30 sec - exiting 03:58:30 (2552): No heartbeat from core client for 30 sec - exiting 03:58:31 (2552): No heartbeat from core client for 30 sec - exiting 03:58:32 (2552): No heartbeat from core client for 30 sec - exiting 03:58:33 (2552): No heartbeat from core client for 30 sec - exiting 03:58:34 (2552): No heartbeat from core client for 30 sec - exiting 03:58:35 (2552): No heartbeat from core client for 30 sec - exiting 03:58:36 (2552): No heartbeat from core client for 30 sec - exiting 03:58:37 (2552): No heartbeat from core client for 30 sec - exiting 03:58:38 (2552): No heartbeat from core client for 30 sec - exiting 03:58:39 (2552): No heartbeat from core client for 30 sec - exiting 03:58:40 (2552): No heartbeat from core client for 30 sec - exiting 03:58:41 (2552): No heartbeat from core client for 30 sec - exiting 03:58:42 (2552): No heartbeat from core client for 30 sec - exiting 03:58:43 (2552): No heartbeat from core client for 30 sec - exiting 03:58:44 (2552): No heartbeat from core client for 30 sec - exiting 03:58:45 (2552): No heartbeat from core client for 30 sec - exiting 03:58:46 (2552): No heartbeat from core client for 30 sec - exiting 03:58:47 (2552): No heartbeat from core client for 30 sec - exiting 03:58:48 (2552): No heartbeat from core client for 30 sec - exiting 03:58:49 (2552): No heartbeat from core client for 30 sec - exiting 03:58:50 (2552): No heartbeat from core client for 30 sec - exiting 03:58:51 (2552): No heartbeat from core client for 30 sec - exiting 03:58:52 (2552): No heartbeat from core client for 30 sec - exiting 03:58:53 (2552): No heartbeat from core client for 30 sec - exiting 03:58:54 (2552): No heartbeat from core client for 30 sec - exiting 03:58:55 (2552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:07:33 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:34 (4200): No heartbeat from core client for 30 sec - exiting 20:07:35 (4200): No heartbeat from core client for 30 sec - exiting 20:07:36 (4200): No heartbeat from core client for 30 sec - exiting 20:07:37 (4200): No heartbeat from core client for 30 sec - exiting 20:07:38 (4200): No heartbeat from core client for 30 sec - exiting 20:59:18 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:29 (1752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:30 (1752): No heartbeat from core client for 30 sec - exiting 21:18:32 (1752): No heartbeat from core client for 30 sec - exiting 21:18:33 (1752): No heartbeat from core client for 30 sec - exiting 21:18:34 (1752): No heartbeat from core client for 30 sec - exiting 21:18:35 (1752): No heartbeat from core client for 30 sec - exiting 21:18:36 (1752): No heartbeat from core client for 30 sec - exiting 21:18:37 (1752): No heartbeat from core client for 30 sec - exiting 21:18:38 (1752): No heartbeat from core client for 30 sec - exiting 21:18:39 (1752): No heartbeat from core client for 30 sec - exiting 21:18:40 (1752): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:24:54 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:00 (1688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:47 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:20:59 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:31 (3052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:42:07 (5696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:08 (5696): No heartbeat from core client for 30 sec - exiting 20:42:09 (5696): No heartbeat from core client for 30 sec - exiting 20:42:10 (5696): No heartbeat from core client for 30 sec - exiting 20:42:11 (5696): No heartbeat from core client for 30 sec - exiting 20:42:12 (5696): No heartbeat from core client for 30 sec - exiting 20:42:13 (5696): No heartbeat from core client for 30 sec - exiting 20:42:14 (5696): No heartbeat from core client for 30 sec - exiting 20:42:15 (5696): No heartbeat from core client for 30 sec - exiting 20:42:16 (5696): No heartbeat from core client for 30 sec - exiting 20:42:17 (5696): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:43:29 (3548): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:52:00 (6060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:01 (6060): No heartbeat from core client for 30 sec - exiting 01:52:02 (6060): No heartbeat from core client for 30 sec - exiting 01:52:03 (6060): No heartbeat from core client for 30 sec - exiting 01:52:04 (6060): No heartbeat from core client for 30 sec - exiting 01:52:05 (6060): No heartbeat from core client for 30 sec - exiting 01:52:06 (6060): No heartbeat from core client for 30 sec - exiting 01:52:07 (6060): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:20:35 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:22:04 (4664): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:26:46 (3300): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:27:58 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:44:07 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:08 (3608): No heartbeat from core client for 30 sec - exiting 03:44:09 (3608): No heartbeat from core client for 30 sec - exiting 03:44:10 (3608): No heartbeat from core client for 30 sec - exiting 03:44:11 (3608): No heartbeat from core client for 30 sec - exiting 03:44:12 (3608): No heartbeat from core client for 30 sec - exiting 03:44:13 (3608): No heartbeat from core client for 30 sec - exiting 03:44:14 (3608): No heartbeat from core client for 30 sec - exiting 03:44:15 (3608): No heartbeat from core client for 30 sec - exiting 03:44:16 (3608): No heartbeat from core client for 30 sec - exiting 03:44:18 (3608): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 06:47:48 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:47:49 (2852): No heartbeat from core client for 30 sec - exiting 06:47:50 (2852): No heartbeat from core client for 30 sec - exiting 06:47:51 (2852): No heartbeat from core client for 30 sec - exiting 06:47:52 (2852): No heartbeat from core client for 30 sec - exiting 06:47:53 (2852): No heartbeat from core client for 30 sec - exiting 06:47:55 (2852): No heartbeat from core client for 30 sec - exiting 06:47:56 (2852): No heartbeat from core client for 30 sec - exiting 06:47:57 (2852): No heartbeat from core client for 30 sec - exiting 06:47:58 (2852): No heartbeat from core client for 30 sec - exiting 06:47:59 (2852): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:01:38 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:27:59 (952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:00 (952): No heartbeat from core client for 30 sec - exiting 13:28:01 (952): No heartbeat from core client for 30 sec - exiting 13:28:02 (952): No heartbeat from core client for 30 sec - exiting 13:28:03 (952): No heartbeat from core client for 30 sec - exiting 13:28:04 (952): No heartbeat from core client for 30 sec - exiting 13:28:06 (952): No heartbeat from core client for 30 sec - exiting 13:28:07 (952): No heartbeat from core client for 30 sec - exiting 13:28:08 (952): No heartbeat from core client for 30 sec - exiting 13:28:09 (952): No heartbeat from core client for 30 sec - exiting 13:28:10 (952): No heartbeat from core client for 30 sec - exiting 14:51:58 (2380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:51:59 (2380): No heartbeat from core client for 30 sec - exiting 14:52:00 (2380): No heartbeat from core client for 30 sec - exiting 14:52:01 (2380): No heartbeat from core client for 30 sec - exiting 14:52:02 (2380): No heartbeat from core client for 30 sec - exiting 14:52:03 (2380): No heartbeat from core client for 30 sec - exiting 14:52:05 (2380): No heartbeat from core client for 30 sec - exiting 14:52:06 (2380): No heartbeat from core client for 30 sec - exiting 14:52:07 (2380): No heartbeat from core client for 30 sec - exiting 14:52:08 (2380): No heartbeat from core client for 30 sec - exiting 14:52:09 (2380): No heartbeat from core client for 30 sec - exiting 14:52:51 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:54:11 (4672): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:33:53 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Feb 2012 07:24:25	1189159	14037412	hadcm3n_t4ov_1940_40_007743049_2	155,520	233,495	1.5014
13 Feb 2012 05:42:37	1189159	14037412	hadcm3n_t4ov_1940_40_007743049_2	129,600	193,912	1.4962
12 Feb 2012 02:36:42	1189159	14037412	hadcm3n_t4ov_1940_40_007743049_2	103,680	155,436	1.4992
07 Feb 2012 18:02:10	1189159	14037412	hadcm3n_t4ov_1940_40_007743049_2	77,760	116,324	1.4959
05 Feb 2012 22:28:31	1189159	14037412	hadcm3n_t4ov_1940_40_007743049_2	51,840	77,500	1.4950
01 Feb 2012 06:52:45	1189159	14037412	hadcm3n_t4ov_1940_40_007743049_2	25,920	39,458	1.5223