Task 15904277

Name	hadcm3n_n1jf_1920_40_008404300_0
Workunit	8555156
Created	23 Jul 2013, 18:40:06 UTC
Sent	23 Jul 2013, 19:01:13 UTC
Report deadline	23 Oct 2013, 2:28:24 UTC
Received	15 Feb 2014, 16:33:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1123218
Run time	48 days 16 hours 49 min 13 sec
CPU time	33 days 7 hours 6 min 39 sec
Validate state	Invalid
Credit	11,819.52
Device peak FLOPS	1.47 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:14:05 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3484, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:57:53 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:58:43 (552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:58:44 (552): No heartbeat from core client for 30 sec - exiting 07:05:42 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:19 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:20 (4916): No heartbeat from core client for 30 sec - exiting 07:07:21 (4916): No heartbeat from core client for 30 sec - exiting 07:07:22 (4916): No heartbeat from core client for 30 sec - exiting 07:07:23 (4916): No heartbeat from core client for 30 sec - exiting 07:09:51 (180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:09:52 (180): No heartbeat from core client for 30 sec - exiting 07:09:53 (180): No heartbeat from core client for 30 sec - exiting 07:09:54 (180): No heartbeat from core client for 30 sec - exiting 07:23:00 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:01 (3124): No heartbeat from core client for 30 sec - exiting 07:23:02 (3124): No heartbeat from core client for 30 sec - exiting 07:23:03 (3124): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:16:45 (1092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:16:46 (1092): No heartbeat from core client for 30 sec - exiting 07:16:47 (1092): No heartbeat from core client for 30 sec - exiting 07:16:48 (1092): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3420, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4256, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:08:10 (3048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:11 (3048): No heartbeat from core client for 30 sec - exiting 11:08:12 (3048): No heartbeat from core client for 30 sec - exiting 11:08:13 (3048): No heartbeat from core client for 30 sec - exiting 11:08:14 (3048): No heartbeat from core client for 30 sec - exiting 13:08:35 (1220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:36 (1220): No heartbeat from core client for 30 sec - exiting 13:08:37 (1220): No heartbeat from core client for 30 sec - exiting 13:08:38 (1220): No heartbeat from core client for 30 sec - exiting 13:08:39 (1220): No heartbeat from core client for 30 sec - exiting 13:08:40 (1220): No heartbeat from core client for 30 sec - exiting 13:26:12 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:13 (4356): No heartbeat from core client for 30 sec - exiting 13:26:14 (4356): No heartbeat from core client for 30 sec - exiting 13:26:15 (4356): No heartbeat from core client for 30 sec - exiting 13:26:16 (4356): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5068, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3884, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1828, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3396, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 18:06:47 (1916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:48 (1916): No heartbeat from core client for 30 sec - exiting 18:06:49 (1916): No heartbeat from core client for 30 sec - exiting 18:06:50 (1916): No heartbeat from core client for 30 sec - exiting 18:06:51 (1916): No heartbeat from core client for 30 sec - exiting 18:06:52 (1916): No heartbeat from core client for 30 sec - exiting 18:45:28 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:29 (2712): No heartbeat from core client for 30 sec - exiting 18:45:30 (2712): No heartbeat from core client for 30 sec - exiting 18:51:25 (740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:51:26 (740): No heartbeat from core client for 30 sec - exiting 19:02:24 (656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:25 (656): No heartbeat from core client for 30 sec - exiting 19:19:42 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:16 (916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:17 (916): No heartbeat from core client for 30 sec - exiting 19:25:18 (916): No heartbeat from core client for 30 sec - exiting 19:25:19 (916): No heartbeat from core client for 30 sec - exiting 19:25:20 (916): No heartbeat from core client for 30 sec - exiting 19:30:43 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:44 (2960): No heartbeat from core client for 30 sec - exiting 19:30:45 (2960): No heartbeat from core client for 30 sec - exiting 19:30:46 (2960): No heartbeat from core client for 30 sec - exiting 19:36:32 (1616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:33 (1616): No heartbeat from core client for 30 sec - exiting 19:36:34 (1616): No heartbeat from core client for 30 sec - exiting 19:36:35 (1616): No heartbeat from core client for 30 sec - exiting 19:43:09 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:19 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:20 (3880): No heartbeat from core client for 30 sec - exiting 19:48:21 (3880): No heartbeat from core client for 30 sec - exiting 19:48:22 (3880): No heartbeat from core client for 30 sec - exiting 20:16:37 (936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:38 (936): No heartbeat from core client for 30 sec - exiting 20:33:27 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:28 (4052): No heartbeat from core client for 30 sec - exiting 20:33:29 (4052): No heartbeat from core client for 30 sec - exiting 20:39:11 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:12 (3148): No heartbeat from core client for 30 sec - exiting 20:39:13 (3148): No heartbeat from core client for 30 sec - exiting 20:50:54 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:55 (2712): No heartbeat from core client for 30 sec - exiting 20:50:56 (2712): No heartbeat from core client for 30 sec - exiting 20:50:57 (2712): No heartbeat from core client for 30 sec - exiting 20:56:44 (2352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:45 (2352): No heartbeat from core client for 30 sec - exiting 20:56:46 (2352): No heartbeat from core client for 30 sec - exiting 21:07:30 (1648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:23 (2816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:24 (2816): No heartbeat from core client for 30 sec - exiting 21:13:25 (2816): No heartbeat from core client for 30 sec - exiting 21:19:13 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:14 (3472): No heartbeat from core client for 30 sec - exiting 21:29:37 (652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:38 (652): No heartbeat from core client for 30 sec - exiting 21:49:48 (1332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:49 (1332): No heartbeat from core client for 30 sec - exiting 21:49:50 (1332): No heartbeat from core client for 30 sec - exiting 21:49:51 (1332): No heartbeat from core client for 30 sec - exiting 22:06:37 (1340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:38 (1340): No heartbeat from core client for 30 sec - exiting 22:06:39 (1340): No heartbeat from core client for 30 sec - exiting 22:06:40 (1340): No heartbeat from core client for 30 sec - exiting 22:26:37 (1616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:38 (1616): No heartbeat from core client for 30 sec - exiting 22:26:39 (1616): No heartbeat from core client for 30 sec - exiting 22:26:40 (1616): No heartbeat from core client for 30 sec - exiting 22:28:46 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:16 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:24 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:25 (3612): No heartbeat from core client for 30 sec - exiting 22:36:26 (3612): No heartbeat from core client for 30 sec - exiting 22:38:52 (656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:53 (656): No heartbeat from core client for 30 sec - exiting 22:38:54 (656): No heartbeat from core client for 30 sec - exiting 22:38:55 (656): No heartbeat from core client for 30 sec - exiting 22:38:56 (656): No heartbeat from core client for 30 sec - exiting 22:38:57 (656): No heartbeat from core client for 30 sec - exiting 22:44:10 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:11 (3744): No heartbeat from core client for 30 sec - exiting 22:44:12 (3744): No heartbeat from core client for 30 sec - exiting 22:44:13 (3744): No heartbeat from core client for 30 sec - exiting 22:44:14 (3744): No heartbeat from core client for 30 sec - exiting 22:49:13 (2732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:14 (2732): No heartbeat from core client for 30 sec - exiting 22:49:15 (2732): No heartbeat from core client for 30 sec - exiting 22:49:16 (2732): No heartbeat from core client for 30 sec - exiting 22:49:17 (2732): No heartbeat from core client for 30 sec - exiting 23:04:56 (3848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:57 (3848): No heartbeat from core client for 30 sec - exiting 23:04:58 (3848): No heartbeat from core client for 30 sec - exiting 23:04:59 (3848): No heartbeat from core client for 30 sec - exiting 23:11:50 (3024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:51 (3024): No heartbeat from core client for 30 sec - exiting 23:14:40 (2496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:14:41 (2496): No heartbeat from core client for 30 sec - exiting 23:14:42 (2496): No heartbeat from core client for 30 sec - exiting 23:14:43 (2496): No heartbeat from core client for 30 sec - exiting 23:14:44 (2496): No heartbeat from core client for 30 sec - exiting 23:24:42 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:43 (1388): No heartbeat from core client for 30 sec - exiting 23:24:44 (1388): No heartbeat from core client for 30 sec - exiting 23:24:45 (1388): No heartbeat from core client for 30 sec - exiting 23:24:46 (1388): No heartbeat from core client for 30 sec - exiting 23:24:47 (1388): No heartbeat from core client for 30 sec - exiting 23:24:48 (1388): No heartbeat from core client for 30 sec - exiting 23:24:49 (1388): No heartbeat from core client for 30 sec - exiting 23:35:00 (1692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:35:01 (1692): No heartbeat from core client for 30 sec - exiting 23:35:02 (1692): No heartbeat from core client for 30 sec - exiting 23:35:03 (1692): No heartbeat from core client for 30 sec - exiting 23:35:04 (1692): No heartbeat from core client for 30 sec - exiting 23:37:12 (2860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:13 (2860): No heartbeat from core client for 30 sec - exiting 23:37:14 (2860): No heartbeat from core client for 30 sec - exiting 23:49:59 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:50:00 (3456): No heartbeat from core client for 30 sec - exiting 23:50:01 (3456): No heartbeat from core client for 30 sec - exiting 23:50:02 (3456): No heartbeat from core client for 30 sec - exiting 23:59:55 (2724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:08 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:09 (2960): No heartbeat from core client for 30 sec - exiting 00:20:10 (2960): No heartbeat from core client for 30 sec - exiting 00:22:49 (1052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:22:50 (1052): No heartbeat from core client for 30 sec - exiting 00:22:51 (1052): No heartbeat from core client for 30 sec - exiting 00:22:52 (1052): No heartbeat from core client for 30 sec - exiting 00:35:50 (796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:51 (796): No heartbeat from core client for 30 sec - exiting 00:35:52 (796): No heartbeat from core client for 30 sec - exiting 00:35:53 (796): No heartbeat from core client for 30 sec - exiting 00:40:14 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:15 (4052): No heartbeat from core client for 30 sec - exiting 00:40:16 (4052): No heartbeat from core client for 30 sec - exiting 00:43:29 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:43:30 (2908): No heartbeat from core client for 30 sec - exiting 00:43:31 (2908): No heartbeat from core client for 30 sec - exiting 00:43:32 (2908): No heartbeat from core client for 30 sec - exiting 00:45:50 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:45:51 (2780): No heartbeat from core client for 30 sec - exiting 00:45:52 (2780): No heartbeat from core client for 30 sec - exiting 00:45:53 (2780): No heartbeat from core client for 30 sec - exiting 00:45:54 (2780): No heartbeat from core client for 30 sec - exiting 00:45:55 (2780): No heartbeat from core client for 30 sec - exiting 00:48:03 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:04 (4052): No heartbeat from core client for 30 sec - exiting 01:06:07 (1292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:08 (1292): No heartbeat from core client for 30 sec - exiting 01:06:09 (1292): No heartbeat from core client for 30 sec - exiting 01:06:10 (1292): No heartbeat from core client for 30 sec - exiting 01:06:11 (1292): No heartbeat from core client for 30 sec - exiting 01:11:02 (2588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:03 (2588): No heartbeat from core client for 30 sec - exiting 01:11:04 (2588): No heartbeat from core client for 30 sec - exiting 01:20:47 (2532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:48 (2532): No heartbeat from core client for 30 sec - exiting 01:20:49 (2532): No heartbeat from core client for 30 sec - exiting 01:23:55 (940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:23:56 (940): No heartbeat from core client for 30 sec - exiting 01:34:18 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:34:19 (2712): No heartbeat from core client for 30 sec - exiting 01:34:20 (2712): No heartbeat from core client for 30 sec - exiting 01:36:37 (3264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:36:38 (3264): No heartbeat from core client for 30 sec - exiting 01:57:06 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:57:07 (2632): No heartbeat from core client for 30 sec - exiting 01:57:08 (2632): No heartbeat from core client for 30 sec - exiting 02:14:44 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:17:00 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:17:01 (2928): No heartbeat from core client for 30 sec - exiting 02:19:12 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:19:13 (3740): No heartbeat from core client for 30 sec - exiting 02:25:06 (3100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:07 (3100): No heartbeat from core client for 30 sec - exiting 02:25:08 (3100): No heartbeat from core client for 30 sec - exiting 02:25:09 (3100): No heartbeat from core client for 30 sec - exiting 02:25:10 (3100): No heartbeat from core client for 30 sec - exiting 02:32:09 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:10 (3744): No heartbeat from core client for 30 sec - exiting 02:32:11 (3744): No heartbeat from core client for 30 sec - exiting 02:32:12 (3744): No heartbeat from core client for 30 sec - exiting 02:35:37 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:38 (3740): No heartbeat from core client for 30 sec - exiting 02:35:39 (3740): No heartbeat from core client for 30 sec - exiting 02:42:17 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:42:18 (3808): No heartbeat from core client for 30 sec - exiting 02:42:19 (3808): No heartbeat from core client for 30 sec - exiting 02:42:20 (3808): No heartbeat from core client for 30 sec - exiting 02:42:21 (3808): No heartbeat from core client for 30 sec - exiting 02:55:09 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:55:10 (2288): No heartbeat from core client for 30 sec - exiting 02:55:11 (2288): No heartbeat from core client for 30 sec - exiting 03:02:43 (3848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:44 (3848): No heartbeat from core client for 30 sec - exiting 03:02:45 (3848): No heartbeat from core client for 30 sec - exiting 03:02:46 (3848): No heartbeat from core client for 30 sec - exiting 03:12:41 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:42 (3148): No heartbeat from core client for 30 sec - exiting 03:12:43 (3148): No heartbeat from core client for 30 sec - exiting 03:23:06 (3024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:07 (3024): No heartbeat from core client for 30 sec - exiting 03:43:10 (1568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:11 (1568): No heartbeat from core client for 30 sec - exiting 03:43:12 (1568): No heartbeat from core client for 30 sec - exiting 03:46:08 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:46:09 (2256): No heartbeat from core client for 30 sec - exiting 03:46:10 (2256): No heartbeat from core client for 30 sec - exiting 04:03:19 (3848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:20 (3848): No heartbeat from core client for 30 sec - exiting 04:03:21 (3848): No heartbeat from core client for 30 sec - exiting 04:03:22 (3848): No heartbeat from core client for 30 sec - exiting 04:03:23 (3848): No heartbeat from core client for 30 sec - exiting 04:13:22 (3044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:49 (1288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:50 (1288): No heartbeat from core client for 30 sec - exiting 04:28:51 (1288): No heartbeat from core client for 30 sec - exiting 04:28:52 (1288): No heartbeat from core client for 30 sec - exiting 04:43:44 (3220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:46:44 (2300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:46:45 (2300): No heartbeat from core client for 30 sec - exiting 04:55:59 (3748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:05 (3748): No heartbeat from core client for 30 sec - exiting 04:56:06 (3748): No heartbeat from core client for 30 sec - exiting 05:04:07 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:04:08 (4004): No heartbeat from core client for 30 sec - exiting 05:04:09 (4004): No heartbeat from core client for 30 sec - exiting 05:04:10 (4004): No heartbeat from core client for 30 sec - exiting 05:04:11 (4004): No heartbeat from core client for 30 sec - exiting 05:07:00 (2176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:01 (2176): No heartbeat from core client for 30 sec - exiting 05:07:02 (2176): No heartbeat from core client for 30 sec - exiting 05:07:03 (2176): No heartbeat from core client for 30 sec - exiting 05:07:04 (2176): No heartbeat from core client for 30 sec - exiting 05:07:05 (2176): No heartbeat from core client for 30 sec - exiting 05:09:52 (2320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:53 (2320): No heartbeat from core client for 30 sec - exiting 05:09:54 (2320): No heartbeat from core client for 30 sec - exiting 05:09:55 (2320): No heartbeat from core client for 30 sec - exiting 05:14:08 (3100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:09 (3100): No heartbeat from core client for 30 sec - exiting 05:14:10 (3100): No heartbeat from core client for 30 sec - exiting 05:14:11 (3100): No heartbeat from core client for 30 sec - exiting 05:24:04 (1956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:24:05 (1956): No heartbeat from core client for 30 sec - exiting 05:26:25 (1568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:23 (3960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:24 (3960): No heartbeat from core client for 30 sec - exiting 05:34:25 (3960): No heartbeat from core client for 30 sec - exiting 05:34:26 (3960): No heartbeat from core client for 30 sec - exiting 06:06:03 (1616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:04 (1616): No heartbeat from core client for 30 sec - exiting 06:06:05 (1616): No heartbeat from core client for 30 sec - exiting 06:06:06 (1616): No heartbeat from core client for 30 sec - exiting 06:15:41 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:50 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:51 (3868): No heartbeat from core client for 30 sec - exiting 06:40:52 (3868): No heartbeat from core client for 30 sec - exiting 06:46:28 (2268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:46:29 (2268): No heartbeat from core client for 30 sec - exiting 06:46:30 (2268): No heartbeat from core client for 30 sec - exiting 06:48:54 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:58:47 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:58:48 (3692): No heartbeat from core client for 30 sec - exiting 07:26:53 (1792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:54 (1792): No heartbeat from core client for 30 sec - exiting 07:26:55 (1792): No heartbeat from core client for 30 sec - exiting 07:26:56 (1792): No heartbeat from core client for 30 sec - exiting 07:39:51 (4084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:47:19 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:47:20 (2324): No heartbeat from core client for 30 sec - exiting 07:47:21 (2324): No heartbeat from core client for 30 sec - exiting 07:47:22 (2324): No heartbeat from core client for 30 sec - exiting 07:47:23 (2324): No heartbeat from core client for 30 sec - exiting 07:49:16 (740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:17 (740): No heartbeat from core client for 30 sec - exiting 07:49:18 (740): No heartbeat from core client for 30 sec - exiting 07:49:19 (740): No heartbeat from core client for 30 sec - exiting 07:57:07 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:08 (3892): No heartbeat from core client for 30 sec - exiting 08:06:54 (4084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:55 (4084): No heartbeat from core client for 30 sec - exiting 08:06:56 (4084): No heartbeat from core client for 30 sec - exiting 08:06:57 (4084): No heartbeat from core client for 30 sec - exiting 08:06:58 (4084): No heartbeat from core client for 30 sec - exiting 08:06:59 (4084): No heartbeat from core client for 30 sec - exiting 08:07:00 (4084): No heartbeat from core client for 30 sec - exiting 08:26:38 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:39 (2232): No heartbeat from core client for 30 sec - exiting 08:26:40 (2232): No heartbeat from core client for 30 sec - exiting 08:38:02 (1956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:03 (1956): No heartbeat from core client for 30 sec - exiting 08:38:04 (1956): No heartbeat from core client for 30 sec - exiting 08:50:37 (2152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:38 (2152): No heartbeat from core client for 30 sec - exiting 08:50:39 (2152): No heartbeat from core client for 30 sec - exiting 08:54:35 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:36 (3096): No heartbeat from core client for 30 sec - exiting 08:54:37 (3096): No heartbeat from core client for 30 sec - exiting 09:15:10 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:11 (3612): No heartbeat from core client for 30 sec - exiting 09:15:12 (3612): No heartbeat from core client for 30 sec - exiting 09:27:35 (3724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:36 (3724): No heartbeat from core client for 30 sec - exiting 09:32:01 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:40:34 (1216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:35 (1216): No heartbeat from core client for 30 sec - exiting 09:40:36 (1216): No heartbeat from core client for 30 sec - exiting 09:40:37 (1216): No heartbeat from core client for 30 sec - exiting 09:40:38 (1216): No heartbeat from core client for 30 sec - exiting 10:00:51 (140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:52 (140): No heartbeat from core client for 30 sec - exiting 10:00:53 (140): No heartbeat from core client for 30 sec - exiting 10:00:54 (140): No heartbeat from core client for 30 sec - exiting 10:00:55 (140): No heartbeat from core client for 30 sec - exiting 10:04:35 (2556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:36 (2556): No heartbeat from core client for 30 sec - exiting 10:04:37 (2556): No heartbeat from core client for 30 sec - exiting 10:04:38 (2556): No heartbeat from core client for 30 sec - exiting 10:21:25 (2928): No heartbeat from core client for 30 sec - exiting 10:21:26 (2928): No heartbeat from core client for 30 sec - exiting 10:21:27 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:21:28 (2928): No heartbeat from core client for 30 sec - exiting 10:21:29 (2928): No heartbeat from core client for 30 sec - exiting 10:27:56 (3212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:57 (3212): No heartbeat from core client for 30 sec - exiting 10:27:58 (3212): No heartbeat from core client for 30 sec - exiting 10:27:59 (3212): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Feb 2014 16:22:07	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	984,960	2,815,477	2.8585
03 Feb 2014 19:51:36	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	959,040	2,743,498	2.8607
30 Jan 2014 16:01:51	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	933,120	2,677,775	2.8697
24 Jan 2014 16:58:10	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	907,200	2,609,083	2.8760
20 Jan 2014 23:13:02	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	881,280	2,541,582	2.8840
15 Jan 2014 18:54:55	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	855,360	2,475,387	2.8940
10 Jan 2014 17:36:52	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	829,440	2,402,585	2.8966
07 Jan 2014 15:11:40	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	803,520	2,325,722	2.8944
31 Dec 2013 17:09:35	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	777,600	2,250,271	2.8939
23 Dec 2013 23:21:17	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	751,680	2,178,071	2.8976
18 Dec 2013 00:03:58	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	725,760	2,100,991	2.8949
12 Dec 2013 17:37:58	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	699,840	2,024,117	2.8923
04 Dec 2013 23:14:37	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	673,920	1,948,110	2.8907
26 Nov 2013 17:40:23	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	648,000	1,872,713	2.8900
14 Nov 2013 09:08:26	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	622,080	1,797,623	2.8897
07 Nov 2013 21:08:54	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	596,160	1,722,929	2.8900
06 Nov 2013 16:23:39	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	570,240	1,645,652	2.8859
05 Nov 2013 09:58:22	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	544,320	1,568,250	2.8811
04 Nov 2013 05:18:09	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	518,400	1,491,695	2.8775
03 Nov 2013 00:15:13	1123218	15904277	hadcm3n_n1jf_1920_40_008404300_0	492,480	1,412,669	2.8685