Task 14663258

Name	hadcm3n_o25w_2020_40_007956535_3
Workunit	8111647
Created	13 May 2012, 15:18:18 UTC
Sent	13 May 2012, 15:18:50 UTC
Report deadline	12 Aug 2012, 22:46:01 UTC
Received	4 Jul 2013, 15:55:50 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1164924
Run time	82 days 4 hours 56 min 34 sec
CPU time	65 days 2 hours 21 min 12 sec
Validate state	Invalid
Credit	6,842.88
Device peak FLOPS	0.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 18:16:01 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4568, iMonCtr=1 Model crash detected, will try to restart... 08:13:07 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:03 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:02 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:03 (4388): No heartbeat from core client for 30 sec - exiting 05:55:49 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:50 (4380): No heartbeat from core client for 30 sec - exiting 09:07:04 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:12:58 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:04 (7040): No heartbeat from core client for 30 sec - exiting 12:13:05 (7040): No heartbeat from core client for 30 sec - exiting 12:13:06 (7040): No heartbeat from core client for 30 sec - exiting 12:13:07 (7040): No heartbeat from core client for 30 sec - exiting 12:13:08 (7040): No heartbeat from core client for 30 sec - exiting 23:16:07 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:09 (5992): No heartbeat from core client for 30 sec - exiting 06:15:06 (7328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:15:07 (7328): No heartbeat from core client for 30 sec - exiting 13:14:04 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:05 (5520): No heartbeat from core client for 30 sec - exiting 21:12:54 (6080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:57 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:59 (4020): No heartbeat from core client for 30 sec - exiting 13:10:58 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:20 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:21 (5516): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2776, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... 21:16:20 (3780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3676, iMonCtr=1 Model crash detected, will try to restart... 03:57:21 (1476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:54 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:31:38 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1992, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1028, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... 16:34:10 (1500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:32:53 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:31:43 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:31:44 (4704): No heartbeat from core client for 30 sec - exiting 06:51:19 (1916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:32:52 (616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:50 (1520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:51 (1520): No heartbeat from core client for 30 sec - exiting 04:30:41 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:30:43 (5260): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3376, iMonCtr=1 Model crash detected, will try to restart... 04:09:43 (2700): No heartbeat from core client for 30 sec - exiting 04:09:44 (2700): No heartbeat from core client for 30 sec - exiting 04:09:45 (2700): No heartbeat from core client for 30 sec - exiting 04:09:46 (2700): No heartbeat from core client for 30 sec - exiting 04:09:47 (2700): No heartbeat from core client for 30 sec - exiting 04:09:48 (2700): No heartbeat from core client for 30 sec - exiting 04:09:49 (2700): No heartbeat from core client for 30 sec - exiting 04:09:50 (2700): No heartbeat from core client for 30 sec - exiting 04:09:51 (2700): No heartbeat from core client for 30 sec - exiting 04:09:52 (2700): No heartbeat from core client for 30 sec - exiting 04:09:53 (2700): No heartbeat from core client for 30 sec - exiting 04:09:54 (2700): No heartbeat from core client for 30 sec - exiting 04:09:55 (2700): No heartbeat from core client for 30 sec - exiting 04:09:56 (2700): No heartbeat from core client for 30 sec - exiting 04:09:57 (2700): No heartbeat from core client for 30 sec - exiting 04:09:58 (2700): No heartbeat from core client for 30 sec - exiting 04:09:59 (2700): No heartbeat from core client for 30 sec - exiting 04:10:00 (2700): No heartbeat from core client for 30 sec - exiting 04:10:01 (2700): No heartbeat from core client for 30 sec - exiting 04:10:02 (2700): No heartbeat from core client for 30 sec - exiting 04:10:03 (2700): No heartbeat from core client for 30 sec - exiting 04:10:05 (2700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:39:03 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:05 (5064): No heartbeat from core client for 30 sec - exiting 09:00:22 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2980, iMonCtr=1 Model crash detected, will try to restart... 11:04:55 (2952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5636, iMonCtr=1 Model crash detected, will try to restart... 03:35:25 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:35:27 (2000): No heartbeat from core client for 30 sec - exiting 03:35:28 (2000): No heartbeat from core client for 30 sec - exiting 03:37:16 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:57:56 (7012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:22 (3484): No heartbeat from core client for 30 sec - exiting 04:01:23 (3484): No heartbeat from core client for 30 sec - exiting 04:01:24 (3484): No heartbeat from core client for 30 sec - exiting 04:01:25 (3484): No heartbeat from core client for 30 sec - exiting 04:01:26 (3484): No heartbeat from core client for 30 sec - exiting 04:01:27 (3484): No heartbeat from core client for 30 sec - exiting 04:01:28 (3484): No heartbeat from core client for 30 sec - exiting 04:01:29 (3484): No heartbeat from core client for 30 sec - exiting 04:01:30 (3484): No heartbeat from core client for 30 sec - exiting 04:01:31 (3484): No heartbeat from core client for 30 sec - exiting 04:01:32 (3484): No heartbeat from core client for 30 sec - exiting 04:01:33 (3484): No heartbeat from core client for 30 sec - exiting 04:01:34 (3484): No heartbeat from core client for 30 sec - exiting 04:01:35 (3484): No heartbeat from core client for 30 sec - exiting 04:01:36 (3484): No heartbeat from core client for 30 sec - exiting 04:01:37 (3484): No heartbeat from core client for 30 sec - exiting 04:01:38 (3484): No heartbeat from core client for 30 sec - exiting 04:01:39 (3484): No heartbeat from core client for 30 sec - exiting 04:01:40 (3484): No heartbeat from core client for 30 sec - exiting 04:01:41 (3484): No heartbeat from core client for 30 sec - exiting 04:01:42 (3484): No heartbeat from core client for 30 sec - exiting 04:01:43 (3484): No heartbeat from core client for 30 sec - exiting 04:01:44 (3484): No heartbeat from core client for 30 sec - exiting 04:01:45 (3484): No heartbeat from core client for 30 sec - exiting 04:01:46 (3484): No heartbeat from core client for 30 sec - exiting 04:01:47 (3484): No heartbeat from core client for 30 sec - exiting 04:01:48 (3484): No heartbeat from core client for 30 sec - exiting 04:01:49 (3484): No heartbeat from core client for 30 sec - exiting 04:01:51 (3484): No heartbeat from core client for 30 sec - exiting 04:01:52 (3484): No heartbeat from core client for 30 sec - exiting 04:01:53 (3484): No heartbeat from core client for 30 sec - exiting 04:01:54 (3484): No heartbeat from core client for 30 sec - exiting 04:01:55 (3484): No heartbeat from core client for 30 sec - exiting 04:01:56 (3484): No heartbeat from core client for 30 sec - exiting 04:01:57 (3484): No heartbeat from core client for 30 sec - exiting 04:01:58 (3484): No heartbeat from core client for 30 sec - exiting 04:01:59 (3484): No heartbeat from core client for 30 sec - exiting 04:02:00 (3484): No heartbeat from core client for 30 sec - exiting 04:02:01 (3484): No heartbeat from core client for 30 sec - exiting 04:02:02 (3484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:35 (700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1880, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2864, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3564, iMonCtr=1 Model crash detected, will try to restart... 03:32:51 (4316): No heartbeat from core client for 30 sec - exiting 03:32:52 (4316): No heartbeat from core client for 30 sec - exiting 03:32:53 (4316): No heartbeat from core client for 30 sec - exiting 03:32:54 (4316): No heartbeat from core client for 30 sec - exiting 03:32:55 (4316): No heartbeat from core client for 30 sec - exiting 03:32:56 (4316): No heartbeat from core client for 30 sec - exiting 03:32:57 (4316): No heartbeat from core client for 30 sec - exiting 03:32:58 (4316): No heartbeat from core client for 30 sec - exiting 03:33:00 (4316): No heartbeat from core client for 30 sec - exiting 03:33:01 (4316): No heartbeat from core client for 30 sec - exiting 03:33:02 (4316): No heartbeat from core client for 30 sec - exiting 03:33:03 (4316): No heartbeat from core client for 30 sec - exiting 03:33:04 (4316): No heartbeat from core client for 30 sec - exiting 03:33:05 (4316): No heartbeat from core client for 30 sec - exiting 03:33:06 (4316): No heartbeat from core client for 30 sec - exiting 03:33:07 (4316): No heartbeat from core client for 30 sec - exiting 03:33:08 (4316): No heartbeat from core client for 30 sec - exiting 03:33:09 (4316): No heartbeat from core client for 30 sec - exiting 03:33:10 (4316): No heartbeat from core client for 30 sec - exiting 03:33:11 (4316): No heartbeat from core client for 30 sec - exiting 03:33:12 (4316): No heartbeat from core client for 30 sec - exiting 03:33:13 (4316): No heartbeat from core client for 30 sec - exiting 03:33:14 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:50:43 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:50:44 (4968): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=1 Model crash detected, will try to restart... 04:08:46 (2340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:02:43 (4892): No heartbeat from core client for 30 sec - exiting 12:02:44 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:28:53 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:28:54 (5504): No heartbeat from core client for 30 sec - exiting 17:28:55 (5504): No heartbeat from core client for 30 sec - exiting 17:28:56 (5504): No heartbeat from core client for 30 sec - exiting 17:28:57 (5504): No heartbeat from core client for 30 sec - exiting 17:28:58 (5504): No heartbeat from core client for 30 sec - exiting 17:28:59 (5504): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=868, iMonCtr=1 Model crash detected, will try to restart... 06:02:50 (4332): No heartbeat from core client for 30 sec - exiting 06:02:52 (4332): No heartbeat from core client for 30 sec - exiting 06:02:53 (4332): No heartbeat from core client for 30 sec - exiting 06:02:54 (4332): No heartbeat from core client for 30 sec - exiting 06:02:55 (4332): No heartbeat from core client for 30 sec - exiting 06:02:56 (4332): No heartbeat from core client for 30 sec - exiting 06:02:57 (4332): No heartbeat from core client for 30 sec - exiting 06:02:58 (4332): No heartbeat from core client for 30 sec - exiting 06:02:59 (4332): No heartbeat from core client for 30 sec - exiting 06:03:00 (4332): No heartbeat from core client for 30 sec - exiting 06:03:01 (4332): No heartbeat from core client for 30 sec - exiting 06:03:02 (4332): No heartbeat from core client for 30 sec - exiting 06:03:04 (4332): No heartbeat from core client for 30 sec - exiting 06:03:05 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:04 (3156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:05 (3156): No heartbeat from core client for 30 sec - exiting 06:25:06 (3156): No heartbeat from core client for 30 sec - exiting 06:25:07 (3156): No heartbeat from core client for 30 sec - exiting 06:25:08 (3156): No heartbeat from core client for 30 sec - exiting 06:25:09 (3156): No heartbeat from core client for 30 sec - exiting 07:16:58 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:16:59 (3744): No heartbeat from core client for 30 sec - exiting 07:17:01 (3744): No heartbeat from core client for 30 sec - exiting 07:17:02 (3744): No heartbeat from core client for 30 sec - exiting 07:17:03 (3744): No heartbeat from core client for 30 sec - exiting 07:17:04 (3744): No heartbeat from core client for 30 sec - exiting 07:17:05 (3744): No heartbeat from core client for 30 sec - exiting 07:20:13 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4760, iMonCtr=1 Model crash detected, will try to restart... 06:29:29 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:29:30 (2716): No heartbeat from core client for 30 sec - exiting 06:29:31 (2716): No heartbeat from core client for 30 sec - exiting 06:29:32 (2716): No heartbeat from core client for 30 sec - exiting 06:29:33 (2716): No heartbeat from core client for 30 sec - exiting 06:29:35 (2716): No heartbeat from core client for 30 sec - exiting 06:59:36 (1172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:59:37 (1172): No heartbeat from core client for 30 sec - exiting 06:59:38 (1172): No heartbeat from core client for 30 sec - exiting 06:59:39 (1172): No heartbeat from core client for 30 sec - exiting 06:59:40 (1172): No heartbeat from core client for 30 sec - exiting 06:59:41 (1172): No heartbeat from core client for 30 sec - exiting 08:09:44 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:22 (7112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:23 (7112): No heartbeat from core client for 30 sec - exiting 15:31:24 (7112): No heartbeat from core client for 30 sec - exiting 15:31:25 (7112): No heartbeat from core client for 30 sec - exiting 15:31:26 (7112): No heartbeat from core client for 30 sec - exiting 15:31:27 (7112): No heartbeat from core client for 30 sec - exiting C11:55:33 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:34 (4568): No heartbeat from core client for 30 sec - exiting 18:54:32 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:02 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... 03:38:13 (2200): No heartbeat from core client for 30 sec - exiting 03:38:14 (2200): No heartbeat from core client for 30 sec - exiting 03:38:16 (2200): No heartbeat from core client for 30 sec - exiting 03:38:17 (2200): No heartbeat from core client for 30 sec - exiting 03:38:18 (2200): No heartbeat from core client for 30 sec - exiting 03:38:19 (2200): No heartbeat from core client for 30 sec - exiting 03:38:20 (2200): No heartbeat from core client for 30 sec - exiting 03:38:21 (2200): No heartbeat from core client for 30 sec - exiting 03:38:22 (2200): No heartbeat from core client for 30 sec - exiting 03:38:23 (2200): No heartbeat from core client for 30 sec - exiting 03:38:24 (2200): No heartbeat from core client for 30 sec - exiting 03:38:25 (2200): No heartbeat from core client for 30 sec - exiting 03:38:27 (2200): No heartbeat from core client for 30 sec - exiting 03:38:28 (2200): No heartbeat from core client for 30 sec - exiting 03:38:29 (2200): No heartbeat from core client for 30 sec - exiting 03:38:30 (2200): No heartbeat from core client for 30 sec - exiting 03:38:31 (2200): No heartbeat from core client for 30 sec - exiting 03:38:32 (2200): No heartbeat from core client for 30 sec - exiting 03:38:34 (2200): No heartbeat from core client for 30 sec - exiting 03:38:35 (2200): No heartbeat from core client for 30 sec - exiting 03:38:36 (2200): No heartbeat from core client for 30 sec - exiting 03:38:37 (2200): No heartbeat from core client for 30 sec - exiting 03:38:38 (2200): No heartbeat from core client for 30 sec - exiting 03:38:39 (2200): No heartbeat from core client for 30 sec - exiting 03:38:40 (2200): No heartbeat from core client for 30 sec - exiting 03:38:41 (2200): No heartbeat from core client for 30 sec - exiting 03:38:42 (2200): No heartbeat from core client for 30 sec - exiting 03:38:43 (2200): No heartbeat from core client for 30 sec - exiting 03:38:44 (2200): No heartbeat from core client for 30 sec - exiting 03:38:45 (2200): No heartbeat from core client for 30 sec - exiting 03:38:46 (2200): No heartbeat from core client for 30 sec - exiting 03:38:47 (2200): No heartbeat from core client for 30 sec - exiting 03:38:48 (2200): No heartbeat from core client for 30 sec - exiting 03:38:49 (2200): No heartbeat from core client for 30 sec - exiting 03:38:50 (2200): No heartbeat from core client for 30 sec - exiting 03:38:51 (2200): No heartbeat from core client for 30 sec - exiting 03:38:52 (2200): No heartbeat from core client for 30 sec - exiting 03:38:53 (2200): No heartbeat from core client for 30 sec - exiting 03:38:54 (2200): No heartbeat from core client for 30 sec - exiting 03:38:55 (2200): No heartbeat from core client for 30 sec - exiting 03:38:56 (2200): No heartbeat from core client for 30 sec - exiting 03:38:57 (2200): No heartbeat from core client for 30 sec - exiting 03:38:58 (2200): No heartbeat from core client for 30 sec - exiting 03:38:59 (2200): No heartbeat from core client for 30 sec - exiting 03:39:01 (2200): No heartbeat from core client for 30 sec - exiting 03:39:02 (2200): No heartbeat from core client for 30 sec - exiting 03:39:03 (2200): No heartbeat from core client for 30 sec - exiting 03:39:04 (2200): No heartbeat from core client for 30 sec - exiting 03:39:05 (2200): No heartbeat from core client for 30 sec - exiting 03:39:06 (2200): No heartbeat from core client for 30 sec - exiting 03:39:07 (2200): No heartbeat from core client for 30 sec - exiting 03:39:08 (2200): No heartbeat from core client for 30 sec - exiting 03:39:09 (2200): No heartbeat from core client for 30 sec - exiting 03:39:10 (2200): No heartbeat from core client for 30 sec - exiting 03:39:11 (2200): No heartbeat from core client for 30 sec - exiting 03:39:12 (2200): No heartbeat from core client for 30 sec - exiting 03:39:13 (2200): No heartbeat from core client for 30 sec - exiting 03:39:14 (2200): No heartbeat from core client for 30 sec - exiting 03:39:15 (2200): No heartbeat from core client for 30 sec - exiting 03:39:16 (2200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:17 (2200): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:01:07 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:09 (3976): No heartbeat from core client for 30 sec - exiting 04:01:10 (3976): No heartbeat from core client for 30 sec - exiting 04:01:11 (3976): No heartbeat from core client for 30 sec - exiting 04:01:12 (3976): No heartbeat from core client for 30 sec - exiting 15:25:26 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:53:31 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:53:38 (5168): No heartbeat from core client for 30 sec - exiting 05:35:55 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:22 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5444, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=600, iMonCtr=1 Model crash detected, will try to restart... 18:55:11 (4992): No heartbeat from core client for 30 sec - exiting 18:55:13 (4992): No heartbeat from core client for 30 sec - exiting 18:55:14 (4992): No heartbeat from core client for 30 sec - exiting 18:55:15 (4992): No heartbeat from core client for 30 sec - exiting 18:55:16 (4992): No heartbeat from core client for 30 sec - exiting 18:55:17 (4992): No heartbeat from core client for 30 sec - exiting 18:55:18 (4992): No heartbeat from core client for 30 sec - exiting 18:55:19 (4992): No heartbeat from core client for 30 sec - exiting 18:55:21 (4992): No heartbeat from core client for 30 sec - exiting 18:55:22 (4992): No heartbeat from core client for 30 sec - exiting 18:55:23 (4992): No heartbeat from core client for 30 sec - exiting 18:55:24 (4992): No heartbeat from core client for 30 sec - exiting 18:55:25 (4992): No heartbeat from core client for 30 sec - exiting 18:55:26 (4992): No heartbeat from core client for 30 sec - exiting 18:55:27 (4992): No heartbeat from core client for 30 sec - exiting 18:55:28 (4992): No heartbeat from core client for 30 sec - exiting 18:55:29 (4992): No heartbeat from core client for 30 sec - exiting 18:55:30 (4992): No heartbeat from core client for 30 sec - exiting 18:55:31 (4992): No heartbeat from core client for 30 sec - exiting 18:55:33 (4992): No heartbeat from core client for 30 sec - exiting 18:55:34 (4992): No heartbeat from core client for 30 sec - exiting 18:55:35 (4992): No heartbeat from core client for 30 sec - exiting 18:55:37 (4992): No heartbeat from core client for 30 sec - exiting 18:55:39 (4992): No heartbeat from core client for 30 sec - exiting 18:55:40 (4992): No heartbeat from core client for 30 sec - exiting 18:55:42 (4992): No heartbeat from core client for 30 sec - exiting 18:55:43 (4992): No heartbeat from core client for 30 sec - exiting 18:55:44 (4992): No heartbeat from core client for 30 sec - exiting 18:55:45 (4992): No heartbeat from core client for 30 sec - exiting 18:55:46 (4992): No heartbeat from core client for 30 sec - exiting 18:55:47 (4992): No heartbeat from core client for 30 sec - exiting 18:55:48 (4992): No heartbeat from core client for 30 sec - exiting 18:55:49 (4992): No heartbeat from core client for 30 sec - exiting 18:55:50 (4992): No heartbeat from core client for 30 sec - exiting 18:55:52 (4992): No heartbeat from core client for 30 sec - exiting 18:55:53 (4992): No heartbeat from core client for 30 sec - exiting 18:55:54 (4992): No heartbeat from core client for 30 sec - exiting 18:55:55 (4992): No heartbeat from core client for 30 sec - exiting 18:55:56 (4992): No heartbeat from core client for 30 sec - exiting 18:55:57 (4992): No heartbeat from core client for 30 sec - exiting 18:55:58 (4992): No heartbeat from core client for 30 sec - exiting 18:55:59 (4992): No heartbeat from core client for 30 sec - exiting 18:56:00 (4992): No heartbeat from core client for 30 sec - exiting 18:56:01 (4992): No heartbeat from core client for 30 sec - exiting 18:56:02 (4992): No heartbeat from core client for 30 sec - exiting 18:56:04 (4992): No heartbeat from core client for 30 sec - exiting 18:56:05 (4992): No heartbeat from core client for 30 sec - exiting 18:56:06 (4992): No heartbeat from core client for 30 sec - exiting 18:56:07 (4992): No heartbeat from core client for 30 sec - exiting 18:56:08 (4992): No heartbeat from core client for 30 sec - exiting 18:56:09 (4992): No heartbeat from core client for 30 sec - exiting 18:56:10 (4992): No heartbeat from core client for 30 sec - exiting 18:56:11 (4992): No heartbeat from core client for 30 sec - exiting 18:56:12 (4992): No heartbeat from core client for 30 sec - exiting 18:56:14 (4992): No heartbeat from core client for 30 sec - exiting 18:56:15 (4992): No heartbeat from core client for 30 sec - exiting 18:56:16 (4992): No heartbeat from core client for 30 sec - exiting 18:56:17 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:00:00 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:39 (2560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4648, iMonCtr=1 Model crash detected, will try to restart... 10:18:25 (600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:14:07 (2444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:10 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1364, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4040, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Abort request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 May 2013 05:34:25	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	570,240	5,429,118	9.5208
12 May 2013 08:05:54	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	544,320	5,189,288	9.5335
08 May 2013 19:14:37	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	518,400	4,940,246	9.5298
05 May 2013 08:04:45	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	492,480	4,693,037	9.5294
17 Mar 2013 21:24:44	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	466,560	4,441,848	9.5204
06 Oct 2012 04:46:32	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	440,640	4,195,562	9.5215
02 Oct 2012 17:03:05	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	414,720	3,950,227	9.5250
29 Sep 2012 07:50:40	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	388,800	3,704,123	9.5271
25 Sep 2012 22:19:54	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	362,880	3,456,133	9.5242
22 Sep 2012 11:43:31	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	336,960	3,207,229	9.5181
17 Sep 2012 08:55:15	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	311,040	2,965,952	9.5356
01 Sep 2012 14:26:32	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	285,120	2,719,328	9.5375
28 Aug 2012 00:28:59	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	259,200	2,468,163	9.5222
24 Aug 2012 04:20:16	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	233,280	2,219,585	9.5147
20 Aug 2012 17:58:52	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	207,360	1,972,406	9.5120
17 Aug 2012 12:40:40	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	181,440	1,724,890	9.5067
14 Aug 2012 08:31:25	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	155,520	1,478,401	9.5062
11 Aug 2012 07:16:38	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	129,600	1,234,503	9.5255
06 Aug 2012 15:44:50	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	103,680	988,176	9.5310
25 Jul 2012 17:00:45	1164924	14663258	hadcm3n_o25w_2020_40_007956535_3	77,760	741,249	9.5325