Task 15922048

Name	hadcm3n_n5wu_1920_40_008377488_2
Workunit	8528347
Created	15 Aug 2013, 6:14:02 UTC
Sent	15 Aug 2013, 6:16:47 UTC
Report deadline	14 Nov 2013, 13:43:58 UTC
Received	30 Sep 2013, 0:26:40 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1129647
Run time	24 days 0 hours 11 min 39 sec
CPU time	22 days 18 hours 14 min 36 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> 13:08:43 (5720): No heartbeat from core client for 30 sec - exiting 13:08:44 (5720): No heartbeat from core client for 30 sec - exiting 13:08:45 (5720): No heartbeat from core client for 30 sec - exiting 13:08:46 (5720): No heartbeat from core client for 30 sec - exiting 13:08:47 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:33:14 (5464): No heartbeat from core client for 30 sec - exiting 05:33:15 (5464): No heartbeat from core client for 30 sec - exiting 05:33:16 (5464): No heartbeat from core client for 30 sec - exiting 05:33:17 (5464): No heartbeat from core client for 30 sec - exiting 05:33:18 (5464): No heartbeat from core client for 30 sec - exiting 05:33:19 (5464): No heartbeat from core client for 30 sec - exiting 05:33:20 (5464): No heartbeat from core client for 30 sec - exiting 05:33:21 (5464): No heartbeat from core client for 30 sec - exiting 05:33:22 (5464): No heartbeat from core client for 30 sec - exiting 05:33:23 (5464): No heartbeat from core client for 30 sec - exiting 05:33:24 (5464): No heartbeat from core client for 30 sec - exiting 05:33:25 (5464): No heartbeat from core client for 30 sec - exiting 05:33:26 (5464): No heartbeat from core client for 30 sec - exiting 05:33:27 (5464): No heartbeat from core client for 30 sec - exiting 05:33:28 (5464): No heartbeat from core client for 30 sec - exiting 05:33:29 (5464): No heartbeat from core client for 30 sec - exiting 05:33:30 (5464): No heartbeat from core client for 30 sec - exiting 05:33:31 (5464): No heartbeat from core client for 30 sec - exiting 05:33:32 (5464): No heartbeat from core client for 30 sec - exiting 05:33:33 (5464): No heartbeat from core client for 30 sec - exiting 05:33:34 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:59 (5564): No heartbeat from core client for 30 sec - exiting 16:44:00 (5564): No heartbeat from core client for 30 sec - exiting 16:44:01 (5564): No heartbeat from core client for 30 sec - exiting 16:44:02 (5564): No heartbeat from core client for 30 sec - exiting 16:44:03 (5564): No heartbeat from core client for 30 sec - exiting 16:44:04 (5564): No heartbeat from core client for 30 sec - exiting 16:44:05 (5564): No heartbeat from core client for 30 sec - exiting 16:44:06 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:31:19 (5452): No heartbeat from core client for 30 sec - exiting 05:31:20 (5452): No heartbeat from core client for 30 sec - exiting 05:31:21 (5452): No heartbeat from core client for 30 sec - exiting 05:31:22 (5452): No heartbeat from core client for 30 sec - exiting 05:31:23 (5452): No heartbeat from core client for 30 sec - exiting 05:31:24 (5452): No heartbeat from core client for 30 sec - exiting 05:31:25 (5452): No heartbeat from core client for 30 sec - exiting 05:31:26 (5452): No heartbeat from core client for 30 sec - exiting 05:31:27 (5452): No heartbeat from core client for 30 sec - exiting 05:31:28 (5452): No heartbeat from core client for 30 sec - exiting 05:31:29 (5452): No heartbeat from core client for 30 sec - exiting 05:31:30 (5452): No heartbeat from core client for 30 sec - exiting 05:31:31 (5452): No heartbeat from core client for 30 sec - exiting 05:31:32 (5452): No heartbeat from core client for 30 sec - exiting 05:31:33 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:31:34 (5452): No heartbeat from core client for 30 sec - exiting 16:31:47 (4272): No heartbeat from core client for 30 sec - exiting 16:31:48 (4272): No heartbeat from core client for 30 sec - exiting 16:31:49 (4272): No heartbeat from core client for 30 sec - exiting 16:31:51 (4272): No heartbeat from core client for 30 sec - exiting 16:31:52 (4272): No heartbeat from core client for 30 sec - exiting 16:31:53 (4272): No heartbeat from core client for 30 sec - exiting 16:31:54 (4272): No heartbeat from core client for 30 sec - exiting 16:31:55 (4272): No heartbeat from core client for 30 sec - exiting 16:31:56 (4272): No heartbeat from core client for 30 sec - exiting 16:31:57 (4272): No heartbeat from core client for 30 sec - exiting 16:31:58 (4272): No heartbeat from core client for 30 sec - exiting 16:31:59 (4272): No heartbeat from core client for 30 sec - exiting 16:32:00 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:32:01 (4272): No heartbeat from core client for 30 sec - exiting 05:31:10 (5412): No heartbeat from core client for 30 sec - exiting 05:31:11 (5412): No heartbeat from core client for 30 sec - exiting 05:31:12 (5412): No heartbeat from core client for 30 sec - exiting 05:31:13 (5412): No heartbeat from core client for 30 sec - exiting 05:31:14 (5412): No heartbeat from core client for 30 sec - exiting 05:31:15 (5412): No heartbeat from core client for 30 sec - exiting 05:31:16 (5412): No heartbeat from core client for 30 sec - exiting 05:31:17 (5412): No heartbeat from core client for 30 sec - exiting 05:31:18 (5412): No heartbeat from core client for 30 sec - exiting 05:31:19 (5412): No heartbeat from core client for 30 sec - exiting 05:31:20 (5412): No heartbeat from core client for 30 sec - exiting 05:31:21 (5412): No heartbeat from core client for 30 sec - exiting 05:31:22 (5412): No heartbeat from core client for 30 sec - exiting 05:31:23 (5412): No heartbeat from core client for 30 sec - exiting 05:31:24 (5412): No heartbeat from core client for 30 sec - exiting 05:31:25 (5412): No heartbeat from core client for 30 sec - exiting 05:31:26 (5412): No heartbeat from core client for 30 sec - exiting 05:31:27 (5412): No heartbeat from core client for 30 sec - exiting 05:31:28 (5412): No heartbeat from core client for 30 sec - exiting 05:31:29 (5412): No heartbeat from core client for 30 sec - exiting 05:31:30 (5412): No heartbeat from core client for 30 sec - exiting 05:31:31 (5412): No heartbeat from core client for 30 sec - exiting 05:31:32 (5412): No heartbeat from core client for 30 sec - exiting 05:31:33 (5412): No heartbeat from core client for 30 sec - exiting 05:31:34 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5072, iMonCtr=1 Model crash detected, will try to restart... 07:54:31 (10064): No heartbeat from core client for 30 sec - exiting 07:54:32 (10064): No heartbeat from core client for 30 sec - exiting 07:54:33 (10064): No heartbeat from core client for 30 sec - exiting 07:54:34 (10064): No heartbeat from core client for 30 sec - exiting 07:54:35 (10064): No heartbeat from core client for 30 sec - exiting 07:54:36 (10064): No heartbeat from core client for 30 sec - exiting 07:54:37 (10064): No heartbeat from core client for 30 sec - exiting 07:54:38 (10064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:39 (10064): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5556, iMonCtr=1 Model crash detected, will try to restart... 17:18:11 (1148): No heartbeat from core client for 30 sec - exiting 17:18:12 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:26:20 (1844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:28 (5104): No heartbeat from core client for 30 sec - exiting 13:54:29 (5104): No heartbeat from core client for 30 sec - exiting 13:54:30 (5104): No heartbeat from core client for 30 sec - exiting 13:54:31 (5104): No heartbeat from core client for 30 sec - exiting 13:54:32 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:20:26 (5368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:38:27 (2368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:46:05 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:30:40 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:30:42 (4344): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1180, iMonCtr=1 Model crash detected, will try to restart... 16:48:15 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:55 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:00:09 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:44:53 (5496): No heartbeat from core client for 30 sec - exiting 05:44:54 (5496): No heartbeat from core client for 30 sec - exiting 05:44:55 (5496): No heartbeat from core client for 30 sec - exiting 05:44:56 (5496): No heartbeat from core client for 30 sec - exiting 05:44:57 (5496): No heartbeat from core client for 30 sec - exiting 05:44:58 (5496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:22 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4000, iMonCtr=1 Model crash detected, will try to restart... 12:11:42 (5784): No heartbeat from core client for 30 sec - exiting 12:11:43 (5784): No heartbeat from core client for 30 sec - exiting 12:11:44 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:15:05 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:49:18 (5816): No heartbeat from core client for 30 sec - exiting 16:49:19 (5816): No heartbeat from core client for 30 sec - exiting 16:49:20 (5816): No heartbeat from core client for 30 sec - exiting 16:49:21 (5816): No heartbeat from core client for 30 sec - exiting 16:49:22 (5816): No heartbeat from core client for 30 sec - exiting 16:49:23 (5816): No heartbeat from core client for 30 sec - exiting 16:49:24 (5816): No heartbeat from core client for 30 sec - exiting 16:49:25 (5816): No heartbeat from core client for 30 sec - exiting 16:49:26 (5816): No heartbeat from core client for 30 sec - exiting 16:49:27 (5816): No heartbeat from core client for 30 sec - exiting 16:49:28 (5816): No heartbeat from core client for 30 sec - exiting 16:49:29 (5816): No heartbeat from core client for 30 sec - exiting 16:49:30 (5816): No heartbeat from core client for 30 sec - exiting 16:49:31 (5816): No heartbeat from core client for 30 sec - exiting 16:49:32 (5816): No heartbeat from core client for 30 sec - exiting 16:49:33 (5816): No heartbeat from core client for 30 sec - exiting 16:49:34 (5816): No heartbeat from core client for 30 sec - exiting 16:49:35 (5816): No heartbeat from core client for 30 sec - exiting 16:49:36 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:24 (3928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5532, iMonCtr=1 Model crash detected, will try to restart... 14:21:23 (1292): No heartbeat from core client for 30 sec - exiting 14:21:24 (1292): No heartbeat from core client for 30 sec - exiting 14:21:25 (1292): No heartbeat from core client for 30 sec - exiting 14:21:26 (1292): No heartbeat from core client for 30 sec - exiting 14:21:27 (1292): No heartbeat from core client for 30 sec - exiting 14:21:28 (1292): No heartbeat from core client for 30 sec - exiting 14:21:29 (1292): No heartbeat from core client for 30 sec - exiting 14:21:30 (1292): No heartbeat from core client for 30 sec - exiting 14:21:31 (1292): No heartbeat from core client for 30 sec - exiting 14:21:32 (1292): No heartbeat from core client for 30 sec - exiting 14:21:33 (1292): No heartbeat from core client for 30 sec - exiting 14:21:34 (1292): No heartbeat from core client for 30 sec - exiting 14:21:35 (1292): No heartbeat from core client for 30 sec - exiting 14:21:36 (1292): No heartbeat from core client for 30 sec - exiting 14:21:37 (1292): No heartbeat from core client for 30 sec - exiting 14:21:38 (1292): No heartbeat from core client for 30 sec - exiting 14:21:39 (1292): No heartbeat from core client for 30 sec - exiting 14:21:40 (1292): No heartbeat from core client for 30 sec - exiting 14:21:41 (1292): No heartbeat from core client for 30 sec - exiting 14:21:42 (1292): No heartbeat from core client for 30 sec - exiting 14:21:43 (1292): No heartbeat from core client for 30 sec - exiting 14:21:44 (1292): No heartbeat from core client for 30 sec - exiting 14:21:45 (1292): No heartbeat from core client for 30 sec - exiting 14:21:46 (1292): No heartbeat from core client for 30 sec - exiting 14:21:47 (1292): No heartbeat from core client for 30 sec - exiting 14:21:48 (1292): No heartbeat from core client for 30 sec - exiting 14:21:49 (1292): No heartbeat from core client for 30 sec - exiting 14:21:50 (1292): No heartbeat from core client for 30 sec - exiting 14:21:51 (1292): No heartbeat from core client for 30 sec - exiting 14:21:52 (1292): No heartbeat from core client for 30 sec - exiting 14:21:53 (1292): No heartbeat from core client for 30 sec - exiting 14:21:54 (1292): No heartbeat from core client for 30 sec - exiting 14:21:55 (1292): No heartbeat from core client for 30 sec - exiting 14:21:56 (1292): No heartbeat from core client for 30 sec - exiting 14:21:57 (1292): No heartbeat from core client for 30 sec - exiting 14:21:58 (1292): No heartbeat from core client for 30 sec - exiting 14:21:59 (1292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:31 (5940): No heartbeat from core client for 30 sec - exiting 12:11:32 (5940): No heartbeat from core client for 30 sec - exiting 12:11:33 (5940): No heartbeat from core client for 30 sec - exiting 12:11:34 (5940): No heartbeat from core client for 30 sec - exiting 12:11:35 (5940): No heartbeat from core client for 30 sec - exiting 12:11:36 (5940): No heartbeat from core client for 30 sec - exiting 12:11:37 (5940): No heartbeat from core client for 30 sec - exiting 12:11:38 (5940): No heartbeat from core client for 30 sec - exiting 12:11:39 (5940): No heartbeat from core client for 30 sec - exiting 12:11:40 (5940): No heartbeat from core client for 30 sec - exiting 12:11:41 (5940): No heartbeat from core client for 30 sec - exiting 12:11:42 (5940): No heartbeat from core client for 30 sec - exiting 12:11:43 (5940): No heartbeat from core client for 30 sec - exiting 12:11:44 (5940): No heartbeat from core client for 30 sec - exiting 12:11:45 (5940): No heartbeat from core client for 30 sec - exiting 12:11:46 (5940): No heartbeat from core client for 30 sec - exiting 12:11:47 (5940): No heartbeat from core client for 30 sec - exiting 12:11:48 (5940): No heartbeat from core client for 30 sec - exiting 12:11:49 (5940): No heartbeat from core client for 30 sec - exiting 12:11:50 (5940): No heartbeat from core client for 30 sec - exiting 12:11:51 (5940): No heartbeat from core client for 30 sec - exiting 12:11:52 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5524, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5564, iMonCtr=1 Model crash detected, will try to restart... 05:23:12 (5844): No heartbeat from core client for 30 sec - exiting 05:23:14 (5844): No heartbeat from core client for 30 sec - exiting 05:23:15 (5844): No heartbeat from core client for 30 sec - exiting 05:23:16 (5844): No heartbeat from core client for 30 sec - exiting 05:23:17 (5844): No heartbeat from core client for 30 sec - exiting 05:23:18 (5844): No heartbeat from core client for 30 sec - exiting 05:23:19 (5844): No heartbeat from core client for 30 sec - exiting 05:23:20 (5844): No heartbeat from core client for 30 sec - exiting 05:23:21 (5844): No heartbeat from core client for 30 sec - exiting 05:23:22 (5844): No heartbeat from core client for 30 sec - exiting 05:23:23 (5844): No heartbeat from core client for 30 sec - exiting 05:23:24 (5844): No heartbeat from core client for 30 sec - exiting 05:23:25 (5844): No heartbeat from core client for 30 sec - exiting 05:23:26 (5844): No heartbeat from core client for 30 sec - exiting 05:23:27 (5844): No heartbeat from core client for 30 sec - exiting 05:23:28 (5844): No heartbeat from core client for 30 sec - exiting 05:23:29 (5844): No heartbeat from core client for 30 sec - exiting 05:23:30 (5844): No heartbeat from core client for 30 sec - exiting 05:23:31 (5844): No heartbeat from core client for 30 sec - exiting 05:23:32 (5844): No heartbeat from core client for 30 sec - exiting 05:23:33 (5844): No heartbeat from core client for 30 sec - exiting 05:23:34 (5844): No heartbeat from core client for 30 sec - exiting 05:23:35 (5844): No heartbeat from core client for 30 sec - exiting 05:23:36 (5844): No heartbeat from core client for 30 sec - exiting 05:23:37 (5844): No heartbeat from core client for 30 sec - exiting 05:23:38 (5844): No heartbeat from core client for 30 sec - exiting 05:23:39 (5844): No heartbeat from core client for 30 sec - exiting 05:23:40 (5844): No heartbeat from core client for 30 sec - exiting 05:23:41 (5844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:22 (5736): No heartbeat from core client for 30 sec - exiting 16:45:23 (5736): No heartbeat from core client for 30 sec - exiting 16:45:24 (5736): No heartbeat from core client for 30 sec - exiting 16:45:25 (5736): No heartbeat from core client for 30 sec - exiting 16:45:26 (5736): No heartbeat from core client for 30 sec - exiting 16:45:27 (5736): No heartbeat from core client for 30 sec - exiting 16:45:28 (5736): No heartbeat from core client for 30 sec - exiting 16:45:29 (5736): No heartbeat from core client for 30 sec - exiting 16:45:30 (5736): No heartbeat from core client for 30 sec - exiting 16:45:31 (5736): No heartbeat from core client for 30 sec - exiting 16:45:32 (5736): No heartbeat from core client for 30 sec - exiting 16:45:33 (5736): No heartbeat from core client for 30 sec - exiting 16:45:34 (5736): No heartbeat from core client for 30 sec - exiting 16:45:35 (5736): No heartbeat from core client for 30 sec - exiting 16:45:36 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:36:01 (5824): No heartbeat from core client for 30 sec - exiting 05:36:02 (5824): No heartbeat from core client for 30 sec - exiting 05:36:03 (5824): No heartbeat from core client for 30 sec - exiting 05:36:04 (5824): No heartbeat from core client for 30 sec - exiting 05:36:05 (5824): No heartbeat from core client for 30 sec - exiting 05:36:06 (5824): No heartbeat from core client for 30 sec - exiting 05:36:07 (5824): No heartbeat from core client for 30 sec - exiting 05:36:08 (5824): No heartbeat from core client for 30 sec - exiting 05:36:09 (5824): No heartbeat from core client for 30 sec - exiting 05:36:10 (5824): No heartbeat from core client for 30 sec - exiting 05:36:11 (5824): No heartbeat from core client for 30 sec - exiting 05:36:12 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:42:44 (4400): No heartbeat from core client for 30 sec - exiting 16:42:45 (4400): No heartbeat from core client for 30 sec - exiting 16:42:46 (4400): No heartbeat from core client for 30 sec - exiting 16:42:47 (4400): No heartbeat from core client for 30 sec - exiting 16:42:48 (4400): No heartbeat from core client for 30 sec - exiting 16:42:49 (4400): No heartbeat from core client for 30 sec - exiting 16:42:50 (4400): No heartbeat from core client for 30 sec - exiting 16:42:51 (4400): No heartbeat from core client for 30 sec - exiting 16:42:52 (4400): No heartbeat from core client for 30 sec - exiting 16:42:53 (4400): No heartbeat from core client for 30 sec - exiting 16:42:54 (4400): No heartbeat from core client for 30 sec - exiting 16:42:55 (4400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:54 (5908): No heartbeat from core client for 30 sec - exiting 13:00:55 (5908): No heartbeat from core client for 30 sec - exiting 13:00:56 (5908): No heartbeat from core client for 30 sec - exiting 13:00:57 (5908): No heartbeat from core client for 30 sec - exiting 13:00:58 (5908): No heartbeat from core client for 30 sec - exiting 13:00:59 (5908): No heartbeat from core client for 30 sec - exiting 13:01:00 (5908): No heartbeat from core client for 30 sec - exiting 13:01:01 (5908): No heartbeat from core client for 30 sec - exiting 13:01:02 (5908): No heartbeat from core client for 30 sec - exiting 13:01:03 (5908): No heartbeat from core client for 30 sec - exiting 13:01:04 (5908): No heartbeat from core client for 30 sec - exiting 13:01:05 (5908): No heartbeat from core client for 30 sec - exiting 13:01:06 (5908): No heartbeat from core client for 30 sec - exiting 13:01:07 (5908): No heartbeat from core client for 30 sec - exiting 13:01:08 (5908): No heartbeat from core client for 30 sec - exiting 13:01:09 (5908): No heartbeat from core client for 30 sec - exiting 13:01:10 (5908): No heartbeat from core client for 30 sec - exiting 13:01:11 (5908): No heartbeat from core client for 30 sec - exiting 13:01:12 (5908): No heartbeat from core client for 30 sec - exiting 13:01:13 (5908): No heartbeat from core client for 30 sec - exiting 13:01:14 (5908): No heartbeat from core client for 30 sec - exiting 13:01:15 (5908): No heartbeat from core client for 30 sec - exiting 13:01:16 (5908): No heartbeat from core client for 30 sec - exiting 13:01:17 (5908): No heartbeat from core client for 30 sec - exiting 13:01:18 (5908): No heartbeat from core client for 30 sec - exiting 13:01:19 (5908): No heartbeat from core client for 30 sec - exiting 13:01:20 (5908): No heartbeat from core client for 30 sec - exiting 13:01:21 (5908): No heartbeat from core client for 30 sec - exiting 13:01:22 (5908): No heartbeat from core client for 30 sec - exiting 13:01:23 (5908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:19 (5840): No heartbeat from core client for 30 sec - exiting 12:18:20 (5840): No heartbeat from core client for 30 sec - exiting 12:18:21 (5840): No heartbeat from core client for 30 sec - exiting 12:18:22 (5840): No heartbeat from core client for 30 sec - exiting 12:18:23 (5840): No heartbeat from core client for 30 sec - exiting 12:18:24 (5840): No heartbeat from core client for 30 sec - exiting 12:18:25 (5840): No heartbeat from core client for 30 sec - exiting 12:18:26 (5840): No heartbeat from core client for 30 sec - exiting 12:18:27 (5840): No heartbeat from core client for 30 sec - exiting 12:18:28 (5840): No heartbeat from core client for 30 sec - exiting 12:18:29 (5840): No heartbeat from core client for 30 sec - exiting 12:18:30 (5840): No heartbeat from core client for 30 sec - exiting 12:18:31 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2004, iMonCtr=1 Model crash detected, will try to restart... 07:12:56 (5324): No heartbeat from core client for 30 sec - exiting 07:12:57 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:58 (5324): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 05:32:24 (5832): No heartbeat from core client for 30 sec - exiting 05:32:25 (5832): No heartbeat from core client for 30 sec - exiting 05:32:26 (5832): No heartbeat from core client for 30 sec - exiting 05:32:27 (5832): No heartbeat from core client for 30 sec - exiting 05:32:28 (5832): No heartbeat from core client for 30 sec - exiting 05:32:29 (5832): No heartbeat from core client for 30 sec - exiting 05:32:30 (5832): No heartbeat from core client for 30 sec - exiting 05:32:31 (5832): No heartbeat from core client for 30 sec - exiting 05:32:32 (5832): No heartbeat from core client for 30 sec - exiting 05:32:33 (5832): No heartbeat from core client for 30 sec - exiting 05:32:34 (5832): No heartbeat from core client for 30 sec - exiting 05:32:35 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:03 (4724): No heartbeat from core client for 30 sec - exiting 16:40:04 (4724): No heartbeat from core client for 30 sec - exiting 16:40:05 (4724): No heartbeat from core client for 30 sec - exiting 16:40:06 (4724): No heartbeat from core client for 30 sec - exiting 16:40:07 (4724): No heartbeat from core client for 30 sec - exiting 16:40:08 (4724): No heartbeat from core client for 30 sec - exiting 16:40:09 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:28 (5524): No heartbeat from core client for 30 sec - exiting 05:32:29 (5524): No heartbeat from core client for 30 sec - exiting 05:32:30 (5524): No heartbeat from core client for 30 sec - exiting 05:32:31 (5524): No heartbeat from core client for 30 sec - exiting 05:32:32 (5524): No heartbeat from core client for 30 sec - exiting 05:32:33 (5524): No heartbeat from core client for 30 sec - exiting 05:32:34 (5524): No heartbeat from core client for 30 sec - exiting 05:32:35 (5524): No heartbeat from core client for 30 sec - exiting 05:32:36 (5524): No heartbeat from core client for 30 sec - exiting 05:32:37 (5524): No heartbeat from core client for 30 sec - exiting 05:32:38 (5524): No heartbeat from core client for 30 sec - exiting 05:32:39 (5524): No heartbeat from core client for 30 sec - exiting 05:32:40 (5524): No heartbeat from core client for 30 sec - exiting 05:32:41 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:52 (4648): No heartbeat from core client for 30 sec - exiting 16:43:53 (4648): No heartbeat from core client for 30 sec - exiting 16:43:54 (4648): No heartbeat from core client for 30 sec - exiting 16:43:55 (4648): No heartbeat from core client for 30 sec - exiting 16:43:56 (4648): No heartbeat from core client for 30 sec - exiting 16:43:57 (4648): No heartbeat from core client for 30 sec - exiting 16:43:58 (4648): No heartbeat from core client for 30 sec - exiting 16:43:59 (4648): No heartbeat from core client for 30 sec - exiting 16:44:00 (4648): No heartbeat from core client for 30 sec - exiting 16:44:01 (4648): No heartbeat from core client for 30 sec - exiting 16:44:02 (4648): No heartbeat from core client for 30 sec - exiting 16:44:03 (4648): No heartbeat from core client for 30 sec - exiting 16:44:04 (4648): No heartbeat from core client for 30 sec - exiting 16:44:05 (4648): No heartbeat from core client for 30 sec - exiting 16:44:06 (4648): No heartbeat from core client for 30 sec - exiting 16:44:07 (4648): No heartbeat from core client for 30 sec - exiting 16:44:08 (4648): No heartbeat from core client for 30 sec - exiting 16:44:09 (4648): No heartbeat from core client for 30 sec - exiting 16:44:10 (4648): No heartbeat from core client for 30 sec - exiting 16:44:11 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:10 (452): No heartbeat from core client for 30 sec - exiting 05:38:12 (452): No heartbeat from core client for 30 sec - exiting 05:38:13 (452): No heartbeat from core client for 30 sec - exiting 05:38:14 (452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:42:21 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:11 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:43 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:31 (7856): No heartbeat from core client for 30 sec - exiting 16:45:32 (7856): No heartbeat from core client for 30 sec - exiting 16:45:33 (7856): No heartbeat from core client for 30 sec - exiting 16:45:34 (7856): No heartbeat from core client for 30 sec - exiting 16:45:35 (7856): No heartbeat from core client for 30 sec - exiting 16:45:36 (7856): No heartbeat from core client for 30 sec - exiting 16:45:37 (7856): No heartbeat from core client for 30 sec - exiting 16:45:38 (7856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:10 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:31:57 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5872, iMonCtr=1 Model crash detected, will try to restart... 12:33:41 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2013 20:04:26	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	1,036,800	1,965,882	1.8961
29 Sep 2013 01:26:28	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	1,010,880	1,921,368	1.9007
28 Sep 2013 09:40:16	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	984,960	1,872,467	1.9011
27 Sep 2013 18:33:51	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	959,040	1,821,987	1.8998
26 Sep 2013 23:04:15	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	933,120	1,773,349	1.9005
25 Sep 2013 09:25:22	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	907,200	1,724,677	1.9011
23 Sep 2013 09:36:37	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	881,280	1,676,604	1.9025
21 Sep 2013 18:50:41	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	855,360	1,626,321	1.9013
21 Sep 2013 04:24:12	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	829,440	1,576,171	1.9003
20 Sep 2013 08:44:16	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	803,520	1,525,207	1.8982
19 Sep 2013 18:03:16	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	777,600	1,474,806	1.8966
18 Sep 2013 10:38:58	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	751,680	1,424,110	1.8946
16 Sep 2013 10:27:30	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	725,760	1,373,303	1.8922
15 Sep 2013 12:50:17	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	699,840	1,322,292	1.8894
14 Sep 2013 12:59:07	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	673,920	1,271,261	1.8864
13 Sep 2013 08:05:56	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	648,000	1,220,324	1.8832
12 Sep 2013 09:44:45	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	622,080	1,170,137	1.8810
10 Sep 2013 08:59:28	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	596,160	1,119,237	1.8774
09 Sep 2013 00:26:14	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	570,240	1,068,523	1.8738
08 Sep 2013 00:33:55	1129647	15922048	hadcm3n_n5wu_1920_40_008377488_2	544,320	1,021,964	1.8775