Task 13405997

Name	hadcm3n_u18v_1980_40_007458122_0
Workunit	7655625
Created	22 Sep 2011, 13:10:17 UTC
Sent	26 Sep 2011, 2:12:00 UTC
Report deadline	26 Dec 2011, 9:39:11 UTC
Received	3 Mar 2013, 7:51:45 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1171696
Run time	23 days 22 hours 40 min 16 sec
CPU time	23 days 8 hours 6 min 55 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... 20:20:02 (10008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:03 (10008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:33:11 (10868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:15 (10868): No heartbeat from core client for 30 sec - exiting 20:33:16 (10868): No heartbeat from core client for 30 sec - exiting 20:33:17 (10868): No heartbeat from core client for 30 sec - exiting 20:33:18 (10868): No heartbeat from core client for 30 sec - exiting 20:33:19 (10868): No heartbeat from core client for 30 sec - exiting 20:33:23 (10868): No heartbeat from core client for 30 sec - exiting 20:33:24 (10868): No heartbeat from core client for 30 sec - exiting 20:33:25 (10868): No heartbeat from core client for 30 sec - exiting 20:33:26 (10868): No heartbeat from core client for 30 sec - exiting 20:33:27 (10868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:51:56 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:52:01 (3308): No heartbeat from core client for 30 sec - exiting 11:52:02 (3308): No heartbeat from core client for 30 sec - exiting 11:52:03 (3308): No heartbeat from core client for 30 sec - exiting 11:52:04 (3308): No heartbeat from core client for 30 sec - exiting 11:52:05 (3308): No heartbeat from core client for 30 sec - exiting 11:52:06 (3308): No heartbeat from core client for 30 sec - exiting 11:52:07 (3308): No heartbeat from core client for 30 sec - exiting 11:52:08 (3308): No heartbeat from core client for 30 sec - exiting 11:52:09 (3308): No heartbeat from core client for 30 sec - exiting 11:55:40 (8136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:43 (8136): No heartbeat from core client for 30 sec - exiting 11:55:44 (8136): No heartbeat from core client for 30 sec - exiting 11:55:45 (8136): No heartbeat from core client for 30 sec - exiting 11:55:46 (8136): No heartbeat from core client for 30 sec - exiting 11:55:47 (8136): No heartbeat from core client for 30 sec - exiting 11:59:19 (6296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:21 (6296): No heartbeat from core client for 30 sec - exiting 11:59:22 (6296): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6116, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:07:25 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4704, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:07:42 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:43 (3204): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:21:49 (7024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:57 (7024): No heartbeat from core client for 30 sec - exiting 03:21:58 (7024): No heartbeat from core client for 30 sec - exiting 03:21:59 (7024): No heartbeat from core client for 30 sec - exiting 03:22:57 (2872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:54:49 (152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=656, iMonCtr=1 Model crash detected, will try to restart... 22:02:50 (8372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:32 (9160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:40:25 (5908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:10:55 (7288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:57 (7288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:00:29 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:12:24 (7460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:28 (7460): No heartbeat from core client for 30 sec - exiting 20:12:29 (7460): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:53:41 (7204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:53:42 (7204): No heartbeat from core client for 30 sec - exiting 01:53:43 (7204): No heartbeat from core client for 30 sec - exiting 01:54:55 (7840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:01:52 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:06:41 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:13:47 (6296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:13:48 (6296): No heartbeat from core client for 30 sec - exiting 15:15:32 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:22:57 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:27:51 (2184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:29:10 (7124): No heartbeat from core client for 30 sec - exiting 15:29:11 (7124): No heartbeat from core client for 30 sec - exiting 15:29:12 (7124): No heartbeat from core client for 30 sec - exiting 15:29:13 (7124): No heartbeat from core client for 30 sec - exiting 15:29:14 (7124): No heartbeat from core client for 30 sec - exiting 15:29:15 (7124): No heartbeat from core client for 30 sec - exiting 15:29:16 (7124): No heartbeat from core client for 30 sec - exiting 15:29:17 (7124): No heartbeat from core client for 30 sec - exiting 15:29:18 (7124): No heartbeat from core client for 30 sec - exiting 15:29:19 (7124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:27 (1576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:40:28 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:45:29 (6644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:10:03 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:29:06 (4160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:07 (4160): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:30:54 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:41:33 (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:41:35 (6516): No heartbeat from core client for 30 sec - exiting 16:43:06 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:46:51 (7020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:48:21 (6780): No heartbeat from core client for 30 sec - exiting 16:48:22 (6780): No heartbeat from core client for 30 sec - exiting 16:48:23 (6780): No heartbeat from core client for 30 sec - exiting 16:48:24 (6780): No heartbeat from core client for 30 sec - exiting 16:48:25 (6780): No heartbeat from core client for 30 sec - exiting 16:48:26 (6780): No heartbeat from core client for 30 sec - exiting 16:48:27 (6780): No heartbeat from core client for 30 sec - exiting 16:48:29 (6780): No heartbeat from core client for 30 sec - exiting 16:48:30 (6780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:56:35 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:36 (4932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:12:19 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:07 (6852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:18 (6496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:24:08 (1064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:41:42 (5568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:41:43 (5568): No heartbeat from core client for 30 sec - exiting 17:49:14 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:50:51 (5868): No heartbeat from core client for 30 sec - exiting 17:50:52 (5868): No heartbeat from core client for 30 sec - exiting 17:50:53 (5868): No heartbeat from core client for 30 sec - exiting 17:50:54 (5868): No heartbeat from core client for 30 sec - exiting 17:50:55 (5868): No heartbeat from core client for 30 sec - exiting 17:50:56 (5868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:50:07 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:08:40 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:40 (2876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:36 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:37:04 (5548): No heartbeat from core client for 30 sec - exiting 09:37:05 (5548): No heartbeat from core client for 30 sec - exiting 09:37:07 (5548): No heartbeat from core client for 30 sec - exiting 09:37:08 (5548): No heartbeat from core client for 30 sec - exiting 09:37:09 (5548): No heartbeat from core client for 30 sec - exiting 09:37:10 (5548): No heartbeat from core client for 30 sec - exiting 09:37:11 (5548): No heartbeat from core client for 30 sec - exiting 09:37:12 (5548): No heartbeat from core client for 30 sec - exiting 09:37:13 (5548): No heartbeat from core client for 30 sec - exiting 09:37:14 (5548): No heartbeat from core client for 30 sec - exiting 09:37:15 (5548): No heartbeat from core client for 30 sec - exiting 09:37:17 (5548): No heartbeat from core client for 30 sec - exiting 09:37:18 (5548): No heartbeat from core client for 30 sec - exiting 09:37:19 (5548): No heartbeat from core client for 30 sec - exiting 09:37:20 (5548): No heartbeat from core client for 30 sec - exiting 09:37:21 (5548): No heartbeat from core client for 30 sec - exiting 09:37:22 (5548): No heartbeat from core client for 30 sec - exiting 09:37:23 (5548): No heartbeat from core client for 30 sec - exiting 09:37:24 (5548): No heartbeat from core client for 30 sec - exiting 09:37:26 (5548): No heartbeat from core client for 30 sec - exiting 09:37:27 (5548): No heartbeat from core client for 30 sec - exiting 09:37:28 (5548): No heartbeat from core client for 30 sec - exiting 09:37:29 (5548): No heartbeat from core client for 30 sec - exiting 09:37:30 (5548): No heartbeat from core client for 30 sec - exiting 09:37:31 (5548): No heartbeat from core client for 30 sec - exiting 09:37:32 (5548): No heartbeat from core client for 30 sec - exiting 09:37:33 (5548): No heartbeat from core client for 30 sec - exiting 09:37:34 (5548): No heartbeat from core client for 30 sec - exiting 09:37:35 (5548): No heartbeat from core client for 30 sec - exiting 09:37:37 (5548): No heartbeat from core client for 30 sec - exiting 09:37:38 (5548): No heartbeat from core client for 30 sec - exiting 09:37:39 (5548): No heartbeat from core client for 30 sec - exiting 09:37:40 (5548): No heartbeat from core client for 30 sec - exiting 09:37:41 (5548): No heartbeat from core client for 30 sec - exiting 09:37:42 (5548): No heartbeat from core client for 30 sec - exiting 09:37:43 (5548): No heartbeat from core client for 30 sec - exiting 09:37:44 (5548): No heartbeat from core client for 30 sec - exiting 09:37:45 (5548): No heartbeat from core client for 30 sec - exiting 09:37:47 (5548): No heartbeat from core client for 30 sec - exiting 09:37:48 (5548): No heartbeat from core client for 30 sec - exiting 09:37:49 (5548): No heartbeat from core client for 30 sec - exiting 09:37:50 (5548): No heartbeat from core client for 30 sec - exiting 09:37:51 (5548): No heartbeat from core client for 30 sec - exiting 09:37:52 (5548): No heartbeat from core client for 30 sec - exiting 09:37:53 (5548): No heartbeat from core client for 30 sec - exiting 09:37:54 (5548): No heartbeat from core client for 30 sec - exiting 09:37:56 (5548): No heartbeat from core client for 30 sec - exiting 09:37:57 (5548): No heartbeat from core client for 30 sec - exiting 09:37:58 (5548): No heartbeat from core client for 30 sec - exiting 09:37:59 (5548): No heartbeat from core client for 30 sec - exiting 09:38:00 (5548): No heartbeat from core client for 30 sec - exiting 09:38:01 (5548): No heartbeat from core client for 30 sec - exiting 09:38:02 (5548): No heartbeat from core client for 30 sec - exiting 09:38:03 (5548): No heartbeat from core client for 30 sec - exiting 09:38:04 (5548): No heartbeat from core client for 30 sec - exiting 09:38:06 (5548): No heartbeat from core client for 30 sec - exiting 09:38:07 (5548): No heartbeat from core client for 30 sec - exiting 09:38:08 (5548): No heartbeat from core client for 30 sec - exiting 09:38:09 (5548): No heartbeat from core client for 30 sec - exiting 09:38:10 (5548): No heartbeat from core client for 30 sec - exiting 09:38:11 (5548): No heartbeat from core client for 30 sec - exiting 09:38:12 (5548): No heartbeat from core client for 30 sec - exiting 09:38:13 (5548): No heartbeat from core client for 30 sec - exiting 09:38:14 (5548): No heartbeat from core client for 30 sec - exiting 09:38:15 (5548): No heartbeat from core client for 30 sec - exiting 09:38:17 (5548): No heartbeat from core client for 30 sec - exiting 09:38:18 (5548): No heartbeat from core client for 30 sec - exiting 09:38:19 (5548): No heartbeat from core client for 30 sec - exiting 09:38:20 (5548): No heartbeat from core client for 30 sec - exiting 09:38:21 (5548): No heartbeat from core client for 30 sec - exiting 09:38:22 (5548): No heartbeat from core client for 30 sec - exiting 09:38:23 (5548): No heartbeat from core client for 30 sec - exiting 09:38:24 (5548): No heartbeat from core client for 30 sec - exiting 09:38:25 (5548): No heartbeat from core client for 30 sec - exiting 09:38:26 (5548): No heartbeat from core client for 30 sec - exiting 09:38:28 (5548): No heartbeat from core client for 30 sec - exiting 09:38:29 (5548): No heartbeat from core client for 30 sec - exiting 09:38:30 (5548): No heartbeat from core client for 30 sec - exiting 09:38:31 (5548): No heartbeat from core client for 30 sec - exiting 09:38:32 (5548): No heartbeat from core client for 30 sec - exiting 09:38:33 (5548): No heartbeat from core client for 30 sec - exiting 09:38:34 (5548): No heartbeat from core client for 30 sec - exiting 09:38:35 (5548): No heartbeat from core client for 30 sec - exiting 09:38:36 (5548): No heartbeat from core client for 30 sec - exiting 09:38:37 (5548): No heartbeat from core client for 30 sec - exiting 09:38:38 (5548): No heartbeat from core client for 30 sec - exiting 09:38:40 (5548): No heartbeat from core client for 30 sec - exiting 09:38:41 (5548): No heartbeat from core client for 30 sec - exiting 09:38:42 (5548): No heartbeat from core client for 30 sec - exiting 09:38:43 (5548): No heartbeat from core client for 30 sec - exiting 09:38:44 (5548): No heartbeat from core client for 30 sec - exiting 09:38:45 (5548): No heartbeat from core client for 30 sec - exiting 09:38:46 (5548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:38:47 (5548): No heartbeat from core client for 30 sec - exiting 09:40:16 (3476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:06:44 (3708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:07:52 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:30:23 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:56 (1072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5908, iMonCtr=1 Model crash detected, will try to restart... 03:36:27 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Mar 2013 06:55:26	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	1,036,800	2,015,684	1.9441
02 Mar 2013 17:01:41	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	1,010,880	1,969,520	1.9483
01 Mar 2013 22:53:55	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	984,960	1,922,891	1.9523
01 Feb 2013 20:46:35	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	959,040	1,876,722	1.9569
01 Feb 2013 07:36:36	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	933,120	1,829,824	1.9610
31 Jan 2013 18:26:37	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	907,200	1,782,384	1.9647
31 Jan 2013 05:05:01	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	881,280	1,734,928	1.9686
30 Jan 2013 15:50:34	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	855,360	1,687,159	1.9725
30 Jan 2013 02:22:18	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	829,440	1,639,180	1.9762
29 Jan 2013 13:25:15	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	803,520	1,592,628	1.9821
29 Jan 2013 00:13:05	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	777,600	1,545,018	1.9869
28 Jan 2013 10:54:52	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	751,680	1,497,069	1.9916
27 Jan 2013 21:32:00	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	725,760	1,448,887	1.9964
27 Jan 2013 07:40:49	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	699,840	1,400,600	2.0013
17 Jan 2013 06:34:11	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	673,920	1,350,405	2.0038
16 Jan 2013 15:56:09	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	648,000	1,298,017	2.0031
16 Jan 2013 00:55:35	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	622,080	1,247,088	2.0047
15 Jan 2013 09:18:43	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	596,160	1,194,893	2.0043
14 Jan 2013 17:46:45	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	570,240	1,142,226	2.0031
14 Jan 2013 02:07:06	1171696	13405997	hadcm3n_u18v_1980_40_007458122_0	544,320	1,089,903	2.0023