Task 13740538

Name	hadcm3n_y8p2_1940_40_007607759_2
Workunit	7785889
Created	6 Dec 2011, 23:44:00 UTC
Sent	6 Dec 2011, 23:48:23 UTC
Report deadline	7 Mar 2012, 7:15:34 UTC
Received	27 Jan 2012, 18:16:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1072815
Run time	10 days 17 hours 7 min 46 sec
CPU time	10 days 13 hours 40 min 36 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 19:44:54 (6284): No heartbeat from core client for 30 sec - exiting 19:44:55 (6284): No heartbeat from core client for 30 sec - exiting 19:44:56 (6284): No heartbeat from core client for 30 sec - exiting 19:44:57 (6284): No heartbeat from core client for 30 sec - exiting 19:44:58 (6284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:16 (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:46:10 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:31 (5584): No heartbeat from core client for 30 sec - exiting 19:02:32 (5584): No heartbeat from core client for 30 sec - exiting 19:02:33 (5584): No heartbeat from core client for 30 sec - exiting 19:02:34 (5584): No heartbeat from core client for 30 sec - exiting 19:02:35 (5584): No heartbeat from core client for 30 sec - exiting 19:02:36 (5584): No heartbeat from core client for 30 sec - exiting 19:02:37 (5584): No heartbeat from core client for 30 sec - exiting 19:02:38 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:13 (6160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:24:37 (5520): No heartbeat from core client for 30 sec - exiting 11:24:38 (5520): No heartbeat from core client for 30 sec - exiting 11:24:39 (5520): No heartbeat from core client for 30 sec - exiting 11:24:40 (5520): No heartbeat from core client for 30 sec - exiting 11:24:41 (5520): No heartbeat from core client for 30 sec - exiting 11:24:42 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:43 (5520): No heartbeat from core client for 30 sec - exiting 11:24:44 (5520): No heartbeat from core client for 30 sec - exiting 11:24:45 (5520): No heartbeat from core client for 30 sec - exiting 11:24:46 (5520): No heartbeat from core client for 30 sec - exiting 11:24:47 (5520): No heartbeat from core client for 30 sec - exiting 11:24:48 (5520): No heartbeat from core client for 30 sec - exiting 11:24:49 (5520): No heartbeat from core client for 30 sec - exiting 11:24:50 (5520): No heartbeat from core client for 30 sec - exiting 14:23:27 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:23:28 (5088): No heartbeat from core client for 30 sec - exiting 14:24:26 (6532): No heartbeat from core client for 30 sec - exiting 14:24:28 (6532): No heartbeat from core client for 30 sec - exiting 14:24:29 (6532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:10 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:11 (6568): No heartbeat from core client for 30 sec - exiting 12:25:00 (5520): No heartbeat from core client for 30 sec - exiting 12:25:02 (5520): No heartbeat from core client for 30 sec - exiting 12:25:03 (5520): No heartbeat from core client for 30 sec - exiting 12:25:04 (5520): No heartbeat from core client for 30 sec - exiting 12:25:05 (5520): No heartbeat from core client for 30 sec - exiting 12:25:06 (5520): No heartbeat from core client for 30 sec - exiting 12:25:07 (5520): No heartbeat from core client for 30 sec - exiting 12:25:08 (5520): No heartbeat from core client for 30 sec - exiting 12:25:09 (5520): No heartbeat from core client for 30 sec - exiting 12:25:10 (5520): No heartbeat from core client for 30 sec - exiting 12:25:11 (5520): No heartbeat from core client for 30 sec - exiting 12:25:12 (5520): No heartbeat from core client for 30 sec - exiting 12:25:13 (5520): No heartbeat from core client for 30 sec - exiting 12:25:14 (5520): No heartbeat from core client for 30 sec - exiting 12:25:15 (5520): No heartbeat from core client for 30 sec - exiting 12:25:16 (5520): No heartbeat from core client for 30 sec - exiting 12:25:18 (5520): No heartbeat from core client for 30 sec - exiting 12:25:19 (5520): No heartbeat from core client for 30 sec - exiting 12:25:20 (5520): No heartbeat from core client for 30 sec - exiting 12:25:21 (5520): No heartbeat from core client for 30 sec - exiting 12:25:22 (5520): No heartbeat from core client for 30 sec - exiting 12:25:23 (5520): No heartbeat from core client for 30 sec - exiting 12:25:24 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:25 (5520): No heartbeat from core client for 30 sec - exiting 12:25:26 (5520): No heartbeat from core client for 30 sec - exiting 12:25:27 (5520): No heartbeat from core client for 30 sec - exiting 12:25:29 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:31:53 (6112): No heartbeat from core client for 30 sec - exiting 19:31:54 (6112): No heartbeat from core client for 30 sec - exiting 19:31:55 (6112): No heartbeat from core client for 30 sec - exiting 19:31:56 (6112): No heartbeat from core client for 30 sec - exiting 19:31:57 (6112): No heartbeat from core client for 30 sec - exiting 19:31:58 (6112): No heartbeat from core client for 30 sec - exiting 19:31:59 (6112): No heartbeat from core client for 30 sec - exiting 19:32:00 (6112): No heartbeat from core client for 30 sec - exiting 19:32:01 (6112): No heartbeat from core client for 30 sec - exiting 19:32:02 (6112): No heartbeat from core client for 30 sec - exiting 19:32:03 (6112): No heartbeat from core client for 30 sec - exiting 19:32:04 (6112): No heartbeat from core client for 30 sec - exiting 19:32:05 (6112): No heartbeat from core client for 30 sec - exiting 19:32:06 (6112): No heartbeat from core client for 30 sec - exiting 19:32:07 (6112): No heartbeat from core client for 30 sec - exiting 19:32:08 (6112): No heartbeat from core client for 30 sec - exiting 19:32:10 (6112): No heartbeat from core client for 30 sec - exiting 19:32:11 (6112): No heartbeat from core client for 30 sec - exiting 19:32:12 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:13 (6112): No heartbeat from core client for 30 sec - exiting 19:32:14 (6112): No heartbeat from core client for 30 sec - exiting 19:32:15 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=1 Model crash detected, will try to restart... 21:38:04 (5264): No heartbeat from core client for 30 sec - exiting 21:38:05 (5264): No heartbeat from core client for 30 sec - exiting 21:38:06 (5264): No heartbeat from core client for 30 sec - exiting 21:38:07 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:08 (5264): No heartbeat from core client for 30 sec - exiting 21:38:09 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:45:05 (6000): No heartbeat from core client for 30 sec - exiting 19:45:06 (6000): No heartbeat from core client for 30 sec - exiting 19:45:07 (6000): No heartbeat from core client for 30 sec - exiting 19:45:08 (6000): No heartbeat from core client for 30 sec - exiting 19:45:09 (6000): No heartbeat from core client for 30 sec - exiting 19:45:10 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:11 (6000): No heartbeat from core client for 30 sec - exiting 19:45:12 (6000): No heartbeat from core client for 30 sec - exiting 19:45:13 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:34:26 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:18:19 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:13:07 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:14:11 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:05 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:35:24 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:41:41 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:32:16 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:23:07 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:27:11 (5972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:12 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:25:32 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:37:40 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:27:39 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:40:42 (5440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:42:16 (2468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:04:35 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:00:25 (5604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:00:33 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:03:07 (2412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:54:23 (6084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:42:59 (1564): No heartbeat from core client for 30 sec - exiting 23:43:00 (1564): No heartbeat from core client for 30 sec - exiting 23:43:01 (1564): No heartbeat from core client for 30 sec - exiting 23:43:02 (1564): No heartbeat from core client for 30 sec - exiting 23:43:03 (1564): No heartbeat from core client for 30 sec - exiting 23:43:04 (1564): No heartbeat from core client for 30 sec - exiting 23:43:05 (1564): No heartbeat from core client for 30 sec - exiting 23:43:06 (1564): No heartbeat from core client for 30 sec - exiting 23:43:07 (1564): No heartbeat from core client for 30 sec - exiting 23:43:08 (1564): No heartbeat from core client for 30 sec - exiting 23:43:09 (1564): No heartbeat from core client for 30 sec - exiting 23:43:10 (1564): No heartbeat from core client for 30 sec - exiting 23:43:11 (1564): No heartbeat from core client for 30 sec - exiting 23:43:12 (1564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:04 (6772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:05 (6772): No heartbeat from core client for 30 sec - exiting 01:18:45 (6024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:38 (5396): No heartbeat from core client for 30 sec - exiting 18:34:39 (5396): No heartbeat from core client for 30 sec - exiting 18:34:40 (5396): No heartbeat from core client for 30 sec - exiting 18:34:42 (5396): No heartbeat from core client for 30 sec - exiting 18:34:43 (5396): No heartbeat from core client for 30 sec - exiting 18:34:44 (5396): No heartbeat from core client for 30 sec - exiting 18:34:45 (5396): No heartbeat from core client for 30 sec - exiting 18:34:46 (5396): No heartbeat from core client for 30 sec - exiting 18:34:47 (5396): No heartbeat from core client for 30 sec - exiting 18:34:48 (5396): No heartbeat from core client for 30 sec - exiting 18:34:49 (5396): No heartbeat from core client for 30 sec - exiting 18:34:50 (5396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:51 (5396): No heartbeat from core client for 30 sec - exiting 18:34:52 (5396): No heartbeat from core client for 30 sec - exiting 18:34:54 (5396): No heartbeat from core client for 30 sec - exiting 18:34:55 (5396): No heartbeat from core client for 30 sec - exiting 18:34:56 (5396): No heartbeat from core client for 30 sec - exiting 18:34:57 (5396): No heartbeat from core client for 30 sec - exiting 18:36:32 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:25 (5216): No heartbeat from core client for 30 sec - exiting 19:51:26 (5216): No heartbeat from core client for 30 sec - exiting 19:51:27 (5216): No heartbeat from core client for 30 sec - exiting 19:51:28 (5216): No heartbeat from core client for 30 sec - exiting 19:51:29 (5216): No heartbeat from core client for 30 sec - exiting 19:51:31 (5216): No heartbeat from core client for 30 sec - exiting 19:51:32 (5216): No heartbeat from core client for 30 sec - exiting 19:51:33 (5216): No heartbeat from core client for 30 sec - exiting 19:51:34 (5216): No heartbeat from core client for 30 sec - exiting 19:51:35 (5216): No heartbeat from core client for 30 sec - exiting 19:51:36 (5216): No heartbeat from core client for 30 sec - exiting 19:51:37 (5216): No heartbeat from core client for 30 sec - exiting 19:51:38 (5216): No heartbeat from core client for 30 sec - exiting 19:51:39 (5216): No heartbeat from core client for 30 sec - exiting 19:51:40 (5216): No heartbeat from core client for 30 sec - exiting 19:51:42 (5216): No heartbeat from core client for 30 sec - exiting 19:51:43 (5216): No heartbeat from core client for 30 sec - exiting 19:51:44 (5216): No heartbeat from core client for 30 sec - exiting 19:51:45 (5216): No heartbeat from core client for 30 sec - exiting 19:51:46 (5216): No heartbeat from core client for 30 sec - exiting 19:51:47 (5216): No heartbeat from core client for 30 sec - exiting 19:51:48 (5216): No heartbeat from core client for 30 sec - exiting 19:51:49 (5216): No heartbeat from core client for 30 sec - exiting 19:51:50 (5216): No heartbeat from core client for 30 sec - exiting 19:51:51 (5216): No heartbeat from core client for 30 sec - exiting 19:51:52 (5216): No heartbeat from core client for 30 sec - exiting 19:51:54 (5216): No heartbeat from core client for 30 sec - exiting 19:51:55 (5216): No heartbeat from core client for 30 sec - exiting 19:51:56 (5216): No heartbeat from core client for 30 sec - exiting 19:51:57 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:58 (5216): No heartbeat from core client for 30 sec - exiting 19:51:59 (5216): No heartbeat from core client for 30 sec - exiting 19:52:00 (5216): No heartbeat from core client for 30 sec - exiting 19:52:01 (5216): No heartbeat from core client for 30 sec - exiting 19:52:02 (5216): No heartbeat from core client for 30 sec - exiting 19:52:03 (5216): No heartbeat from core client for 30 sec - exiting 19:52:05 (5216): No heartbeat from core client for 30 sec - exiting 19:52:06 (5216): No heartbeat from core client for 30 sec - exiting 19:52:07 (5216): No heartbeat from core client for 30 sec - exiting 19:52:08 (5216): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5304, iMonCtr=1 Model crash detected, will try to restart... 19:31:00 (5172): No heartbeat from core client for 30 sec - exiting 19:31:01 (5172): No heartbeat from core client for 30 sec - exiting 19:31:02 (5172): No heartbeat from core client for 30 sec - exiting 19:31:03 (5172): No heartbeat from core client for 30 sec - exiting 19:31:04 (5172): No heartbeat from core client for 30 sec - exiting 19:31:05 (5172): No heartbeat from core client for 30 sec - exiting 19:31:06 (5172): No heartbeat from core client for 30 sec - exiting 19:31:07 (5172): No heartbeat from core client for 30 sec - exiting 19:31:08 (5172): No heartbeat from core client for 30 sec - exiting 19:31:09 (5172): No heartbeat from core client for 30 sec - exiting 19:31:10 (5172): No heartbeat from core client for 30 sec - exiting 19:31:11 (5172): No heartbeat from core client for 30 sec - exiting 19:31:12 (5172): No heartbeat from core client for 30 sec - exiting 19:31:13 (5172): No heartbeat from core client for 30 sec - exiting 19:31:14 (5172): No heartbeat from core client for 30 sec - exiting 19:31:15 (5172): No heartbeat from core client for 30 sec - exiting 19:31:16 (5172): No heartbeat from core client for 30 sec - exiting 19:31:17 (5172): No heartbeat from core client for 30 sec - exiting 19:31:18 (5172): No heartbeat from core client for 30 sec - exiting 19:31:19 (5172): No heartbeat from core client for 30 sec - exiting 19:31:20 (5172): No heartbeat from core client for 30 sec - exiting 19:31:21 (5172): No heartbeat from core client for 30 sec - exiting 19:31:22 (5172): No heartbeat from core client for 30 sec - exiting 19:31:23 (5172): No heartbeat from core client for 30 sec - exiting 19:31:24 (5172): No heartbeat from core client for 30 sec - exiting 19:31:25 (5172): No heartbeat from core client for 30 sec - exiting 19:31:26 (5172): No heartbeat from core client for 30 sec - exiting 19:31:27 (5172): No heartbeat from core client for 30 sec - exiting 19:31:28 (5172): No heartbeat from core client for 30 sec - exiting 19:31:29 (5172): No heartbeat from core client for 30 sec - exiting 19:31:30 (5172): No heartbeat from core client for 30 sec - exiting 19:31:31 (5172): No heartbeat from core client for 30 sec - exiting 19:31:32 (5172): No heartbeat from core client for 30 sec - exiting 19:31:34 (5172): No heartbeat from core client for 30 sec - exiting 19:31:35 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:15 (5716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:59 (6420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:13 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:17 (5176): No heartbeat from core client for 30 sec - exiting 12:26:18 (5176): No heartbeat from core client for 30 sec - exiting 12:26:19 (5176): No heartbeat from core client for 30 sec - exiting 12:26:20 (5176): No heartbeat from core client for 30 sec - exiting 12:26:21 (5176): No heartbeat from core client for 30 sec - exiting 12:26:22 (5176): No heartbeat from core client for 30 sec - exiting 12:26:23 (5176): No heartbeat from core client for 30 sec - exiting 12:26:25 (5176): No heartbeat from core client for 30 sec - exiting 12:26:26 (5176): No heartbeat from core client for 30 sec - exiting 12:26:27 (5176): No heartbeat from core client for 30 sec - exiting 12:26:28 (5176): No heartbeat from core client for 30 sec - exiting 12:26:29 (5176): No heartbeat from core client for 30 sec - exiting 12:26:30 (5176): No heartbeat from core client for 30 sec - exiting 12:26:31 (5176): No heartbeat from core client for 30 sec - exiting 12:26:32 (5176): No heartbeat from core client for 30 sec - exiting 12:26:33 (5176): No heartbeat from core client for 30 sec - exiting 12:26:34 (5176): No heartbeat from core client for 30 sec - exiting 12:26:35 (5176): No heartbeat from core client for 30 sec - exiting 12:26:36 (5176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:23 (3448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:24 (3448): No heartbeat from core client for 30 sec - exiting 01:00:11 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:15:27 (3056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:16:10 (4564): No heartbeat from core client for 30 sec - exiting 01:16:11 (4564): No heartbeat from core client for 30 sec - exiting 01:16:12 (4564): No heartbeat from core client for 30 sec - exiting 01:16:13 (4564): No heartbeat from core client for 30 sec - exiting 01:16:14 (4564): No heartbeat from core client for 30 sec - exiting 01:16:15 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:16:16 (4564): No heartbeat from core client for 30 sec - exiting 12:03:27 (5516): No heartbeat from core client for 30 sec - exiting 12:03:28 (5516): No heartbeat from core client for 30 sec - exiting 12:03:29 (5516): No heartbeat from core client for 30 sec - exiting 12:03:30 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:39 (3732): No heartbeat from core client for 30 sec - exiting 19:31:40 (3732): No heartbeat from core client for 30 sec - exiting 19:31:41 (3732): No heartbeat from core client for 30 sec - exiting 19:31:42 (3732): No heartbeat from core client for 30 sec - exiting 19:31:43 (3732): No heartbeat from core client for 30 sec - exiting 19:31:44 (3732): No heartbeat from core client for 30 sec - exiting 19:31:45 (3732): No heartbeat from core client for 30 sec - exiting 19:31:46 (3732): No heartbeat from core client for 30 sec - exiting 19:31:47 (3732): No heartbeat from core client for 30 sec - exiting 19:31:48 (3732): No heartbeat from core client for 30 sec - exiting 19:31:49 (3732): No heartbeat from core client for 30 sec - exiting 19:31:50 (3732): No heartbeat from core client for 30 sec - exiting 19:31:51 (3732): No heartbeat from core client for 30 sec - exiting 19:31:52 (3732): No heartbeat from core client for 30 sec - exiting 19:31:53 (3732): No heartbeat from core client for 30 sec - exiting 19:31:54 (3732): No heartbeat from core client for 30 sec - exiting 19:31:55 (3732): No heartbeat from core client for 30 sec - exiting 19:31:56 (3732): No heartbeat from core client for 30 sec - exiting 19:31:57 (3732): No heartbeat from core client for 30 sec - exiting 19:31:58 (3732): No heartbeat from core client for 30 sec - exiting 19:31:59 (3732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:25 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:42 (6124): No heartbeat from core client for 30 sec - exiting 19:10:43 (6124): No heartbeat from core client for 30 sec - exiting 19:10:44 (6124): No heartbeat from core client for 30 sec - exiting 19:10:45 (6124): No heartbeat from core client for 30 sec - exiting 19:10:46 (6124): No heartbeat from core client for 30 sec - exiting 19:10:47 (6124): No heartbeat from core client for 30 sec - exiting 19:10:48 (6124): No heartbeat from core client for 30 sec - exiting 19:10:49 (6124): No heartbeat from core client for 30 sec - exiting 19:10:50 (6124): No heartbeat from core client for 30 sec - exiting 19:10:51 (6124): No heartbeat from core client for 30 sec - exiting 19:10:53 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:29 (5376): No heartbeat from core client for 30 sec - exiting 19:33:30 (5376): No heartbeat from core client for 30 sec - exiting 19:33:32 (5376): No heartbeat from core client for 30 sec - exiting 19:33:33 (5376): No heartbeat from core client for 30 sec - exiting 19:33:34 (5376): No heartbeat from core client for 30 sec - exiting 19:33:35 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:25 (5440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:40 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:16 (6072): No heartbeat from core client for 30 sec - exiting 19:23:17 (6072): No heartbeat from core client for 30 sec - exiting 19:23:18 (6072): No heartbeat from core client for 30 sec - exiting 19:23:19 (6072): No heartbeat from core client for 30 sec - exiting 19:23:20 (6072): No heartbeat from core client for 30 sec - exiting 19:23:21 (6072): No heartbeat from core client for 30 sec - exiting 19:23:22 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:23 (6072): No heartbeat from core client for 30 sec - exiting 12:07:18 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:30:50 (1384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C11:48:25 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:47 (1960): No heartbeat from core client for 30 sec - exiting 12:04:48 (1960): No heartbeat from core client for 30 sec - exiting 12:04:49 (1960): No heartbeat from core client for 30 sec - exiting 12:04:50 (1960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:51 (1960): No heartbeat from core client for 30 sec - exiting 14:15:13 (5640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:34 (6352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:54 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:18:34 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:04 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:18 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5816, iMonCtr=1 Model crash detected, will try to restart... 18:09:31 (880): No heartbeat from core client for 30 sec - exiting 18:09:32 (880): No heartbeat from core client for 30 sec - exiting 18:09:33 (880): No heartbeat from core client for 30 sec - exiting 18:09:34 (880): No heartbeat from core client for 30 sec - exiting 18:09:35 (880): No heartbeat from core client for 30 sec - exiting 18:09:36 (880): No heartbeat from core client for 30 sec - exiting 18:09:37 (880): No heartbeat from core client for 30 sec - exiting 18:09:38 (880): No heartbeat from core client for 30 sec - exiting 18:09:39 (880): No heartbeat from core client for 30 sec - exiting 18:09:40 (880): No heartbeat from core client for 30 sec - exiting 18:09:41 (880): No heartbeat from core client for 30 sec - exiting 18:09:42 (880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:44 (880): No heartbeat from core client for 30 sec - exiting 18:09:45 (880): No heartbeat from core client for 30 sec - exiting 18:09:46 (880): No heartbeat from core client for 30 sec - exiting 18:09:47 (880): No heartbeat from core client for 30 sec - exiting 18:09:48 (880): No heartbeat from core client for 30 sec - exiting 18:09:49 (880): No heartbeat from core client for 30 sec - exiting 18:09:50 (880): No heartbeat from core client for 30 sec - exiting 18:09:51 (880): No heartbeat from core client for 30 sec - exiting 18:09:52 (880): No heartbeat from core client for 30 sec - exiting 18:09:53 (880): No heartbeat from core client for 30 sec - exiting 22:13:49 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:50:59 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:05:05 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:25:19 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:25:21 (4776): No heartbeat from core client for 30 sec - exiting 17:25:22 (4776): No heartbeat from core client for 30 sec - exiting 17:25:23 (4776): No heartbeat from core client for 30 sec - exiting 17:27:40 (4048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6516, iMonCtr=1 Model crash detected, will try to restart... 19:10:56 (1624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:57 (1624): No heartbeat from core client for 30 sec - exiting 19:10:58 (1624): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4596, iMonCtr=1 Model crash detected, will try to restart... 19:23:39 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:55 (5960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:56 (5960): No heartbeat from core client for 30 sec - exiting 19:10:09 (2088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:35:06 (6240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jan 2012 23:02:57	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	518,400	913,230	1.7616
24 Jan 2012 23:20:16	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	492,480	867,322	1.7611
23 Jan 2012 00:08:20	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	466,560	822,395	1.7627
22 Jan 2012 01:19:35	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	440,640	777,198	1.7638
21 Jan 2012 12:36:38	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	414,720	732,887	1.7672
19 Jan 2012 21:57:03	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	388,800	687,486	1.7682
17 Jan 2012 23:26:56	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	362,880	641,997	1.7692
15 Jan 2012 22:17:16	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	336,960	596,789	1.7711
14 Jan 2012 23:28:30	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	311,040	552,455	1.7762
14 Jan 2012 00:00:10	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	285,120	506,512	1.7765
11 Jan 2012 22:25:05	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	259,200	460,491	1.7766
09 Jan 2012 21:55:41	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	233,280	414,763	1.7780
08 Jan 2012 15:11:21	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	207,360	368,454	1.7769
07 Jan 2012 15:18:36	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	181,440	323,258	1.7816
05 Jan 2012 22:50:20	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	155,520	277,323	1.7832
03 Jan 2012 22:28:19	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	129,600	231,710	1.7879
14 Dec 2011 18:49:57	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	103,680	186,280	1.7967
11 Dec 2011 17:19:20	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	77,760	139,121	1.7891
10 Dec 2011 16:42:52	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	51,840	91,968	1.7741
09 Dec 2011 00:15:35	1072815	13740538	hadcm3n_y8p2_1940_40_007607759_2	25,920	46,381	1.7894