Task 13412976

Name	hadcm3n_u1vs_1980_40_007460823_1
Workunit	7658326
Created	23 Sep 2011, 1:04:48 UTC
Sent	23 Sep 2011, 19:20:45 UTC
Report deadline	24 Dec 2011, 2:47:56 UTC
Received	30 Oct 2011, 18:25:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1157390
Run time	32 days 2 hours 10 min
CPU time	32 days 0 hours 41 min 8 sec
Validate state	Invalid
Credit	11,819.52
Device peak FLOPS	1.38 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> eat from core client for 30 sec - exiting 12:39:22 (16362): No heartbeat from core client for 30 sec - exiting 12:39:23 (16362): No heartbeat from core client for 30 sec - exiting 12:39:24 (16362): No heartbeat from core client for 30 sec - exiting 12:39:25 (16362): No heartbeat from core client for 30 sec - exiting 12:39:26 (16362): No heartbeat from core client for 30 sec - exiting 12:39:27 (16362): No heartbeat from core client for 30 sec - exiting 12:39:28 (16362): No heartbeat from core client for 30 sec - exiting 12:39:29 (16362): No heartbeat from core client for 30 sec - exiting 12:39:30 (16362): No heartbeat from core client for 30 sec - exiting 12:39:31 (16362): No heartbeat from core client for 30 sec - exiting 12:39:32 (16362): No heartbeat from core client for 30 sec - exiting 12:39:33 (16362): No heartbeat from core client for 30 sec - exiting 12:39:34 (16362): No heartbeat from core client for 30 sec - exiting 12:39:35 (16362): No heartbeat from core client for 30 sec - exiting 12:39:36 (16362): No heartbeat from core client for 30 sec - exiting 12:39:37 (16362): No heartbeat from core client for 30 sec - exiting 12:39:38 (16362): No heartbeat from core client for 30 sec - exiting 12:39:39 (16362): No heartbeat from core client for 30 sec - exiting 12:39:41 (16362): No heartbeat from core client for 30 sec - exiting 12:39:42 (16362): No heartbeat from core client for 30 sec - exiting 12:39:43 (16362): No heartbeat from core client for 30 sec - exiting 12:39:44 (16362): No heartbeat from core client for 30 sec - exiting 12:39:45 (16362): No heartbeat from core client for 30 sec - exiting 12:39:46 (16362): No heartbeat from core client for 30 sec - exiting 12:39:47 (16362): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:29 (16416): No heartbeat from core client for 30 sec - exiting 12:41:30 (16416): No heartbeat from core client for 30 sec - exiting 12:41:31 (16416): No heartbeat from core client for 30 sec - exiting 12:41:32 (16416): No heartbeat from core client for 30 sec - exiting 12:41:33 (16416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:44:12 (16446): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:47:31 (16497): No heartbeat from core client for 30 sec - exiting 12:47:33 (16497): No heartbeat from core client for 30 sec - exiting 12:47:34 (16497): No heartbeat from core client for 30 sec - exiting 12:47:35 (16497): No heartbeat from core client for 30 sec - exiting 12:47:36 (16497): No heartbeat from core client for 30 sec - exiting 12:47:37 (16497): No heartbeat from core client for 30 sec - exiting 12:47:38 (16497): No heartbeat from core client for 30 sec - exiting 12:47:39 (16497): No heartbeat from core client for 30 sec - exiting 12:47:40 (16497): No heartbeat from core client for 30 sec - exiting 12:47:41 (16497): No heartbeat from core client for 30 sec - exiting 12:47:42 (16497): No heartbeat from core client for 30 sec - exiting 12:47:43 (16497): No heartbeat from core client for 30 sec - exiting 12:47:44 (16497): No heartbeat from core client for 30 sec - exiting 12:47:45 (16497): No heartbeat from core client for 30 sec - exiting 12:47:47 (16497): No heartbeat from core client for 30 sec - exiting 12:47:48 (16497): No heartbeat from core client for 30 sec - exiting 12:47:49 (16497): No heartbeat from core client for 30 sec - exiting 12:47:50 (16497): No heartbeat from core client for 30 sec - exiting 12:47:51 (16497): No heartbeat from core client for 30 sec - exiting 12:47:52 (16497): No heartbeat from core client for 30 sec - exiting 12:47:53 (16497): No heartbeat from core client for 30 sec - exiting 12:47:54 (16497): No heartbeat from core client for 30 sec - exiting 12:47:55 (16497): No heartbeat from core client for 30 sec - exiting 12:47:57 (16497): No heartbeat from core client for 30 sec - exiting 12:47:58 (16497): No heartbeat from core client for 30 sec - exiting 12:47:59 (16497): No heartbeat from core client for 30 sec - exiting 12:48:00 (16497): No heartbeat from core client for 30 sec - exiting 12:48:01 (16497): No heartbeat from core client for 30 sec - exiting 12:48:02 (16497): No heartbeat from core client for 30 sec - exiting 12:48:03 (16497): No heartbeat from core client for 30 sec - exiting 12:48:04 (16497): No heartbeat from core client for 30 sec - exiting 12:48:05 (16497): No heartbeat from core client for 30 sec - exiting 12:48:06 (16497): No heartbeat from core client for 30 sec - exiting 12:48:07 (16497): No heartbeat from core client for 30 sec - exiting 12:48:08 (16497): No heartbeat from core client for 30 sec - exiting 12:48:09 (16497): No heartbeat from core client for 30 sec - exiting 12:48:10 (16497): No heartbeat from core client for 30 sec - exiting 12:48:11 (16497): No heartbeat from core client for 30 sec - exiting 12:48:12 (16497): No heartbeat from core client for 30 sec - exiting 12:48:13 (16497): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:50:16 (16552): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:52:02 (16596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:23 (16659): No heartbeat from core client for 30 sec - exiting 12:54:24 (16659): No heartbeat from core client for 30 sec - exiting 12:54:25 (16659): No heartbeat from core client for 30 sec - exiting 12:54:26 (16659): No heartbeat from core client for 30 sec - exiting 12:54:27 (16659): No heartbeat from core client for 30 sec - exiting 12:54:28 (16659): No heartbeat from core client for 30 sec - exiting 12:54:29 (16659): No heartbeat from core client for 30 sec - exiting 12:54:30 (16659): No heartbeat from core client for 30 sec - exiting 12:54:31 (16659): No heartbeat from core client for 30 sec - exiting 12:54:32 (16659): No heartbeat from core client for 30 sec - exiting 12:54:33 (16659): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:33 (16715): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:28 (16725): No heartbeat from core client for 30 sec - exiting 13:06:29 (16725): No heartbeat from core client for 30 sec - exiting 13:06:30 (16725): No heartbeat from core client for 30 sec - exiting 13:06:31 (16725): No heartbeat from core client for 30 sec - exiting 13:06:32 (16725): No heartbeat from core client for 30 sec - exiting 13:06:33 (16725): No heartbeat from core client for 30 sec - exiting 13:06:34 (16725): No heartbeat from core client for 30 sec - exiting 13:06:35 (16725): No heartbeat from core client for 30 sec - exiting 13:06:36 (16725): No heartbeat from core client for 30 sec - exiting 13:06:37 (16725): No heartbeat from core client for 30 sec - exiting 13:06:38 (16725): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:45 (16780): No heartbeat from core client for 30 sec - exiting 13:07:46 (16780): No heartbeat from core client for 30 sec - exiting 13:07:47 (16780): No heartbeat from core client for 30 sec - exiting 13:07:49 (16780): No heartbeat from core client for 30 sec - exiting 13:07:50 (16780): No heartbeat from core client for 30 sec - exiting 13:07:51 (16780): No heartbeat from core client for 30 sec - exiting 13:07:52 (16780): No heartbeat from core client for 30 sec - exiting 13:07:53 (16780): No heartbeat from core client for 30 sec - exiting 13:07:55 (16780): No heartbeat from core client for 30 sec - exiting 13:07:56 (16780): No heartbeat from core client for 30 sec - exiting 13:07:57 (16780): No heartbeat from core client for 30 sec - exiting 13:07:58 (16780): No heartbeat from core client for 30 sec - exiting 13:07:59 (16780): No heartbeat from core client for 30 sec - exiting 13:08:00 (16780): No heartbeat from core client for 30 sec - exiting 13:08:01 (16780): No heartbeat from core client for 30 sec - exiting 13:08:02 (16780): No heartbeat from core client for 30 sec - exiting 13:08:03 (16780): No heartbeat from core client for 30 sec - exiting 13:08:04 (16780): No heartbeat from core client for 30 sec - exiting 13:08:05 (16780): No heartbeat from core client for 30 sec - exiting 13:08:06 (16780): No heartbeat from core client for 30 sec - exiting 13:08:07 (16780): No heartbeat from core client for 30 sec - exiting 13:08:08 (16780): No heartbeat from core client for 30 sec - exiting 13:08:10 (16780): No heartbeat from core client for 30 sec - exiting 13:08:11 (16780): No heartbeat from core client for 30 sec - exiting 13:08:12 (16780): No heartbeat from core client for 30 sec - exiting 13:08:13 (16780): No heartbeat from core client for 30 sec - exiting 13:08:14 (16780): No heartbeat from core client for 30 sec - exiting 13:08:15 (16780): No heartbeat from core client for 30 sec - exiting 13:08:16 (16780): No heartbeat from core client for 30 sec - exiting 13:08:17 (16780): No heartbeat from core client for 30 sec - exiting 13:08:18 (16780): No heartbeat from core client for 30 sec - exiting 13:08:19 (16780): No heartbeat from core client for 30 sec - exiting 13:08:20 (16780): No heartbeat from core client for 30 sec - exiting 13:08:21 (16780): No heartbeat from core client for 30 sec - exiting 13:08:22 (16780): No heartbeat from core client for 30 sec - exiting 13:08:23 (16780): No heartbeat from core client for 30 sec - exiting 13:08:25 (16780): No heartbeat from core client for 30 sec - exiting 13:08:26 (16780): No heartbeat from core client for 30 sec - exiting 13:08:27 (16780): No heartbeat from core client for 30 sec - exiting 13:08:28 (16780): No heartbeat from core client for 30 sec - exiting 13:08:30 (16780): No heartbeat from core client for 30 sec - exiting 13:08:31 (16780): No heartbeat from core client for 30 sec - exiting 13:08:32 (16780): No heartbeat from core client for 30 sec - exiting 13:08:33 (16780): No heartbeat from core client for 30 sec - exiting 13:08:34 (16780): No heartbeat from core client for 30 sec - exiting 13:08:35 (16780): No heartbeat from core client for 30 sec - exiting 13:08:36 (16780): No heartbeat from core client for 30 sec - exiting 13:08:37 (16780): No heartbeat from core client for 30 sec - exiting 13:08:38 (16780): No heartbeat from core client for 30 sec - exiting 13:08:39 (16780): No heartbeat from core client for 30 sec - exiting 13:08:40 (16780): No heartbeat from core client for 30 sec - exiting 13:08:41 (16780): No heartbeat from core client for 30 sec - exiting 13:08:42 (16780): No heartbeat from core client for 30 sec - exiting 13:08:43 (16780): No heartbeat from core client for 30 sec - exiting 13:08:44 (16780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:16 (16840): No heartbeat from core client for 30 sec - exiting 13:10:17 (16840): No heartbeat from core client for 30 sec - exiting 13:10:18 (16840): No heartbeat from core client for 30 sec - exiting 13:10:19 (16840): No heartbeat from core client for 30 sec - exiting 13:10:20 (16840): No heartbeat from core client for 30 sec - exiting 13:10:21 (16840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:01 (16864): No heartbeat from core client for 30 sec - exiting 13:12:02 (16864): No heartbeat from core client for 30 sec - exiting 13:12:03 (16864): No heartbeat from core client for 30 sec - exiting 13:12:04 (16864): No heartbeat from core client for 30 sec - exiting 13:12:05 (16864): No heartbeat from core client for 30 sec - exiting 13:12:06 (16864): No heartbeat from core client for 30 sec - exiting 13:12:07 (16864): No heartbeat from core client for 30 sec - exiting 13:12:08 (16864): No heartbeat from core client for 30 sec - exiting 13:12:09 (16864): No heartbeat from core client for 30 sec - exiting 13:12:10 (16864): No heartbeat from core client for 30 sec - exiting 13:12:11 (16864): No heartbeat from core client for 30 sec - exiting 13:12:12 (16864): No heartbeat from core client for 30 sec - exiting 13:12:13 (16864): No heartbeat from core client for 30 sec - exiting 13:12:14 (16864): No heartbeat from core client for 30 sec - exiting 13:12:15 (16864): No heartbeat from core client for 30 sec - exiting 13:12:16 (16864): No heartbeat from core client for 30 sec - exiting 13:12:17 (16864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:17:55 (16917): No heartbeat from core client for 30 sec - exiting 13:17:57 (16917): No heartbeat from core client for 30 sec - exiting 13:17:58 (16917): No heartbeat from core client for 30 sec - exiting 13:17:59 (16917): No heartbeat from core client for 30 sec - exiting 13:18:00 (16917): No heartbeat from core client for 30 sec - exiting 13:18:01 (16917): No heartbeat from core client for 30 sec - exiting 13:18:03 (16917): No heartbeat from core client for 30 sec - exiting 13:18:04 (16917): No heartbeat from core client for 30 sec - exiting 13:18:05 (16917): No heartbeat from core client for 30 sec - exiting 13:18:06 (16917): No heartbeat from core client for 30 sec - exiting 13:18:08 (16917): No heartbeat from core client for 30 sec - exiting 13:18:09 (16917): No heartbeat from core client for 30 sec - exiting 13:18:10 (16917): No heartbeat from core client for 30 sec - exiting 13:18:11 (16917): No heartbeat from core client for 30 sec - exiting 13:18:12 (16917): No heartbeat from core client for 30 sec - exiting 13:18:13 (16917): No heartbeat from core client for 30 sec - exiting 13:18:14 (16917): No heartbeat from core client for 30 sec - exiting 13:18:15 (16917): No heartbeat from core client for 30 sec - exiting 13:18:16 (16917): No heartbeat from core client for 30 sec - exiting 13:18:17 (16917): No heartbeat from core client for 30 sec - exiting 13:18:18 (16917): No heartbeat from core client for 30 sec - exiting 13:18:19 (16917): No heartbeat from core client for 30 sec - exiting 13:18:20 (16917): No heartbeat from core client for 30 sec - exiting 13:18:21 (16917): No heartbeat from core client for 30 sec - exiting 13:18:22 (16917): No heartbeat from core client for 30 sec - exiting 13:18:23 (16917): No heartbeat from core client for 30 sec - exiting 13:18:24 (16917): No heartbeat from core client for 30 sec - exiting 13:18:25 (16917): No heartbeat from core client for 30 sec - exiting 13:18:26 (16917): No heartbeat from core client for 30 sec - exiting 13:18:28 (16917): No heartbeat from core client for 30 sec - exiting 13:18:29 (16917): No heartbeat from core client for 30 sec - exiting 13:18:30 (16917): No heartbeat from core client for 30 sec - exiting 13:18:31 (16917): No heartbeat from core client for 30 sec - exiting 13:18:32 (16917): No heartbeat from core client for 30 sec - exiting 13:18:33 (16917): No heartbeat from core client for 30 sec - exiting 13:18:34 (16917): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:20:11 (16969): No heartbeat from core client for 30 sec - exiting 13:20:12 (16969): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:21:55 (16999): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:33:52 (17049): No heartbeat from core client for 30 sec - exiting 13:33:55 (17049): No heartbeat from core client for 30 sec - exiting 13:33:56 (17049): No heartbeat from core client for 30 sec - exiting 13:33:57 (17049): No heartbeat from core client for 30 sec - exiting 13:33:58 (17049): No heartbeat from core client for 30 sec - exiting 13:33:59 (17049): No heartbeat from core client for 30 sec - exiting 13:34:00 (17049): No heartbeat from core client for 30 sec - exiting 13:34:01 (17049): No heartbeat from core client for 30 sec - exiting 13:34:02 (17049): No heartbeat from core client for 30 sec - exiting 13:34:03 (17049): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:37:05 (17121): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:49 (17177): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:41:34 (17228): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:43:23 (17281): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:45:00 (17329): No heartbeat from core client for 30 sec - exiting 13:45:02 (17329): No heartbeat from core client for 30 sec - exiting 13:45:04 (17329): No heartbeat from core client for 30 sec - exiting 13:45:05 (17329): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:43 (17388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:26 (17442): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:52:23 (17500): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:03:16 (17552): No heartbeat from core client for 30 sec - exiting 14:03:17 (17552): No heartbeat from core client for 30 sec - exiting 14:03:19 (17552): No heartbeat from core client for 30 sec - exiting 14:03:20 (17552): No heartbeat from core client for 30 sec - exiting 14:03:21 (17552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:31 (17604): No heartbeat from core client for 30 sec - exiting 14:04:32 (17604): No heartbeat from core client for 30 sec - exiting 14:04:33 (17604): No heartbeat from core client for 30 sec - exiting 14:04:34 (17604): No heartbeat from core client for 30 sec - exiting 14:04:35 (17604): No heartbeat from core client for 30 sec - exiting 14:04:36 (17604): No heartbeat from core client for 30 sec - exiting 14:04:37 (17604): No heartbeat from core client for 30 sec - exiting 14:04:38 (17604): No heartbeat from core client for 30 sec - exiting 14:04:39 (17604): No heartbeat from core client for 30 sec - exiting 14:04:40 (17604): No heartbeat from core client for 30 sec - exiting 14:04:41 (17604): No heartbeat from core client for 30 sec - exiting 14:04:42 (17604): No heartbeat from core client for 30 sec - exiting 14:04:43 (17604): No heartbeat from core client for 30 sec - exiting 14:04:44 (17604): No heartbeat from core client for 30 sec - exiting 14:04:45 (17604): No heartbeat from core client for 30 sec - exiting 14:04:46 (17604): No heartbeat from core client for 30 sec - exiting 14:04:47 (17604): No heartbeat from core client for 30 sec - exiting 14:04:48 (17604): No heartbeat from core client for 30 sec - exiting 14:04:49 (17604): No heartbeat from core client for 30 sec - exiting 14:04:50 (17604): No heartbeat from core client for 30 sec - exiting 14:04:51 (17604): No heartbeat from core client for 30 sec - exiting 14:04:52 (17604): No heartbeat from core client for 30 sec - exiting 14:04:53 (17604): No heartbeat from core client for 30 sec - exiting 14:04:54 (17604): No heartbeat from core client for 30 sec - exiting 14:04:55 (17604): No heartbeat from core client for 30 sec - exiting 14:04:56 (17604): No heartbeat from core client for 30 sec - exiting 14:04:57 (17604): No heartbeat from core client for 30 sec - exiting 14:04:58 (17604): No heartbeat from core client for 30 sec - exiting 14:04:59 (17604): No heartbeat from core client for 30 sec - exiting 14:05:00 (17604): No heartbeat from core client for 30 sec - exiting 14:05:01 (17604): No heartbeat from core client for 30 sec - exiting 14:05:02 (17604): No heartbeat from core client for 30 sec - exiting 14:05:03 (17604): No heartbeat from core client for 30 sec - exiting 14:05:04 (17604): No heartbeat from core client for 30 sec - exiting 14:05:05 (17604): No heartbeat from core client for 30 sec - exiting 14:05:06 (17604): No heartbeat from core client for 30 sec - exiting 14:05:07 (17604): No heartbeat from core client for 30 sec - exiting 14:05:08 (17604): No heartbeat from core client for 30 sec - exiting 14:05:09 (17604): No heartbeat from core client for 30 sec - exiting 14:05:10 (17604): No heartbeat from core client for 30 sec - exiting 14:05:11 (17604): No heartbeat from core client for 30 sec - exiting 14:05:12 (17604): No heartbeat from core client for 30 sec - exiting 14:05:13 (17604): No heartbeat from core client for 30 sec - exiting 14:05:14 (17604): No heartbeat from core client for 30 sec - exiting 14:05:15 (17604): No heartbeat from core client for 30 sec - exiting 14:05:16 (17604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:07:15 (17664): No heartbeat from core client for 30 sec - exiting 14:07:16 (17664): No heartbeat from core client for 30 sec - exiting 14:07:17 (17664): No heartbeat from core client for 30 sec - exiting 14:07:18 (17664): No heartbeat from core client for 30 sec - exiting 14:07:19 (17664): No heartbeat from core client for 30 sec - exiting 14:07:21 (17664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:47 (17715): No heartbeat from core client for 30 sec - exiting 14:08:50 (17715): No heartbeat from core client for 30 sec - exiting 14:08:51 (17715): No heartbeat from core client for 30 sec - exiting 14:08:52 (17715): No heartbeat from core client for 30 sec - exiting 14:08:53 (17715): No heartbeat from core client for 30 sec - exiting 14:08:54 (17715): No heartbeat from core client for 30 sec - exiting 14:08:55 (17715): No heartbeat from core client for 30 sec - exiting 14:08:56 (17715): No heartbeat from core client for 30 sec - exiting 14:08:57 (17715): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:15:54 (17737): No heartbeat from core client for 30 sec - exiting 14:15:56 (17737): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:10 (17802): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:44:08 (17863): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:29 (17933): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:52:30 (17992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:11:12 (18059): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:33 (18122): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:27:33 (18192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:37:34 (18261): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:45:44 (18326): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:46:51 (27604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:48:38 (27671): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:27 (27730): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:15 (27791): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:54:25 (27855): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:56:55 (27915): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:13:48 (27977): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:26:09 (28035): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:12 (28101): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:45:25 (28162): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:01:15 (28225): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:56:21 (28292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:36:24 (28369): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:41:24 (28442): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:00:51 (28480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:18:46 (28544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:51:39 (28612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:42 (28848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:41:56 (28919): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:55 (29001): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:11:58 (29066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:22:00 (29130): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:31:17 (29198): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:57:02 (29260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:45:47 (29325): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:17:10 (29395): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:57:40 (29464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 13:59:22 (29531): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:02:57 (29595): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 14:04:42 (29659): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:07:01 (29720): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 14:34:00 (29785): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 14:36:26 (29848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 14:42:59 (29908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:08:00 (29970): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:13:01 (30035): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:28:02 (30098): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:43:04 (30166): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:53:05 (30228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:03:06 (30293): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:18:07 (30355): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:33:09 (30423): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:38:10 (30486): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:53:11 (30548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:08:12 (30613): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:13:13 (30675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:13:15 (30675): No heartbeat from core client for 30 sec - exiting 17:13:16 (30675): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:23:13 (30737): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:43:15 (30802): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:19 (30802): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:58:16 (30867): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:17 (30934): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:20 (30934): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:18:19 (30996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:33:20 (31061): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:22 (31061): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:48:21 (31125): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:23 (31188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:13:24 (31253): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:23:25 (31314): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:38:26 (31383): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:48:27 (31447): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:58:28 (31510): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:13:30 (31575): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:23:30 (31638): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:33:31 (31708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:48:33 (31771): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:58:34 (31834): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:03:35 (31898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:36 (31898): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:23:36 (31960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:38:37 (32029): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:38 (32029): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:58:39 (32091): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:13:39 (32156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:28:40 (32218): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:43:41 (32289): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:48:42 (32350): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:13:42 (32410): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:38:46 (32474): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:47 (32474): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:58:48 (32543): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:03:33 (32610): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:09:07 (32672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:09:13 (32672): No heartbeat from core client for 30 sec - exiting 00:09:14 (32672): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:33:26 (32736): No heartbeat from core client for 30 sec - exiting 00:35:43 (32736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:36:24 (337): No heartbeat from core client for 30 sec - exiting 00:36:25 (337): No heartbeat from core client for 30 sec - exiting 00:36:26 (337): No heartbeat from core client for 30 sec - exiting 00:36:27 (337): No heartbeat from core client for 30 sec - exiting 00:36:28 (337): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:39:55 (414): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:04 (414): No heartbeat from core client for 30 sec - exiting 00:40:49 (460): No heartbeat from core client for 30 sec - exiting 00:40:50 (460): No heartbeat from core client for 30 sec - exiting 00:40:51 (460): No heartbeat from core client for 30 sec - exiting 00:40:52 (460): No heartbeat from core client for 30 sec - exiting 00:40:53 (460): No heartbeat from core client for 30 sec - exiting 00:40:54 (460): No heartbeat from core client for 30 sec - exiting 00:40:55 (460): No heartbeat from core client for 30 sec - exiting 00:40:56 (460): No heartbeat from core client for 30 sec - exiting 00:40:57 (460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:42:46 (498): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:22 (556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:29 (556): No heartbeat from core client for 30 sec - exiting 00:47:30 (556): No heartbeat from core client for 30 sec - exiting 00:52:22 (620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:52:24 (620): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=651, iMonCtr=1 Model crash detected, will try to restart... 00:56:04 (651): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:28 (713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:37 (713): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=788, iMonCtr=1 Model crash detected, will try to restart... 01:01:14 (788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:02:22 (850): No heartbeat from core client for 30 sec - exiting 01:02:24 (850): No heartbeat from core client for 30 sec - exiting 01:02:25 (850): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc SIGABRT: abort called Stack trace (15 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf76f8400] [0xf76f8425] /lib32/libc.so.6(gsignal+0x51)[0xf7582a21] /lib32/libc.so.6(abort+0x182)[0xf7585e42] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8401b90] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7af5] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7b32] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7c5a] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f825e] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f829d] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839dfbf] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf3] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf756ec76] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=906, iMonCtr=1 Model crash detected, will try to restart... 01:05:19 (906): No heartbeat from core client for 30 sec - exiting 01:05:34 (906): No heartbeat from core client for 30 sec - exiting 01:05:36 (906): No heartbeat from core client for 30 sec - exiting 01:05:37 (906): No heartbeat from core client for 30 sec - exiting 01:05:38 (906): No heartbeat from core client for 30 sec - exiting 01:05:39 (906): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:41 (906): No heartbeat from core client for 30 sec - exiting 01:05:42 (906): No heartbeat from core client for 30 sec - exiting 01:05:43 (906): No heartbeat from core client for 30 sec - exiting 01:05:45 (906): No heartbeat from core client for 30 sec - exiting 01:05:46 (906): No heartbeat from core client for 30 sec - exiting 01:05:48 (906): No heartbeat from core client for 30 sec - exiting 01:05:50 (906): No heartbeat from core client for 30 sec - exiting 01:05:51 (906): No heartbeat from core client for 30 sec - exiting 01:05:52 (906): No heartbeat from core client for 30 sec - exiting 01:05:53 (906): No heartbeat from core client for 30 sec - exiting 01:07:24 (963): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:26 (963): No heartbeat from core client for 30 sec - exiting terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc SIGABRT: abort called Stack trace (15 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7724400] [0xf7724425] /lib32/libc.so.6(gsignal+0x51)[0xf75aea21] /lib32/libc.so.6(abort+0x182)[0xf75b1e42] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8401b90] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7af5] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7b32] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7c5a] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f825e] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f829d] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839dfbf] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf3] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf759ac76] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1024, iMonCtr=1 Model crash detected, will try to restart... 01:10:21 (1024): No heartbeat from core client for 30 sec - exiting 01:10:39 (1024): No heartbeat from core client for 30 sec - exiting 01:10:40 (1024): No heartbeat from core client for 30 sec - exiting 01:10:41 (1024): No heartbeat from core client for 30 sec - exiting 01:10:42 (1024): No heartbeat from core client for 30 sec - exiting 01:10:43 (1024): No heartbeat from core client for 30 sec - exiting 01:10:44 (1024): No heartbeat from core client for 30 sec - exiting 01:10:45 (1024): No heartbeat from core client for 30 sec - exiting 01:10:46 (1024): No heartbeat from core client for 30 sec - exiting 01:10:47 (1024): No heartbeat from core client for 30 sec - exiting 01:10:48 (1024): No heartbeat from core client for 30 sec - exiting 01:10:49 (1024): No heartbeat from core client for 30 sec - exiting 01:10:50 (1024): No heartbeat from core client for 30 sec - exiting 01:10:51 (1024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:06 (1087): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:31 (1141): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:16:52 (1198): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:19:16 (1265): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:39 (1334): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:22:02 (1389): No heartbeat from core client for 30 sec - exiting 01:22:05 (1389): No heartbeat from core client for 30 sec - exiting 01:22:06 (1389): No heartbeat from core client for 30 sec - exiting 01:22:08 (1389): No heartbeat from core client for 30 sec - exiting 01:22:09 (1389): No heartbeat from core client for 30 sec - exiting 01:22:10 (1389): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc SIGABRT: abort called Stack trace (15 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77ac400] [0xf77ac425] /lib32/libc.so.6(gsignal+0x51)[0xf7636a21] /lib32/libc.so.6(abort+0x182)[0xf7639e42] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8401b90] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7af5] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7b32] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7c5a] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f825e] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f829d] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839dfbf] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf3] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7622c76] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1445, iMonCtr=1 Model crash detected, will try to restart... 01:26:49 (1445): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:24 (1493): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1595, iMonCtr=1 Model crash detected, will try to restart... 01:31:25 (1595): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:12 (1657): No heartbeat from core client for 30 sec - exiting 01:35:14 (1657): No heartbeat from core client for 30 sec - exiting 01:35:15 (1657): No heartbeat from core client for 30 sec - exiting 01:35:16 (1657): No heartbeat from core client for 30 sec - exiting 01:35:17 (1657): No heartbeat from core client for 30 sec - exiting 01:35:18 (1657): No heartbeat from core client for 30 sec - exiting 01:35:19 (1657): No heartbeat from core client for 30 sec - exiting 01:35:20 (1657): No heartbeat from core client for 30 sec - exiting 01:35:21 (1657): No heartbeat from core client for 30 sec - exiting 01:35:22 (1657): No heartbeat from core client for 30 sec - exiting 01:35:23 (1657): No heartbeat from core client for 30 sec - exiting 01:35:24 (1657): No heartbeat from core client for 30 sec - exiting 01:35:25 (1657): No heartbeat from core client for 30 sec - exiting 01:35:26 (1657): No heartbeat from core client for 30 sec - exiting 01:35:27 (1657): No heartbeat from core client for 30 sec - exiting 01:35:28 (1657): No heartbeat from core client for 30 sec - exiting 01:35:29 (1657): No heartbeat from core client for 30 sec - exiting 01:35:30 (1657): No heartbeat from core client for 30 sec - exiting 01:35:31 (1657): No heartbeat from core client for 30 sec - exiting 01:35:32 (1657): No heartbeat from core client for 30 sec - exiting 01:35:33 (1657): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:45 (1693): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:48 (1693): No heartbeat from core client for 30 sec - exiting 01:40:18 (1741): No heartbeat from core client for 30 sec - exiting 01:40:22 (1741): No heartbeat from core client for 30 sec - exiting 01:40:23 (1741): No heartbeat from core client for 30 sec - exiting 01:40:24 (1741): No heartbeat from core client for 30 sec - exiting 01:40:25 (1741): No heartbeat from core client for 30 sec - exiting 01:40:26 (1741): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:40:27 (1741): No heartbeat from core client for 30 sec - exiting 01:40:28 (1741): No heartbeat from core client for 30 sec - exiting 01:40:29 (1741): No heartbeat from core client for 30 sec - exiting 01:41:37 (1780): No heartbeat from core client for 30 sec - exiting 01:41:40 (1780): No heartbeat from core client for 30 sec - exiting 01:41:41 (1780): No heartbeat from core client for 30 sec - exiting 01:41:42 (1780): No heartbeat from core client for 30 sec - exiting 01:41:43 (1780): No heartbeat from core client for 30 sec - exiting 01:41:44 (1780): No heartbeat from core client for 30 sec - exiting 01:41:45 (1780): No heartbeat from core client for 30 sec - exiting 01:41:46 (1780): No heartbeat from core client for 30 sec - exiting 01:41:47 (1780): No heartbeat from core client for 30 sec - exiting 01:41:48 (1780): No heartbeat from core client for 30 sec - exiting 01:41:49 (1780): No heartbeat from core client for 30 sec - exiting 01:41:50 (1780): No heartbeat from core client for 30 sec - exiting 01:41:51 (1780): No heartbeat from core client for 30 sec - exiting 01:41:52 (1780): No heartbeat from core client for 30 sec - exiting 01:41:53 (1780): No heartbeat from core client for 30 sec - exiting 01:41:54 (1780): No heartbeat from core client for 30 sec - exiting 01:41:55 (1780): No heartbeat from core client for 30 sec - exiting 01:41:56 (1780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:41:57 (1780): No heartbeat from core client for 30 sec - exiting 01:43:47 (1819): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:43:49 (1819): No heartbeat from core client for 30 sec - exiting 01:44:51 (1855): No heartbeat from core client for 30 sec - exiting 01:44:53 (1855): No heartbeat from core client for 30 sec - exiting 01:44:54 (1855): No heartbeat from core client for 30 sec - exiting 01:44:55 (1855): No heartbeat from core client for 30 sec - exiting 01:44:56 (1855): No heartbeat from core client for 30 sec - exiting 01:44:57 (1855): No heartbeat from core client for 30 sec - exiting 01:44:58 (1855): No heartbeat from core client for 30 sec - exiting 01:44:59 (1855): No heartbeat from core client for 30 sec - exiting 01:45:00 (1855): No heartbeat from core client for 30 sec - exiting 01:45:01 (1855): No heartbeat from core client for 30 sec - exiting 01:45:02 (1855): No heartbeat from core client for 30 sec - exiting 01:45:03 (1855): No heartbeat from core client for 30 sec - exiting 01:45:04 (1855): No heartbeat from core client for 30 sec - exiting 01:45:05 (1855): No heartbeat from core client for 30 sec - exiting 01:45:06 (1855): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:47:06 (1890): No heartbeat from core client for 30 sec - exiting 01:47:08 (1890): No heartbeat from core client for 30 sec - exiting 01:47:09 (1890): No heartbeat from core client for 30 sec - exiting 01:47:10 (1890): No heartbeat from core client for 30 sec - exiting 01:47:11 (1890): No heartbeat from core client for 30 sec - exiting 01:47:12 (1890): No heartbeat from core client for 30 sec - exiting 01:47:13 (1890): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:47:14 (1890): No heartbeat from core client for 30 sec - exiting 01:49:04 (1928): No heartbeat from core client for 30 sec - exiting 01:49:06 (1928): No heartbeat from core client for 30 sec - exiting 01:49:07 (1928): No heartbeat from core client for 30 sec - exiting 01:49:08 (1928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:49:09 (1928): No heartbeat from core client for 30 sec - exiting 01:52:22 (1973): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:54:03 (2012): No heartbeat from core client for 30 sec - exiting 01:54:06 (2012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:54:07 (2012): No heartbeat from core client for 30 sec - exiting 01:58:57 (2048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2089, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 18:46:30	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	984,960	2,766,323	2.8086
31 Oct 2011 18:12:17	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	959,040	2,693,951	2.8090
31 Oct 2011 17:21:31	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	933,120	2,621,342	2.8092
31 Oct 2011 16:51:25	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	907,200	2,548,728	2.8094
31 Oct 2011 15:41:03	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	881,280	2,475,956	2.8095
31 Oct 2011 12:59:59	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	855,360	2,403,370	2.8098
31 Oct 2011 13:00:00	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	829,440	2,330,742	2.8100
31 Oct 2011 13:00:01	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	803,520	2,258,040	2.8102
31 Oct 2011 12:59:58	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	777,600	2,185,327	2.8103
31 Oct 2011 13:00:03	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	751,680	2,112,816	2.8108
31 Oct 2011 13:00:03	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	725,760	2,040,411	2.8114
31 Oct 2011 13:00:02	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	699,840	1,968,859	2.8133
19 Oct 2011 06:18:37	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	673,920	1,896,574	2.8142
18 Oct 2011 10:08:44	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	648,000	1,824,137	2.8150
17 Oct 2011 15:03:16	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	622,080	1,751,687	2.8159
16 Oct 2011 18:42:05	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	596,160	1,679,687	2.8175
15 Oct 2011 22:22:43	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	570,240	1,607,421	2.8188
15 Oct 2011 02:37:04	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	544,320	1,535,168	2.8203
14 Oct 2011 05:16:11	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	518,400	1,462,269	2.8207
13 Oct 2011 09:00:03	1157390	13412976	hadcm3n_u1vs_1980_40_007460823_1	492,480	1,389,278	2.8210