Task 15800453

Name	hadcm3n_3epn_1980_40_008363999_3
Workunit	8514858
Created	29 May 2013, 6:00:38 UTC
Sent	29 May 2013, 6:00:43 UTC
Report deadline	28 Aug 2013, 13:27:54 UTC
Received	16 Jun 2013, 13:58:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1209437
Run time	10 days 4 hours 50 min 49 sec
CPU time	10 days 2 hours 22 min 37 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:47:07 (37812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:52 (39168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:53 (39168): No heartbeat from core client for 30 sec - exiting 02:46:54 (39168): No heartbeat from core client for 30 sec - exiting 02:46:55 (39168): No heartbeat from core client for 30 sec - exiting 02:46:56 (39168): No heartbeat from core client for 30 sec - exiting 02:46:57 (39168): No heartbeat from core client for 30 sec - exiting 02:46:58 (39168): No heartbeat from core client for 30 sec - exiting 04:30:42 (36648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:30:43 (36648): No heartbeat from core client for 30 sec - exiting 04:30:44 (36648): No heartbeat from core client for 30 sec - exiting 04:30:45 (36648): No heartbeat from core client for 30 sec - exiting 04:30:46 (36648): No heartbeat from core client for 30 sec - exiting 04:30:47 (36648): No heartbeat from core client for 30 sec - exiting 04:30:48 (36648): No heartbeat from core client for 30 sec - exiting 04:30:49 (36648): No heartbeat from core client for 30 sec - exiting 04:30:50 (36648): No heartbeat from core client for 30 sec - exiting 04:30:51 (36648): No heartbeat from core client for 30 sec - exiting 05:09:27 (42140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:28 (42140): No heartbeat from core client for 30 sec - exiting 05:09:29 (42140): No heartbeat from core client for 30 sec - exiting 05:09:30 (42140): No heartbeat from core client for 30 sec - exiting 05:09:31 (42140): No heartbeat from core client for 30 sec - exiting 05:09:32 (42140): No heartbeat from core client for 30 sec - exiting 05:09:33 (42140): No heartbeat from core client for 30 sec - exiting 05:09:34 (42140): No heartbeat from core client for 30 sec - exiting 05:09:35 (42140): No heartbeat from core client for 30 sec - exiting 05:09:36 (42140): No heartbeat from core client for 30 sec - exiting 05:09:37 (42140): No heartbeat from core client for 30 sec - exiting 06:40:16 (43408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:17 (43408): No heartbeat from core client for 30 sec - exiting 06:40:18 (43408): No heartbeat from core client for 30 sec - exiting 06:40:19 (43408): No heartbeat from core client for 30 sec - exiting 06:40:20 (43408): No heartbeat from core client for 30 sec - exiting 06:40:21 (43408): No heartbeat from core client for 30 sec - exiting 06:40:22 (43408): No heartbeat from core client for 30 sec - exiting 06:40:23 (43408): No heartbeat from core client for 30 sec - exiting 06:40:24 (43408): No heartbeat from core client for 30 sec - exiting 06:40:25 (43408): No heartbeat from core client for 30 sec - exiting 06:40:26 (43408): No heartbeat from core client for 30 sec - exiting 08:12:13 (44768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:14 (44768): No heartbeat from core client for 30 sec - exiting 08:12:15 (44768): No heartbeat from core client for 30 sec - exiting 08:12:16 (44768): No heartbeat from core client for 30 sec - exiting 08:12:17 (44768): No heartbeat from core client for 30 sec - exiting 08:12:18 (44768): No heartbeat from core client for 30 sec - exiting 08:12:19 (44768): No heartbeat from core client for 30 sec - exiting 08:12:20 (44768): No heartbeat from core client for 30 sec - exiting 08:12:21 (44768): No heartbeat from core client for 30 sec - exiting 08:12:22 (44768): No heartbeat from core client for 30 sec - exiting 08:12:23 (44768): No heartbeat from core client for 30 sec - exiting 12:14:33 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:34 (5532): No heartbeat from core client for 30 sec - exiting 12:18:47 (44996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:48 (44996): No heartbeat from core client for 30 sec - exiting 12:18:49 (44996): No heartbeat from core client for 30 sec - exiting 12:18:50 (44996): No heartbeat from core client for 30 sec - exiting 12:18:51 (44996): No heartbeat from core client for 30 sec - exiting 12:18:52 (44996): No heartbeat from core client for 30 sec - exiting 12:18:53 (44996): No heartbeat from core client for 30 sec - exiting 12:18:54 (44996): No heartbeat from core client for 30 sec - exiting 12:18:55 (44996): No heartbeat from core client for 30 sec - exiting 12:18:56 (44996): No heartbeat from core client for 30 sec - exiting 12:18:57 (44996): No heartbeat from core client for 30 sec - exiting 12:20:38 (25108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:39 (25108): No heartbeat from core client for 30 sec - exiting 12:20:40 (25108): No heartbeat from core client for 30 sec - exiting 12:20:41 (25108): No heartbeat from core client for 30 sec - exiting 12:20:42 (25108): No heartbeat from core client for 30 sec - exiting 12:20:43 (25108): No heartbeat from core client for 30 sec - exiting 12:20:44 (25108): No heartbeat from core client for 30 sec - exiting 12:20:45 (25108): No heartbeat from core client for 30 sec - exiting 12:20:46 (25108): No heartbeat from core client for 30 sec - exiting 12:20:47 (25108): No heartbeat from core client for 30 sec - exiting 12:20:48 (25108): No heartbeat from core client for 30 sec - exiting 12:34:47 (44300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:48 (44300): No heartbeat from core client for 30 sec - exiting 12:34:49 (44300): No heartbeat from core client for 30 sec - exiting 12:34:50 (44300): No heartbeat from core client for 30 sec - exiting 12:34:51 (44300): No heartbeat from core client for 30 sec - exiting 12:34:52 (44300): No heartbeat from core client for 30 sec - exiting 12:34:53 (44300): No heartbeat from core client for 30 sec - exiting 12:34:54 (44300): No heartbeat from core client for 30 sec - exiting 12:34:55 (44300): No heartbeat from core client for 30 sec - exiting 12:35:47 (25816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:09:27 (20576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:09:28 (20576): No heartbeat from core client for 30 sec - exiting 14:09:29 (20576): No heartbeat from core client for 30 sec - exiting 14:09:30 (20576): No heartbeat from core client for 30 sec - exiting 14:09:31 (20576): No heartbeat from core client for 30 sec - exiting 14:09:32 (20576): No heartbeat from core client for 30 sec - exiting 14:09:33 (20576): No heartbeat from core client for 30 sec - exiting 14:09:34 (20576): No heartbeat from core client for 30 sec - exiting 14:09:35 (20576): No heartbeat from core client for 30 sec - exiting 14:09:36 (20576): No heartbeat from core client for 30 sec - exiting 14:09:37 (20576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... 13:30:15 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:30:16 (5920): No heartbeat from core client for 30 sec - exiting 13:30:17 (5920): No heartbeat from core client for 30 sec - exiting 13:30:18 (5920): No heartbeat from core client for 30 sec - exiting 13:30:19 (5920): No heartbeat from core client for 30 sec - exiting 13:30:20 (5920): No heartbeat from core client for 30 sec - exiting 14:23:47 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:23:48 (4264): No heartbeat from core client for 30 sec - exiting 14:23:49 (4264): No heartbeat from core client for 30 sec - exiting 14:23:50 (4264): No heartbeat from core client for 30 sec - exiting 14:23:51 (4264): No heartbeat from core client for 30 sec - exiting 14:23:52 (4264): No heartbeat from core client for 30 sec - exiting 14:23:53 (4264): No heartbeat from core client for 30 sec - exiting 14:23:54 (4264): No heartbeat from core client for 30 sec - exiting 14:23:55 (4264): No heartbeat from core client for 30 sec - exiting 14:23:56 (4264): No heartbeat from core client for 30 sec - exiting 15:00:51 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:52 (4704): No heartbeat from core client for 30 sec - exiting 15:00:53 (4704): No heartbeat from core client for 30 sec - exiting 15:00:54 (4704): No heartbeat from core client for 30 sec - exiting 15:00:55 (4704): No heartbeat from core client for 30 sec - exiting 15:00:56 (4704): No heartbeat from core client for 30 sec - exiting 15:00:57 (4704): No heartbeat from core client for 30 sec - exiting 15:00:58 (4704): No heartbeat from core client for 30 sec - exiting 15:00:59 (4704): No heartbeat from core client for 30 sec - exiting 15:01:00 (4704): No heartbeat from core client for 30 sec - exiting 15:01:01 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 14:56:47 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:48 (5380): No heartbeat from core client for 30 sec - exiting 14:56:49 (5380): No heartbeat from core client for 30 sec - exiting 14:56:50 (5380): No heartbeat from core client for 30 sec - exiting 14:56:51 (5380): No heartbeat from core client for 30 sec - exiting 14:56:52 (5380): No heartbeat from core client for 30 sec - exiting 14:56:53 (5380): No heartbeat from core client for 30 sec - exiting 14:56:54 (5380): No heartbeat from core client for 30 sec - exiting 14:56:55 (5380): No heartbeat from core client for 30 sec - exiting 14:56:56 (5380): No heartbeat from core client for 30 sec - exiting 14:56:57 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 01:52:15 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:16 (5372): No heartbeat from core client for 30 sec - exiting 01:52:17 (5372): No heartbeat from core client for 30 sec - exiting 02:02:50 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:51 (6540): No heartbeat from core client for 30 sec - exiting 02:02:52 (6540): No heartbeat from core client for 30 sec - exiting 02:02:53 (6540): No heartbeat from core client for 30 sec - exiting 02:02:54 (6540): No heartbeat from core client for 30 sec - exiting 02:02:55 (6540): No heartbeat from core client for 30 sec - exiting 02:02:56 (6540): No heartbeat from core client for 30 sec - exiting 02:02:57 (6540): No heartbeat from core client for 30 sec - exiting 02:02:58 (6540): No heartbeat from core client for 30 sec - exiting 02:02:59 (6540): No heartbeat from core client for 30 sec - exiting 02:03:00 (6540): No heartbeat from core client for 30 sec - exiting 02:09:37 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:38 (5372): No heartbeat from core client for 30 sec - exiting 02:09:39 (5372): No heartbeat from core client for 30 sec - exiting 02:09:40 (5372): No heartbeat from core client for 30 sec - exiting 02:09:41 (5372): No heartbeat from core client for 30 sec - exiting 02:09:42 (5372): No heartbeat from core client for 30 sec - exiting 02:09:43 (5372): No heartbeat from core client for 30 sec - exiting 02:09:44 (5372): No heartbeat from core client for 30 sec - exiting 02:09:45 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:55:16 (39548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:55:17 (39548): No heartbeat from core client for 30 sec - exiting 07:55:18 (39548): No heartbeat from core client for 30 sec - exiting 07:55:19 (39548): No heartbeat from core client for 30 sec - exiting 07:55:21 (39548): No heartbeat from core client for 30 sec - exiting 07:58:57 (43204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:58 (43204): No heartbeat from core client for 30 sec - exiting 07:58:59 (43204): No heartbeat from core client for 30 sec - exiting 07:59:00 (43204): No heartbeat from core client for 30 sec - exiting 07:59:01 (43204): No heartbeat from core client for 30 sec - exiting 07:59:02 (43204): No heartbeat from core client for 30 sec - exiting 07:59:03 (43204): No heartbeat from core client for 30 sec - exiting 07:59:04 (43204): No heartbeat from core client for 30 sec - exiting 07:59:05 (43204): No heartbeat from core client for 30 sec - exiting 07:59:06 (43204): No heartbeat from core client for 30 sec - exiting 07:59:07 (43204): No heartbeat from core client for 30 sec - exiting 09:25:32 (37304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:33 (37304): No heartbeat from core client for 30 sec - exiting 09:25:34 (37304): No heartbeat from core client for 30 sec - exiting 09:25:35 (37304): No heartbeat from core client for 30 sec - exiting 09:25:36 (37304): No heartbeat from core client for 30 sec - exiting 09:25:37 (37304): No heartbeat from core client for 30 sec - exiting 09:25:38 (37304): No heartbeat from core client for 30 sec - exiting 09:25:39 (37304): No heartbeat from core client for 30 sec - exiting 09:25:40 (37304): No heartbeat from core client for 30 sec - exiting 10:40:40 (42012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:41 (42012): No heartbeat from core client for 30 sec - exiting 10:40:42 (42012): No heartbeat from core client for 30 sec - exiting 10:40:43 (42012): No heartbeat from core client for 30 sec - exiting 10:40:44 (42012): No heartbeat from core client for 30 sec - exiting 10:40:45 (42012): No heartbeat from core client for 30 sec - exiting 10:40:46 (42012): No heartbeat from core client for 30 sec - exiting 10:40:47 (42012): No heartbeat from core client for 30 sec - exiting 10:40:48 (42012): No heartbeat from core client for 30 sec - exiting 10:40:49 (42012): No heartbeat from core client for 30 sec - exiting 10:40:50 (42012): No heartbeat from core client for 30 sec - exiting 10:58:21 (28884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:58:22 (28884): No heartbeat from core client for 30 sec - exiting 10:58:23 (28884): No heartbeat from core client for 30 sec - exiting 10:58:24 (28884): No heartbeat from core client for 30 sec - exiting 10:58:25 (28884): No heartbeat from core client for 30 sec - exiting 10:58:26 (28884): No heartbeat from core client for 30 sec - exiting 10:58:27 (28884): No heartbeat from core client for 30 sec - exiting 10:58:28 (28884): No heartbeat from core client for 30 sec - exiting 10:58:29 (28884): No heartbeat from core client for 30 sec - exiting 10:58:30 (28884): No heartbeat from core client for 30 sec - exiting 10:58:31 (28884): No heartbeat from core client for 30 sec - exiting 11:00:52 (42704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:53 (42704): No heartbeat from core client for 30 sec - exiting 11:00:54 (42704): No heartbeat from core client for 30 sec - exiting 11:00:55 (42704): No heartbeat from core client for 30 sec - exiting 11:00:56 (42704): No heartbeat from core client for 30 sec - exiting 11:22:50 (42384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:44:42 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:00 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:01 (4300): No heartbeat from core client for 30 sec - exiting 11:51:02 (4300): No heartbeat from core client for 30 sec - exiting 11:51:03 (4300): No heartbeat from core client for 30 sec - exiting 11:51:04 (4300): No heartbeat from core client for 30 sec - exiting 11:51:05 (4300): No heartbeat from core client for 30 sec - exiting 11:51:06 (4300): No heartbeat from core client for 30 sec - exiting 11:51:07 (4300): No heartbeat from core client for 30 sec - exiting 11:52:29 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:52:30 (5012): No heartbeat from core client for 30 sec - exiting 11:52:31 (5012): No heartbeat from core client for 30 sec - exiting 11:52:32 (5012): No heartbeat from core client for 30 sec - exiting 11:52:33 (5012): No heartbeat from core client for 30 sec - exiting 11:52:34 (5012): No heartbeat from core client for 30 sec - exiting 11:52:35 (5012): No heartbeat from core client for 30 sec - exiting 11:52:36 (5012): No heartbeat from core client for 30 sec - exiting 11:52:37 (5012): No heartbeat from core client for 30 sec - exiting 11:52:38 (5012): No heartbeat from core client for 30 sec - exiting 11:52:39 (5012): No heartbeat from core client for 30 sec - exiting 13:18:53 (5176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:54 (5176): No heartbeat from core client for 30 sec - exiting 13:18:55 (5176): No heartbeat from core client for 30 sec - exiting 13:18:56 (5176): No heartbeat from core client for 30 sec - exiting 13:18:57 (5176): No heartbeat from core client for 30 sec - exiting 13:18:58 (5176): No heartbeat from core client for 30 sec - exiting 13:18:59 (5176): No heartbeat from core client for 30 sec - exiting 13:19:00 (5176): No heartbeat from core client for 30 sec - exiting 13:19:01 (5176): No heartbeat from core client for 30 sec - exiting 13:19:02 (5176): No heartbeat from core client for 30 sec - exiting 13:19:03 (5176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:45:31 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:45:32 (2192): No heartbeat from core client for 30 sec - exiting 06:45:33 (2192): No heartbeat from core client for 30 sec - exiting 06:45:34 (2192): No heartbeat from core client for 30 sec - exiting 06:45:35 (2192): No heartbeat from core client for 30 sec - exiting 06:45:36 (2192): No heartbeat from core client for 30 sec - exiting 06:45:37 (2192): No heartbeat from core client for 30 sec - exiting 06:45:38 (2192): No heartbeat from core client for 30 sec - exiting 06:45:39 (2192): No heartbeat from core client for 30 sec - exiting 06:45:40 (2192): No heartbeat from core client for 30 sec - exiting 06:45:41 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:19:56 (9988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:19:57 (9988): No heartbeat from core client for 30 sec - exiting 14:19:58 (9988): No heartbeat from core client for 30 sec - exiting 14:19:59 (9988): No heartbeat from core client for 30 sec - exiting 14:20:00 (9988): No heartbeat from core client for 30 sec - exiting 14:20:01 (9988): No heartbeat from core client for 30 sec - exiting 14:20:02 (9988): No heartbeat from core client for 30 sec - exiting 14:20:03 (9988): No heartbeat from core client for 30 sec - exiting 14:20:04 (9988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:09:39 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:09:40 (4428): No heartbeat from core client for 30 sec - exiting 00:09:41 (4428): No heartbeat from core client for 30 sec - exiting 00:09:42 (4428): No heartbeat from core client for 30 sec - exiting 00:09:43 (4428): No heartbeat from core client for 30 sec - exiting 00:09:44 (4428): No heartbeat from core client for 30 sec - exiting 00:09:45 (4428): No heartbeat from core client for 30 sec - exiting 00:09:46 (4428): No heartbeat from core client for 30 sec - exiting 00:09:47 (4428): No heartbeat from core client for 30 sec - exiting 00:09:48 (4428): No heartbeat from core client for 30 sec - exiting 00:09:49 (4428): No heartbeat from core client for 30 sec - exiting 00:28:54 (10756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:55 (10756): No heartbeat from core client for 30 sec - exiting 00:28:56 (10756): No heartbeat from core client for 30 sec - exiting 00:28:57 (10756): No heartbeat from core client for 30 sec - exiting 00:28:58 (10756): No heartbeat from core client for 30 sec - exiting 00:28:59 (10756): No heartbeat from core client for 30 sec - exiting 00:29:00 (10756): No heartbeat from core client for 30 sec - exiting 00:29:01 (10756): No heartbeat from core client for 30 sec - exiting 00:29:02 (10756): No heartbeat from core client for 30 sec - exiting 00:29:03 (10756): No heartbeat from core client for 30 sec - exiting 00:29:04 (10756): No heartbeat from core client for 30 sec - exiting 01:51:38 (9660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:51:39 (9660): No heartbeat from core client for 30 sec - exiting 01:51:40 (9660): No heartbeat from core client for 30 sec - exiting 01:51:41 (9660): No heartbeat from core client for 30 sec - exiting 01:51:42 (9660): No heartbeat from core client for 30 sec - exiting 01:51:43 (9660): No heartbeat from core client for 30 sec - exiting 01:51:44 (9660): No heartbeat from core client for 30 sec - exiting 01:51:45 (9660): No heartbeat from core client for 30 sec - exiting 01:51:46 (9660): No heartbeat from core client for 30 sec - exiting 01:51:47 (9660): No heartbeat from core client for 30 sec - exiting 01:51:48 (9660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 04:49:25 (10600): No heartbeat from core client for 30 sec - exiting 04:49:26 (10600): No heartbeat from core client for 30 sec - exiting 04:49:27 (10600): No heartbeat from core client for 30 sec - exiting 04:49:28 (10600): No heartbeat from core client for 30 sec - exiting 04:49:29 (10600): No heartbeat from core client for 30 sec - exiting 04:49:30 (10600): No heartbeat from core client for 30 sec - exiting 04:49:31 (10600): No heartbeat from core client for 30 sec - exiting 04:49:32 (10600): No heartbeat from core client for 30 sec - exiting 04:49:33 (10600): No heartbeat from core client for 30 sec - exiting 04:49:34 (10600): No heartbeat from core client for 30 sec - exiting 04:50:19 (10600): No heartbeat from core client for 30 sec - exiting 04:50:20 (10600): No heartbeat from core client for 30 sec - exiting 04:50:21 (10600): No heartbeat from core client for 30 sec - exiting 04:50:22 (10600): No heartbeat from core client for 30 sec - exiting 04:50:23 (10600): No heartbeat from core client for 30 sec - exiting 04:50:24 (10600): No heartbeat from core client for 30 sec - exiting 04:50:25 (10600): No heartbeat from core client for 30 sec - exiting 04:50:26 (10600): No heartbeat from core client for 30 sec - exiting 04:50:27 (10600): No heartbeat from core client for 30 sec - exiting 04:50:28 (10600): No heartbeat from core client for 30 sec - exiting 04:50:29 (10600): No heartbeat from core client for 30 sec - exiting 04:50:30 (10600): No heartbeat from core client for 30 sec - exiting 04:50:31 (10600): No heartbeat from core client for 30 sec - exiting 04:50:32 (10600): No heartbeat from core client for 30 sec - exiting 04:50:33 (10600): No heartbeat from core client for 30 sec - exiting 04:50:34 (10600): No heartbeat from core client for 30 sec - exiting 04:50:35 (10600): No heartbeat from core client for 30 sec - exiting 04:50:36 (10600): No heartbeat from core client for 30 sec - exiting 04:50:37 (10600): No heartbeat from core client for 30 sec - exiting 04:50:38 (10600): No heartbeat from core client for 30 sec - exiting 04:50:39 (10600): No heartbeat from core client for 30 sec - exiting 04:50:40 (10600): No heartbeat from core client for 30 sec - exiting 04:50:41 (10600): No heartbeat from core client for 30 sec - exiting 04:50:42 (10600): No heartbeat from core client for 30 sec - exiting 04:50:43 (10600): No heartbeat from core client for 30 sec - exiting 04:50:44 (10600): No heartbeat from core client for 30 sec - exiting 04:50:45 (10600): No heartbeat from core client for 30 sec - exiting 04:50:46 (10600): No heartbeat from core client for 30 sec - exiting 04:50:47 (10600): No heartbeat from core client for 30 sec - exiting 04:50:48 (10600): No heartbeat from core client for 30 sec - exiting 04:50:49 (10600): No heartbeat from core client for 30 sec - exiting 04:50:50 (10600): No heartbeat from core client for 30 sec - exiting 04:50:51 (10600): No heartbeat from core client for 30 sec - exiting 04:50:52 (10600): No heartbeat from core client for 30 sec - exiting 04:50:53 (10600): No heartbeat from core client for 30 sec - exiting 04:50:54 (10600): No heartbeat from core client for 30 sec - exiting 04:50:55 (10600): No heartbeat from core client for 30 sec - exiting 04:50:56 (10600): No heartbeat from core client for 30 sec - exiting 04:50:57 (10600): No heartbeat from core client for 30 sec - exiting 04:50:58 (10600): No heartbeat from core client for 30 sec - exiting 04:50:59 (10600): No heartbeat from core client for 30 sec - exiting 04:51:00 (10600): No heartbeat from core client for 30 sec - exiting 04:51:01 (10600): No heartbeat from core client for 30 sec - exiting 04:51:02 (10600): No heartbeat from core client for 30 sec - exiting 04:51:03 (10600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:41 (2772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:42 (2772): No heartbeat from core client for 30 sec - exiting 06:04:43 (2772): No heartbeat from core client for 30 sec - exiting 06:04:44 (2772): No heartbeat from core client for 30 sec - exiting 06:04:45 (2772): No heartbeat from core client for 30 sec - exiting 06:04:46 (2772): No heartbeat from core client for 30 sec - exiting 06:04:47 (2772): No heartbeat from core client for 30 sec - exiting 06:04:48 (2772): No heartbeat from core client for 30 sec - exiting 06:04:49 (2772): No heartbeat from core client for 30 sec - exiting 06:04:50 (2772): No heartbeat from core client for 30 sec - exiting 06:04:51 (2772): No heartbeat from core client for 30 sec - exiting 06:24:06 (3480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:07 (3480): No heartbeat from core client for 30 sec - exiting 06:24:26 (3480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:10:48 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77367373 read attempt to address 0x40B3FBAC Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77363AB3 read attempt to address 0x40B3FBB4 Engaging BOINC Windows Runtime Debugger... Cannot serialize file D:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3epn_1980_40_008363999/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Jun 2013 09:56:19	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	777,600	867,602	1.1157
16 Jun 2013 02:43:14	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	751,680	842,935	1.1214
14 Jun 2013 23:55:46	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	725,760	818,120	1.1273
14 Jun 2013 07:16:57	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	699,840	789,371	1.1279
14 Jun 2013 00:08:03	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	673,920	764,038	1.1337
13 Jun 2013 10:19:22	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	648,000	737,038	1.1374
13 Jun 2013 02:11:20	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	622,080	711,766	1.1442
12 Jun 2013 11:49:38	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	596,160	683,114	1.1459
11 Jun 2013 14:45:48	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	570,240	656,921	1.1520
11 Jun 2013 04:01:15	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	544,320	629,892	1.1572
10 Jun 2013 12:39:22	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	518,400	602,907	1.1630
10 Jun 2013 02:40:13	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	492,480	574,088	1.1657
09 Jun 2013 11:20:41	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	466,560	549,825	1.1785
07 Jun 2013 16:11:38	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	440,640	520,457	1.1811
07 Jun 2013 07:45:03	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	414,720	490,245	1.1821
06 Jun 2013 17:00:15	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	388,800	459,110	1.1808
06 Jun 2013 08:06:02	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	362,880	428,010	1.1795
05 Jun 2013 23:16:51	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	336,960	397,046	1.1783
05 Jun 2013 08:40:22	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	311,040	366,569	1.1785
04 Jun 2013 23:56:35	1209437	15800453	hadcm3n_3epn_1980_40_008363999_3	285,120	335,811	1.1778