Task 15680145

Name	hadcm3n_3gf4_1940_40_008267586_2
Workunit	8422710
Created	23 Mar 2013, 14:21:57 UTC
Sent	23 Mar 2013, 14:22:02 UTC
Report deadline	22 Jun 2013, 21:49:13 UTC
Received	5 Apr 2013, 6:04:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1218996
Run time	6 days 17 hours 10 min 55 sec
CPU time	5 days 15 hours 11 min 6 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.81 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:22:29 (8020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7812, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2956, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:40:58 (7060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6408, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7088, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 17:51:05 (4924): No heartbeat from core client for 30 sec - exiting 17:51:06 (4924): No heartbeat from core client for 30 sec - exiting 17:51:07 (4924): No heartbeat from core client for 30 sec - exiting 17:51:08 (4924): No heartbeat from core client for 30 sec - exiting 17:51:09 (4924): No heartbeat from core client for 30 sec - exiting 17:51:10 (4924): No heartbeat from core client for 30 sec - exiting 17:51:11 (4924): No heartbeat from core client for 30 sec - exiting 17:51:12 (4924): No heartbeat from core client for 30 sec - exiting 17:51:13 (4924): No heartbeat from core client for 30 sec - exiting 17:51:14 (4924): No heartbeat from core client for 30 sec - exiting 17:51:15 (4924): No heartbeat from core client for 30 sec - exiting 17:51:16 (4924): No heartbeat from core client for 30 sec - exiting 17:51:17 (4924): No heartbeat from core client for 30 sec - exiting 17:51:18 (4924): No heartbeat from core client for 30 sec - exiting 17:51:19 (4924): No heartbeat from core client for 30 sec - exiting 17:51:20 (4924): No heartbeat from core client for 30 sec - exiting 17:51:21 (4924): No heartbeat from core client for 30 sec - exiting 17:51:22 (4924): No heartbeat from core client for 30 sec - exiting 17:51:23 (4924): No heartbeat from core client for 30 sec - exiting 17:51:24 (4924): No heartbeat from core client for 30 sec - exiting 17:51:25 (4924): No heartbeat from core client for 30 sec - exiting 17:51:26 (4924): No heartbeat from core client for 30 sec - exiting 17:51:27 (4924): No heartbeat from core client for 30 sec - exiting 17:51:28 (4924): No heartbeat from core client for 30 sec - exiting 17:51:29 (4924): No heartbeat from core client for 30 sec - exiting 17:51:30 (4924): No heartbeat from core client for 30 sec - exiting 17:51:31 (4924): No heartbeat from core client for 30 sec - exiting 17:51:32 (4924): No heartbeat from core client for 30 sec - exiting 17:51:33 (4924): No heartbeat from core client for 30 sec - exiting 17:51:34 (4924): No heartbeat from core client for 30 sec - exiting 17:51:35 (4924): No heartbeat from core client for 30 sec - exiting 17:51:36 (4924): No heartbeat from core client for 30 sec - exiting 17:51:37 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:16 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:04:27 (5360): No heartbeat from core client for 30 sec - exiting 18:04:28 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1672, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:38:46 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:53:23 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:05:44 (6368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:38:09 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:40:16 (5564): No heartbeat from core client for 30 sec - exiting 02:40:19 (5564): No heartbeat from core client for 30 sec - exiting 02:40:20 (5564): No heartbeat from core client for 30 sec - exiting 02:40:21 (5564): No heartbeat from core client for 30 sec - exiting 02:40:22 (5564): No heartbeat from core client for 30 sec - exiting 02:40:23 (5564): No heartbeat from core client for 30 sec - exiting 02:40:24 (5564): No heartbeat from core client for 30 sec - exiting 02:40:25 (5564): No heartbeat from core client for 30 sec - exiting 02:40:26 (5564): No heartbeat from core client for 30 sec - exiting 02:40:27 (5564): No heartbeat from core client for 30 sec - exiting 02:40:28 (5564): No heartbeat from core client for 30 sec - exiting 02:40:29 (5564): No heartbeat from core client for 30 sec - exiting 02:40:30 (5564): No heartbeat from core client for 30 sec - exiting 02:40:31 (5564): No heartbeat from core client for 30 sec - exiting 02:40:32 (5564): No heartbeat from core client for 30 sec - exiting 02:40:33 (5564): No heartbeat from core client for 30 sec - exiting 02:40:34 (5564): No heartbeat from core client for 30 sec - exiting 02:40:35 (5564): No heartbeat from core client for 30 sec - exiting 02:40:36 (5564): No heartbeat from core client for 30 sec - exiting 02:40:37 (5564): No heartbeat from core client for 30 sec - exiting 02:40:38 (5564): No heartbeat from core client for 30 sec - exiting 02:40:39 (5564): No heartbeat from core client for 30 sec - exiting 02:40:40 (5564): No heartbeat from core client for 30 sec - exiting 02:40:41 (5564): No heartbeat from core client for 30 sec - exiting 02:40:42 (5564): No heartbeat from core client for 30 sec - exiting 02:40:43 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:52:34 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:55:29 (5548): No heartbeat from core client for 30 sec - exiting 02:55:30 (5548): No heartbeat from core client for 30 sec - exiting 02:55:31 (5548): No heartbeat from core client for 30 sec - exiting 02:55:32 (5548): No heartbeat from core client for 30 sec - exiting 02:55:33 (5548): No heartbeat from core client for 30 sec - exiting 02:55:34 (5548): No heartbeat from core client for 30 sec - exiting 02:55:35 (5548): No heartbeat from core client for 30 sec - exiting 02:55:36 (5548): No heartbeat from core client for 30 sec - exiting 02:55:37 (5548): No heartbeat from core client for 30 sec - exiting 02:55:38 (5548): No heartbeat from core client for 30 sec - exiting 02:55:39 (5548): No heartbeat from core client for 30 sec - exiting 02:55:40 (5548): No heartbeat from core client for 30 sec - exiting 02:55:41 (5548): No heartbeat from core client for 30 sec - exiting 02:55:42 (5548): No heartbeat from core client for 30 sec - exiting 02:55:43 (5548): No heartbeat from core client for 30 sec - exiting 02:55:44 (5548): No heartbeat from core client for 30 sec - exiting 02:55:45 (5548): No heartbeat from core client for 30 sec - exiting 02:55:46 (5548): No heartbeat from core client for 30 sec - exiting 02:55:47 (5548): No heartbeat from core client for 30 sec - exiting 02:55:48 (5548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:58:10 (9100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:09:37 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:13:34 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:55:43 (8508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:41 (5868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:13:57 (9156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:14:57 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:31:09 (9060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:33:07 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:12 (9076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:39:54 (7204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:43:56 (4600): No heartbeat from core client for 30 sec - exiting 04:43:57 (4600): No heartbeat from core client for 30 sec - exiting 04:43:58 (4600): No heartbeat from core client for 30 sec - exiting 04:43:59 (4600): No heartbeat from core client for 30 sec - exiting 04:44:00 (4600): No heartbeat from core client for 30 sec - exiting 04:44:01 (4600): No heartbeat from core client for 30 sec - exiting 04:44:02 (4600): No heartbeat from core client for 30 sec - exiting 04:44:03 (4600): No heartbeat from core client for 30 sec - exiting 04:44:04 (4600): No heartbeat from core client for 30 sec - exiting 04:44:05 (4600): No heartbeat from core client for 30 sec - exiting 04:44:06 (4600): No heartbeat from core client for 30 sec - exiting 04:44:07 (4600): No heartbeat from core client for 30 sec - exiting 04:44:08 (4600): No heartbeat from core client for 30 sec - exiting 04:44:09 (4600): No heartbeat from core client for 30 sec - exiting 04:44:10 (4600): No heartbeat from core client for 30 sec - exiting 04:44:11 (4600): No heartbeat from core client for 30 sec - exiting 04:44:12 (4600): No heartbeat from core client for 30 sec - exiting 04:44:13 (4600): No heartbeat from core client for 30 sec - exiting 04:44:14 (4600): No heartbeat from core client for 30 sec - exiting 04:44:15 (4600): No heartbeat from core client for 30 sec - exiting 04:44:16 (4600): No heartbeat from core client for 30 sec - exiting 04:44:17 (4600): No heartbeat from core client for 30 sec - exiting 04:44:18 (4600): No heartbeat from core client for 30 sec - exiting 04:44:19 (4600): No heartbeat from core client for 30 sec - exiting 04:44:20 (4600): No heartbeat from core client for 30 sec - exiting 04:44:21 (4600): No heartbeat from core client for 30 sec - exiting 04:44:22 (4600): No heartbeat from core client for 30 sec - exiting 04:44:23 (4600): No heartbeat from core client for 30 sec - exiting 04:44:24 (4600): No heartbeat from core client for 30 sec - exiting 04:44:25 (4600): No heartbeat from core client for 30 sec - exiting 04:44:26 (4600): No heartbeat from core client for 30 sec - exiting 04:44:27 (4600): No heartbeat from core client for 30 sec - exiting 04:44:28 (4600): No heartbeat from core client for 30 sec - exiting 04:44:29 (4600): No heartbeat from core client for 30 sec - exiting 04:44:30 (4600): No heartbeat from core client for 30 sec - exiting 04:44:31 (4600): No heartbeat from core client for 30 sec - exiting 04:44:32 (4600): No heartbeat from core client for 30 sec - exiting 04:44:33 (4600): No heartbeat from core client for 30 sec - exiting 04:44:34 (4600): No heartbeat from core client for 30 sec - exiting 04:44:35 (4600): No heartbeat from core client for 30 sec - exiting 04:44:36 (4600): No heartbeat from core client for 30 sec - exiting 04:44:37 (4600): No heartbeat from core client for 30 sec - exiting 04:44:38 (4600): No heartbeat from core client for 30 sec - exiting 04:44:39 (4600): No heartbeat from core client for 30 sec - exiting 04:44:40 (4600): No heartbeat from core client for 30 sec - exiting 04:44:41 (4600): No heartbeat from core client for 30 sec - exiting 04:44:42 (4600): No heartbeat from core client for 30 sec - exiting 04:44:43 (4600): No heartbeat from core client for 30 sec - exiting 04:44:44 (4600): No heartbeat from core client for 30 sec - exiting 04:44:45 (4600): No heartbeat from core client for 30 sec - exiting 04:44:46 (4600): No heartbeat from core client for 30 sec - exiting 04:44:47 (4600): No heartbeat from core client for 30 sec - exiting 04:44:48 (4600): No heartbeat from core client for 30 sec - exiting 04:44:49 (4600): No heartbeat from core client for 30 sec - exiting 04:44:50 (4600): No heartbeat from core client for 30 sec - exiting 04:44:51 (4600): No heartbeat from core client for 30 sec - exiting 04:44:52 (4600): No heartbeat from core client for 30 sec - exiting 04:44:53 (4600): No heartbeat from core client for 30 sec - exiting 04:44:54 (4600): No heartbeat from core client for 30 sec - exiting 04:44:55 (4600): No heartbeat from core client for 30 sec - exiting 04:44:56 (4600): No heartbeat from core client for 30 sec - exiting 04:44:57 (4600): No heartbeat from core client for 30 sec - exiting 04:44:58 (4600): No heartbeat from core client for 30 sec - exiting 04:44:59 (4600): No heartbeat from core client for 30 sec - exiting 04:45:00 (4600): No heartbeat from core client for 30 sec - exiting 04:45:01 (4600): No heartbeat from core client for 30 sec - exiting 04:45:02 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:56 (7960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5092, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2604, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:46:35 (632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:25:59 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1232, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77253F99 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77253AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Apr 2013 21:25:03	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	259,200	472,810	1.8241
03 Apr 2013 02:43:08	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	233,280	430,740	1.8465
31 Mar 2013 13:20:38	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	207,360	380,058	1.8328
30 Mar 2013 11:25:13	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	181,440	324,618	1.7891
29 Mar 2013 09:56:20	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	155,520	268,093	1.7238
28 Mar 2013 02:31:34	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	129,600	210,472	1.6240
27 Mar 2013 01:04:10	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	103,680	198,062	1.9103
26 Mar 2013 04:49:35	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	77,760	143,324	1.8432
25 Mar 2013 12:39:31	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	51,840	106,020	2.0451
24 Mar 2013 12:13:07	1218996	15680145	hadcm3n_3gf4_1940_40_008267586_2	25,920	55,098	2.1257