Task 12823660

Name	hadcm3n_p3b0_1900_40_007221868_1
Workunit	7420108
Created	26 Apr 2011, 15:24:01 UTC
Sent	1 May 2011, 5:54:37 UTC
Report deadline	31 Jul 2011, 13:21:48 UTC
Received	8 Jun 2011, 8:39:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1146891
Run time	20 days 4 hours 18 min
CPU time	19 days 12 hours 9 min 3 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.09 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:54:45 (5420): No heartbeat from core client for 30 sec - exiting 18:54:46 (5420): No heartbeat from core client for 30 sec - exiting 18:54:47 (5420): No heartbeat from core client for 30 sec - exiting 18:54:48 (5420): No heartbeat from core client for 30 sec - exiting 18:54:49 (5420): No heartbeat from core client for 30 sec - exiting 18:54:50 (5420): No heartbeat from core client for 30 sec - exiting 18:54:51 (5420): No heartbeat from core client for 30 sec - exiting 18:54:52 (5420): No heartbeat from core client for 30 sec - exiting 18:54:53 (5420): No heartbeat from core client for 30 sec - exiting 18:54:54 (5420): No heartbeat from core client for 30 sec - exiting 18:54:55 (5420): No heartbeat from core client for 30 sec - exiting 18:54:56 (5420): No heartbeat from core client for 30 sec - exiting 18:54:57 (5420): No heartbeat from core client for 30 sec - exiting 18:54:58 (5420): No heartbeat from core client for 30 sec - exiting 18:54:59 (5420): No heartbeat from core client for 30 sec - exiting 18:55:00 (5420): No heartbeat from core client for 30 sec - exiting 18:55:01 (5420): No heartbeat from core client for 30 sec - exiting 18:55:02 (5420): No heartbeat from core client for 30 sec - exiting 18:55:03 (5420): No heartbeat from core client for 30 sec - exiting 18:55:04 (5420): No heartbeat from core client for 30 sec - exiting 18:55:05 (5420): No heartbeat from core client for 30 sec - exiting 18:55:06 (5420): No heartbeat from core client for 30 sec - exiting 18:55:07 (5420): No heartbeat from core client for 30 sec - exiting 18:55:08 (5420): No heartbeat from core client for 30 sec - exiting 18:55:09 (5420): No heartbeat from core client for 30 sec - exiting 18:55:10 (5420): No heartbeat from core client for 30 sec - exiting 18:55:11 (5420): No heartbeat from core client for 30 sec - exiting 18:55:12 (5420): No heartbeat from core client for 30 sec - exiting 18:55:13 (5420): No heartbeat from core client for 30 sec - exiting 18:55:14 (5420): No heartbeat from core client for 30 sec - exiting 18:55:15 (5420): No heartbeat from core client for 30 sec - exiting 18:55:16 (5420): No heartbeat from core client for 30 sec - exiting 18:55:17 (5420): No heartbeat from core client for 30 sec - exiting 18:55:18 (5420): No heartbeat from core client for 30 sec - exiting 18:55:19 (5420): No heartbeat from core client for 30 sec - exiting 18:55:20 (5420): No heartbeat from core client for 30 sec - exiting 18:55:21 (5420): No heartbeat from core client for 30 sec - exiting 18:55:22 (5420): No heartbeat from core client for 30 sec - exiting 18:55:23 (5420): No heartbeat from core client for 30 sec - exiting 18:55:24 (5420): No heartbeat from core client for 30 sec - exiting 18:55:25 (5420): No heartbeat from core client for 30 sec - exiting 18:55:26 (5420): No heartbeat from core client for 30 sec - exiting 18:55:27 (5420): No heartbeat from core client for 30 sec - exiting 18:55:28 (5420): No heartbeat from core client for 30 sec - exiting 18:55:29 (5420): No heartbeat from core client for 30 sec - exiting 18:55:30 (5420): No heartbeat from core client for 30 sec - exiting 18:55:31 (5420): No heartbeat from core client for 30 sec - exiting 18:55:32 (5420): No heartbeat from core client for 30 sec - exiting 18:55:33 (5420): No heartbeat from core client for 30 sec - exiting 18:55:34 (5420): No heartbeat from core client for 30 sec - exiting 18:55:35 (5420): No heartbeat from core client for 30 sec - exiting 18:55:36 (5420): No heartbeat from core client for 30 sec - exiting 18:55:37 (5420): No heartbeat from core client for 30 sec - exiting 18:55:38 (5420): No heartbeat from core client for 30 sec - exiting 18:55:39 (5420): No heartbeat from core client for 30 sec - exiting 18:55:40 (5420): No heartbeat from core client for 30 sec - exiting 18:55:41 (5420): No heartbeat from core client for 30 sec - exiting 18:55:42 (5420): No heartbeat from core client for 30 sec - exiting 18:55:43 (5420): No heartbeat from core client for 30 sec - exiting 18:55:44 (5420): No heartbeat from core client for 30 sec - exiting 18:55:45 (5420): No heartbeat from core client for 30 sec - exiting 18:55:46 (5420): No heartbeat from core client for 30 sec - exiting 18:55:47 (5420): No heartbeat from core client for 30 sec - exiting 18:55:48 (5420): No heartbeat from core client for 30 sec - exiting 18:55:49 (5420): No heartbeat from core client for 30 sec - exiting 18:55:50 (5420): No heartbeat from core client for 30 sec - exiting 18:55:51 (5420): No heartbeat from core client for 30 sec - exiting 18:55:52 (5420): No heartbeat from core client for 30 sec - exiting 18:55:53 (5420): No heartbeat from core client for 30 sec - exiting 18:55:54 (5420): No heartbeat from core client for 30 sec - exiting 18:55:55 (5420): No heartbeat from core client for 30 sec - exiting 18:55:56 (5420): No heartbeat from core client for 30 sec - exiting 18:55:57 (5420): No heartbeat from core client for 30 sec - exiting 18:55:58 (5420): No heartbeat from core client for 30 sec - exiting 18:55:59 (5420): No heartbeat from core client for 30 sec - exiting 18:56:00 (5420): No heartbeat from core client for 30 sec - exiting 18:56:01 (5420): No heartbeat from core client for 30 sec - exiting 18:56:02 (5420): No heartbeat from core client for 30 sec - exiting 18:56:03 (5420): No heartbeat from core client for 30 sec - exiting 18:56:04 (5420): No heartbeat from core client for 30 sec - exiting 18:56:05 (5420): No heartbeat from core client for 30 sec - exiting 18:56:06 (5420): No heartbeat from core client for 30 sec - exiting 18:56:07 (5420): No heartbeat from core client for 30 sec - exiting 18:56:08 (5420): No heartbeat from core client for 30 sec - exiting 18:56:09 (5420): No heartbeat from core client for 30 sec - exiting 18:56:10 (5420): No heartbeat from core client for 30 sec - exiting 18:56:11 (5420): No heartbeat from core client for 30 sec - exiting 18:56:12 (5420): No heartbeat from core client for 30 sec - exiting 18:56:13 (5420): No heartbeat from core client for 30 sec - exiting 18:56:14 (5420): No heartbeat from core client for 30 sec - exiting 18:56:15 (5420): No heartbeat from core client for 30 sec - exiting 18:56:16 (5420): No heartbeat from core client for 30 sec - exiting 18:56:17 (5420): No heartbeat from core client for 30 sec - exiting 18:56:18 (5420): No heartbeat from core client for 30 sec - exiting 18:56:19 (5420): No heartbeat from core client for 30 sec - exiting 18:56:20 (5420): No heartbeat from core client for 30 sec - exiting 18:56:21 (5420): No heartbeat from core client for 30 sec - exiting 18:56:22 (5420): No heartbeat from core client for 30 sec - exiting 18:56:23 (5420): No heartbeat from core client for 30 sec - exiting 18:56:24 (5420): No heartbeat from core client for 30 sec - exiting 18:56:25 (5420): No heartbeat from core client for 30 sec - exiting 18:56:26 (5420): No heartbeat from core client for 30 sec - exiting 18:56:27 (5420): No heartbeat from core client for 30 sec - exiting 18:56:28 (5420): No heartbeat from core client for 30 sec - exiting 18:56:29 (5420): No heartbeat from core client for 30 sec - exiting 18:56:30 (5420): No heartbeat from core client for 30 sec - exiting 18:56:31 (5420): No heartbeat from core client for 30 sec - exiting 18:56:32 (5420): No heartbeat from core client for 30 sec - exiting 18:56:33 (5420): No heartbeat from core client for 30 sec - exiting 18:56:34 (5420): No heartbeat from core client for 30 sec - exiting 18:56:35 (5420): No heartbeat from core client for 30 sec - exiting 18:56:36 (5420): No heartbeat from core client for 30 sec - exiting 18:56:37 (5420): No heartbeat from core client for 30 sec - exiting 18:56:38 (5420): No heartbeat from core client for 30 sec - exiting 18:56:39 (5420): No heartbeat from core client for 30 sec - exiting 18:56:40 (5420): No heartbeat from core client for 30 sec - exiting 18:56:41 (5420): No heartbeat from core client for 30 sec - exiting 18:56:42 (5420): No heartbeat from core client for 30 sec - exiting 18:56:43 (5420): No heartbeat from core client for 30 sec - exiting 18:56:44 (5420): No heartbeat from core client for 30 sec - exiting 18:56:45 (5420): No heartbeat from core client for 30 sec - exiting 18:56:46 (5420): No heartbeat from core client for 30 sec - exiting 18:56:47 (5420): No heartbeat from core client for 30 sec - exiting 18:56:48 (5420): No heartbeat from core client for 30 sec - exiting 18:56:49 (5420): No heartbeat from core client for 30 sec - exiting 18:56:50 (5420): No heartbeat from core client for 30 sec - exiting 18:56:51 (5420): No heartbeat from core client for 30 sec - exiting 18:56:52 (5420): No heartbeat from core client for 30 sec - exiting 18:56:53 (5420): No heartbeat from core client for 30 sec - exiting 18:56:54 (5420): No heartbeat from core client for 30 sec - exiting 18:56:55 (5420): No heartbeat from core client for 30 sec - exiting 18:56:56 (5420): No heartbeat from core client for 30 sec - exiting 18:56:57 (5420): No heartbeat from core client for 30 sec - exiting 18:56:58 (5420): No heartbeat from core client for 30 sec - exiting 18:56:59 (5420): No heartbeat from core client for 30 sec - exiting 18:57:00 (5420): No heartbeat from core client for 30 sec - exiting 18:57:01 (5420): No heartbeat from core client for 30 sec - exiting 18:57:02 (5420): No heartbeat from core client for 30 sec - exiting 18:57:03 (5420): No heartbeat from core client for 30 sec - exiting 18:57:04 (5420): No heartbeat from core client for 30 sec - exiting 18:57:05 (5420): No heartbeat from core client for 30 sec - exiting 18:57:06 (5420): No heartbeat from core client for 30 sec - exiting 18:57:07 (5420): No heartbeat from core client for 30 sec - exiting 18:57:08 (5420): No heartbeat from core client for 30 sec - exiting 18:57:09 (5420): No heartbeat from core client for 30 sec - exiting 18:57:10 (5420): No heartbeat from core client for 30 sec - exiting 18:57:11 (5420): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:58:04 (1536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:07:31 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x778E7353 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8668, selfPID=8668, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x778E3A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Jun 2011 19:03:56	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	777,600	1,682,150	2.1633
06 Jun 2011 19:25:00	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	751,680	1,630,959	2.1698
05 Jun 2011 21:40:00	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	725,760	1,580,762	2.1781
04 Jun 2011 22:30:50	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	699,840	1,530,567	2.1870
03 Jun 2011 23:06:40	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	673,920	1,480,300	2.1966
02 Jun 2011 22:48:37	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	648,000	1,428,970	2.2052
01 Jun 2011 22:07:18	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	622,080	1,378,643	2.2162
31 May 2011 20:54:53	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	596,160	1,326,972	2.2259
30 May 2011 20:29:19	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	570,240	1,274,565	2.2351
29 May 2011 20:09:26	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	544,320	1,222,539	2.2460
28 May 2011 19:42:58	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	518,400	1,171,289	2.2594
27 May 2011 22:46:22	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	492,480	1,120,253	2.2747
27 May 2011 05:05:27	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	466,560	1,069,524	2.2924
26 May 2011 11:14:33	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	440,640	1,018,749	2.3120
25 May 2011 15:21:40	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	414,720	967,545	2.3330
24 May 2011 18:35:20	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	388,800	915,649	2.3551
23 May 2011 19:37:59	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	362,880	863,196	2.3787
22 May 2011 20:16:55	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	336,960	809,588	2.4026
21 May 2011 22:19:49	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	311,040	758,287	2.4379
20 May 2011 23:54:10	1146891	12823660	hadcm3n_p3b0_1900_40_007221868_1	285,120	708,065	2.4834