Task 12821522

Name	hadcm3n_p2hc_1900_40_007220800_0
Workunit	7419040
Created	26 Apr 2011, 15:21:12 UTC
Sent	2 May 2011, 11:29:57 UTC
Report deadline	1 Aug 2011, 18:57:08 UTC
Received	6 Jun 2011, 4:11:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1052964
Run time	8 days 2 hours 5 min 59 sec
CPU time	7 days 11 hours 21 min 22 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.60 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3328, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:22:42 (4192): No heartbeat from core client for 30 sec - exiting 20:22:43 (4192): No heartbeat from core client for 30 sec - exiting 20:22:44 (4192): No heartbeat from core client for 30 sec - exiting 20:22:45 (4192): No heartbeat from core client for 30 sec - exiting 20:22:46 (4192): No heartbeat from core client for 30 sec - exiting 20:22:47 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:24:41 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:29 (7320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:31 (7280): No heartbeat from core client for 30 sec - exiting 07:54:33 (7280): No heartbeat from core client for 30 sec - exiting 07:54:34 (7280): No heartbeat from core client for 30 sec - exiting 07:54:36 (7280): No heartbeat from core client for 30 sec - exiting 07:54:38 (7280): No heartbeat from core client for 30 sec - exiting 07:54:40 (7280): No heartbeat from core client for 30 sec - exiting 07:54:41 (7280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:50 (7900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6564, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:06:04 (2224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:06:06 (2224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:46:39 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:32:17 (5528): No heartbeat from core client for 30 sec - exiting 06:32:18 (5528): No heartbeat from core client for 30 sec - exiting 06:32:19 (5528): No heartbeat from core client for 30 sec - exiting 06:32:20 (5528): No heartbeat from core client for 30 sec - exiting 06:32:21 (5528): No heartbeat from core client for 30 sec - exiting 06:32:22 (5528): No heartbeat from core client for 30 sec - exiting 06:32:23 (5528): No heartbeat from core client for 30 sec - exiting 06:32:25 (5528): No heartbeat from core client for 30 sec - exiting 06:32:26 (5528): No heartbeat from core client for 30 sec - exiting 06:32:27 (5528): No heartbeat from core client for 30 sec - exiting 06:32:28 (5528): No heartbeat from core client for 30 sec - exiting 06:32:29 (5528): No heartbeat from core client for 30 sec - exiting 06:32:30 (5528): No heartbeat from core client for 30 sec - exiting 06:32:31 (5528): No heartbeat from core client for 30 sec - exiting 06:32:32 (5528): No heartbeat from core client for 30 sec - exiting 06:32:33 (5528): No heartbeat from core client for 30 sec - exiting 06:32:34 (5528): No heartbeat from core client for 30 sec - exiting 06:32:35 (5528): No heartbeat from core client for 30 sec - exiting 06:32:37 (5528): No heartbeat from core client for 30 sec - exiting 06:32:38 (5528): No heartbeat from core client for 30 sec - exiting 06:32:39 (5528): No heartbeat from core client for 30 sec - exiting 06:32:40 (5528): No heartbeat from core client for 30 sec - exiting 06:32:41 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:42 (5528): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1340, iMonCtr=1 Model crash detected, will try to restart... 14:18:58 (764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:44:42 (2344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:51:12 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:45 (816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:07:04 (4236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:07:48 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:29:55 (3400): No heartbeat from core client for 30 sec - exiting 06:29:56 (3400): No heartbeat from core client for 30 sec - exiting 06:29:58 (3400): No heartbeat from core client for 30 sec - exiting 06:29:59 (3400): No heartbeat from core client for 30 sec - exiting 06:30:00 (3400): No heartbeat from core client for 30 sec - exiting 06:30:01 (3400): No heartbeat from core client for 30 sec - exiting 06:30:02 (3400): No heartbeat from core client for 30 sec - exiting 06:30:03 (3400): No heartbeat from core client for 30 sec - exiting 06:30:04 (3400): No heartbeat from core client for 30 sec - exiting 06:30:05 (3400): No heartbeat from core client for 30 sec - exiting 06:30:06 (3400): No heartbeat from core client for 30 sec - exiting 06:30:08 (3400): No heartbeat from core client for 30 sec - exiting 06:30:09 (3400): No heartbeat from core client for 30 sec - exiting 06:30:10 (3400): No heartbeat from core client for 30 sec - exiting 06:30:11 (3400): No heartbeat from core client for 30 sec - exiting 06:30:12 (3400): No heartbeat from core client for 30 sec - exiting 06:30:13 (3400): No heartbeat from core client for 30 sec - exiting 06:30:14 (3400): No heartbeat from core client for 30 sec - exiting 06:30:15 (3400): No heartbeat from core client for 30 sec - exiting 06:30:16 (3400): No heartbeat from core client for 30 sec - exiting 06:30:17 (3400): No heartbeat from core client for 30 sec - exiting 06:30:19 (3400): No heartbeat from core client for 30 sec - exiting 06:30:20 (3400): No heartbeat from core client for 30 sec - exiting 06:30:21 (3400): No heartbeat from core client for 30 sec - exiting 06:30:22 (3400): No heartbeat from core client for 30 sec - exiting 06:30:23 (3400): No heartbeat from core client for 30 sec - exiting 06:30:24 (3400): No heartbeat from core client for 30 sec - exiting 06:30:25 (3400): No heartbeat from core client for 30 sec - exiting 06:30:26 (3400): No heartbeat from core client for 30 sec - exiting 06:30:27 (3400): No heartbeat from core client for 30 sec - exiting 06:30:28 (3400): No heartbeat from core client for 30 sec - exiting 06:30:29 (3400): No heartbeat from core client for 30 sec - exiting 06:30:30 (3400): No heartbeat from core client for 30 sec - exiting 06:30:31 (3400): No heartbeat from core client for 30 sec - exiting 06:30:33 (3400): No heartbeat from core client for 30 sec - exiting 06:30:34 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:29:56 (2212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:57 (2212): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:20:19 (5148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:09 (3632): No heartbeat from core client for 30 sec - exiting 21:10:10 (3632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:06 (6092): No heartbeat from core client for 30 sec - exiting 06:25:07 (6092): No heartbeat from core client for 30 sec - exiting 06:25:08 (6092): No heartbeat from core client for 30 sec - exiting 06:25:10 (6092): No heartbeat from core client for 30 sec - exiting 06:25:11 (6092): No heartbeat from core client for 30 sec - exiting 06:25:12 (6092): No heartbeat from core client for 30 sec - exiting 06:25:13 (6092): No heartbeat from core client for 30 sec - exiting 06:25:14 (6092): No heartbeat from core client for 30 sec - exiting 06:25:15 (6092): No heartbeat from core client for 30 sec - exiting 06:25:16 (6092): No heartbeat from core client for 30 sec - exiting 06:25:17 (6092): No heartbeat from core client for 30 sec - exiting 06:25:18 (6092): No heartbeat from core client for 30 sec - exiting 06:25:19 (6092): No heartbeat from core client for 30 sec - exiting 06:25:20 (6092): No heartbeat from core client for 30 sec - exiting 06:25:22 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:54:46 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:40:03 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:50 (5636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:19 (8064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:10 (2564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:17:57 (6140): No heartbeat from core client for 30 sec - exiting 05:17:58 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:17:59 (6140): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:12:25 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:42:52 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:11:52 (1536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:11:40 (5252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:41 (5252): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... C06:31:30 (5468): No heartbeat from core client for 30 sec - exiting 06:31:31 (5468): No heartbeat from core client for 30 sec - exiting 06:31:32 (5468): No heartbeat from core client for 30 sec - exiting 06:31:34 (5468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:19:55 (6136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:19:56 (6136): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:13:48 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6696, iMonCtr=1 Model crash detected, will try to restart... 06:44:31 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:07 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:08 (5708): No heartbeat from core client for 30 sec - exiting 10:27:17 (6664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x776DC3CB write attempt to address 0x43321862 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Jun 2011 13:35:27	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	259,200	645,665	2.4910
31 May 2011 17:12:16	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	233,280	580,356	2.4878
30 May 2011 11:29:50	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	207,360	516,815	2.4924
24 May 2011 07:02:55	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	181,440	451,169	2.4866
20 May 2011 19:40:18	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	155,520	386,198	2.4833
19 May 2011 04:50:20	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	129,600	325,196	2.5092
17 May 2011 17:31:36	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	103,680	266,750	2.5728
13 May 2011 07:23:12	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	77,760	200,420	2.5774
09 May 2011 15:17:41	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	51,840	136,859	2.6400
05 May 2011 06:09:39	1052964	12821522	hadcm3n_p2hc_1900_40_007220800_0	25,920	68,092	2.6270