Task 12816279

Name	hadcm3n_p0gj_1900_40_007218179_1
Workunit	7416419
Created	26 Apr 2011, 15:14:19 UTC
Sent	5 May 2011, 14:51:00 UTC
Report deadline	4 Aug 2011, 22:18:11 UTC
Received	8 Jul 2011, 15:43:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	255 (0x000000FF) Unknown error code
Computer ID	829754
Run time	17 days 14 hours 2 min 47 sec
CPU time	16 days 7 hours 45 min 16 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The extended attributes are inconsistent. (0xff) - exit code 255 (0xff) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:37:40 (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:19:07 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:08 (4904): No heartbeat from core client for 30 sec - exiting 22:32:26 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:28 (4180): No heartbeat from core client for 30 sec - exiting 00:18:14 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:15 (4728): No heartbeat from core client for 30 sec - exiting 00:18:16 (4728): No heartbeat from core client for 30 sec - exiting 00:18:17 (4728): No heartbeat from core client for 30 sec - exiting 00:18:18 (4728): No heartbeat from core client for 30 sec - exiting 00:18:19 (4728): No heartbeat from core client for 30 sec - exiting 00:18:20 (4728): No heartbeat from core client for 30 sec - exiting 00:18:21 (4728): No heartbeat from core client for 30 sec - exiting 00:18:22 (4728): No heartbeat from core client for 30 sec - exiting 00:18:23 (4728): No heartbeat from core client for 30 sec - exiting 00:18:24 (4728): No heartbeat from core client for 30 sec - exiting 00:19:26 (6488): No heartbeat from core client for 30 sec - exiting 00:19:27 (6488): No heartbeat from core client for 30 sec - exiting 00:19:28 (6488): No heartbeat from core client for 30 sec - exiting 00:19:29 (6488): No heartbeat from core client for 30 sec - exiting 00:19:30 (6488): No heartbeat from core client for 30 sec - exiting 00:19:31 (6488): No heartbeat from core client for 30 sec - exiting 00:19:32 (6488): No heartbeat from core client for 30 sec - exiting 00:19:33 (6488): No heartbeat from core client for 30 sec - exiting 00:19:34 (6488): No heartbeat from core client for 30 sec - exiting 00:19:35 (6488): No heartbeat from core client for 30 sec - exiting 00:19:36 (6488): No heartbeat from core client for 30 sec - exiting 00:19:37 (6488): No heartbeat from core client for 30 sec - exiting 00:19:38 (6488): No heartbeat from core client for 30 sec - exiting 00:19:39 (6488): No heartbeat from core client for 30 sec - exiting 00:19:40 (6488): No heartbeat from core client for 30 sec - exiting 00:19:41 (6488): No heartbeat from core client for 30 sec - exiting 00:19:42 (6488): No heartbeat from core client for 30 sec - exiting 00:19:43 (6488): No heartbeat from core client for 30 sec - exiting 00:19:44 (6488): No heartbeat from core client for 30 sec - exiting 00:19:45 (6488): No heartbeat from core client for 30 sec - exiting 00:19:46 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:19:47 (6488): No heartbeat from core client for 30 sec - exiting 00:19:48 (6488): No heartbeat from core client for 30 sec - exiting 00:19:49 (6488): No heartbeat from core client for 30 sec - exiting 00:22:19 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:22:28 (6068): No heartbeat from core client for 30 sec - exiting 00:22:29 (6068): No heartbeat from core client for 30 sec - exiting 00:22:30 (6068): No heartbeat from core client for 30 sec - exiting 00:22:31 (6068): No heartbeat from core client for 30 sec - exiting 00:22:32 (6068): No heartbeat from core client for 30 sec - exiting 00:22:33 (6068): No heartbeat from core client for 30 sec - exiting 00:26:51 (6948): No heartbeat from core client for 30 sec - exiting 00:26:52 (6948): No heartbeat from core client for 30 sec - exiting 00:26:53 (6948): No heartbeat from core client for 30 sec - exiting 00:26:54 (6948): No heartbeat from core client for 30 sec - exiting 00:26:55 (6948): No heartbeat from core client for 30 sec - exiting 00:26:56 (6948): No heartbeat from core client for 30 sec - exiting 00:26:57 (6948): No heartbeat from core client for 30 sec - exiting 00:26:58 (6948): No heartbeat from core client for 30 sec - exiting 00:26:59 (6948): No heartbeat from core client for 30 sec - exiting 00:27:00 (6948): No heartbeat from core client for 30 sec - exiting 00:27:01 (6948): No heartbeat from core client for 30 sec - exiting 00:27:02 (6948): No heartbeat from core client for 30 sec - exiting 00:27:03 (6948): No heartbeat from core client for 30 sec - exiting 00:27:04 (6948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:30:37 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:39:21 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:39:23 (5092): No heartbeat from core client for 30 sec - exiting 00:39:24 (5092): No heartbeat from core client for 30 sec - exiting 00:39:25 (5092): No heartbeat from core client for 30 sec - exiting 01:31:48 (7972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:50 (7972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:15:04 (7980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:15:05 (7980): No heartbeat from core client for 30 sec - exiting 04:15:06 (7980): No heartbeat from core client for 30 sec - exiting 04:15:07 (7980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:57:27 (4720): No heartbeat from core client for 30 sec - exiting 12:57:29 (4720): No heartbeat from core client for 30 sec - exiting 12:57:30 (4720): No heartbeat from core client for 30 sec - exiting 12:57:31 (4720): No heartbeat from core client for 30 sec - exiting 12:57:32 (4720): No heartbeat from core client for 30 sec - exiting 12:57:33 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:34 (4720): No heartbeat from core client for 30 sec - exiting 12:57:35 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:16:01 (532): Can't acquire lockfile (32) - waiting 35s 08:16:26 (8180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:56:18 (1096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:15:37 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:24:46 (3676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:38:38 (1680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:17:44 (6176): No heartbeat from core client for 30 sec - exiting 23:17:45 (6176): No heartbeat from core client for 30 sec - exiting 23:17:46 (6176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:47 (6176): No heartbeat from core client for 30 sec - exiting 23:17:48 (6176): No heartbeat from core client for 30 sec - exiting 23:17:49 (6176): No heartbeat from core client for 30 sec - exiting 23:17:50 (6176): No heartbeat from core client for 30 sec - exiting 23:17:51 (6176): No heartbeat from core client for 30 sec - exiting 23:17:52 (6176): No heartbeat from core client for 30 sec - exiting 23:17:53 (6176): No heartbeat from core client for 30 sec - exiting 23:17:54 (6176): No heartbeat from core client for 30 sec - exiting 23:17:55 (6176): No heartbeat from core client for 30 sec - exiting 23:17:56 (6176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:49:06 (7060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:17:23 (7100): No heartbeat from core client for 30 sec - exiting 23:17:24 (7100): No heartbeat from core client for 30 sec - exiting 23:17:25 (7100): No heartbeat from core client for 30 sec - exiting 23:17:26 (7100): No heartbeat from core client for 30 sec - exiting 23:17:27 (7100): No heartbeat from core client for 30 sec - exiting 23:17:28 (7100): No heartbeat from core client for 30 sec - exiting 23:17:29 (7100): No heartbeat from core client for 30 sec - exiting 23:17:30 (7100): No heartbeat from core client for 30 sec - exiting 23:17:31 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4512, selfPID=4512, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00417B59 read attempt to address 0x41F6DE9B Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4616, selfPID=4616, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77B96E0F read attempt to address 0x404B95D6 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77B96E0F read attempt to address 0x404B95D6 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Jul 2011 01:11:03	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	777,600	1,409,405	1.8125
07 Jul 2011 17:56:20	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	751,680	1,361,543	1.8113
05 Jul 2011 04:52:23	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	725,760	1,312,777	1.8088
03 Jul 2011 04:59:22	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	699,840	1,264,192	1.8064
01 Jul 2011 15:57:59	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	673,920	1,217,686	1.8069
30 Jun 2011 20:38:08	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	648,000	1,171,933	1.8085
29 Jun 2011 08:33:40	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	622,080	1,125,922	1.8099
27 Jun 2011 06:18:08	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	596,160	1,078,585	1.8092
26 Jun 2011 00:48:01	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	570,240	1,032,821	1.8112
22 Jun 2011 14:58:03	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	544,320	986,691	1.8127
20 Jun 2011 22:48:31	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	518,400	939,798	1.8129
19 Jun 2011 22:01:41	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	492,480	893,891	1.8151
17 Jun 2011 11:06:20	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	466,560	848,450	1.8185
15 Jun 2011 21:26:06	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	440,640	801,243	1.8184
12 Jun 2011 07:42:53	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	414,720	753,473	1.8168
05 Jun 2011 07:55:32	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	388,800	706,241	1.8165
02 Jun 2011 23:44:16	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	362,880	660,759	1.8209
02 Jun 2011 05:31:09	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	336,960	614,896	1.8248
28 May 2011 09:29:49	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	311,040	568,090	1.8264
23 May 2011 18:16:21	829754	12816279	hadcm3n_p0gj_1900_40_007218179_1	285,120	522,664	1.8331