Task 14750216

Name	hadcm3n_yeey_1940_40_007998753_1
Workunit	8153867
Created	28 May 2012, 16:12:24 UTC
Sent	28 May 2012, 16:19:42 UTC
Report deadline	27 Aug 2012, 23:46:53 UTC
Received	15 Jul 2012, 5:44:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1126273
Run time	12 days 3 hours 19 min 38 sec
CPU time	8 days 21 hours 27 min 42 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CreateFile error 32 when trying set file time CreateFile error 32 when trying set file time Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3124, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5200, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5280, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3888, selfPID=3888, iMonCtr=1 07:54:38 (1544): Can't acquire lockfile (32) - waiting 35s BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yeeyko.pje6c10 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:25:02 (6496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95c0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95d0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95e0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95f0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95g0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95h0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95i0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95j0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95k0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95l0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95m0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95n0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95o0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95p0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95q0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95r0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95s0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95t0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae95u0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9610 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9620 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9630 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9640 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9650 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9660 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9670 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9680 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9690 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae96a0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae96b0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae96c0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.dae9cu0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0110 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0120 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0130 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0140 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0150 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0160 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0170 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0180 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0190 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01a0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01b0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01c0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01d0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01e0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01f0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01g0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01h0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01i0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01j0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01k0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01l0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf01m0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:15:28 (1368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:37 (328): Can't acquire lockfile (32) - waiting 35s 17:24:32 (328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:38 (2060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:39 (2060): No heartbeat from core client for 30 sec - exiting 19:11:30 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0540 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0550 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0560 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0570 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0580 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf0590 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf05a0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf05b0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf05c0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf05d0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf05e0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on yeeyka.daf05f0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:03:36 (6152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:37 (6152): No heartbeat from core client for 30 sec - exiting 19:15:51 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x777EC530 read attempt to address 0x40B460E7 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jul 2012 19:37:53	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	259,200	763,901	2.9471
11 Jul 2012 19:16:54	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	233,280	683,607	2.9304
10 Jul 2012 10:10:45	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	207,360	603,550	2.9106
02 Jul 2012 11:01:35	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	181,440	524,331	2.8898
28 Jun 2012 18:37:49	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	155,520	444,601	2.8588
23 Jun 2012 07:21:44	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	129,600	365,204	2.8179
11 Jun 2012 14:31:01	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	103,680	292,535	2.8215
08 Jun 2012 18:08:03	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	77,760	219,349	2.8208
05 Jun 2012 04:25:51	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	51,840	146,050	2.8173
01 Jun 2012 09:28:32	1126273	14750216	hadcm3n_yeey_1940_40_007998753_1	25,920	72,480	2.7963