climateprediction.net home page
Task 15879196

Task 15879196

Name hadcm3n_o2y3_1980_40_008398136_0
Workunit 8548992
Created 3 Jul 2013, 17:50:05 UTC
Sent 4 Jul 2013, 23:12:14 UTC
Report deadline 4 Oct 2013, 6:39:25 UTC
Received 27 Aug 2013, 3:25:07 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID 1104109
Run time 22 days 6 hours 14 min 46 sec
CPU time 18 days 14 hours 43 min 13 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 2.45 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.64</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -1073741819 (0xc0000005)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o2y3ko.dai88a0
Ocean Restart file copy failed on o2y3ko.dai88b0
Ocean Restart file copy failed on o2y3ko.dai88c0
Suspended CPDN Monitor - Suspend request from BOINC...
13:08:14 (6800): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:08:15 (6800): No heartbeat from core client for 30 sec - exiting
13:08:16 (6800): No heartbeat from core client for 30 sec - exiting
13:08:17 (6800): No heartbeat from core client for 30 sec - exiting
13:08:18 (6800): No heartbeat from core client for 30 sec - exiting
13:08:19 (6800): No heartbeat from core client for 30 sec - exiting
13:08:20 (6800): No heartbeat from core client for 30 sec - exiting
13:08:21 (6800): No heartbeat from core client for 30 sec - exiting
13:08:22 (6800): No heartbeat from core client for 30 sec - exiting
13:08:23 (6800): No heartbeat from core client for 30 sec - exiting
13:08:24 (6800): No heartbeat from core client for 30 sec - exiting
19:50:12 (3948): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:52:44 (5852): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:50:41 (4148): No heartbeat from core client for 30 sec - exiting
22:50:42 (4148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:50:43 (4148): No heartbeat from core client for 30 sec - exiting
22:50:44 (4148): No heartbeat from core client for 30 sec - exiting
22:50:45 (4148): No heartbeat from core client for 30 sec - exiting
22:50:46 (4148): No heartbeat from core client for 30 sec - exiting
22:50:47 (4148): No heartbeat from core client for 30 sec - exiting
22:50:48 (4148): No heartbeat from core client for 30 sec - exiting
22:50:49 (4148): No heartbeat from core client for 30 sec - exiting
22:50:50 (4148): No heartbeat from core client for 30 sec - exiting
22:50:51 (4148): No heartbeat from core client for 30 sec - exiting
22:50:52 (4148): No heartbeat from core client for 30 sec - exiting
09:44:25 (2148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:44:26 (2148): No heartbeat from core client for 30 sec - exiting
09:44:27 (2148): No heartbeat from core client for 30 sec - exiting
09:44:28 (2148): No heartbeat from core client for 30 sec - exiting
09:44:29 (2148): No heartbeat from core client for 30 sec - exiting
09:44:30 (2148): No heartbeat from core client for 30 sec - exiting
09:44:31 (2148): No heartbeat from core client for 30 sec - exiting
09:44:32 (2148): No heartbeat from core client for 30 sec - exiting
09:44:33 (2148): No heartbeat from core client for 30 sec - exiting
09:44:34 (2148): No heartbeat from core client for 30 sec - exiting
09:44:35 (2148): No heartbeat from core client for 30 sec - exiting
09:44:36 (2148): No heartbeat from core client for 30 sec - exiting
09:44:37 (2148): No heartbeat from core client for 30 sec - exiting
09:44:38 (2148): No heartbeat from core client for 30 sec - exiting
09:44:39 (2148): No heartbeat from core client for 30 sec - exiting
09:44:40 (2148): No heartbeat from core client for 30 sec - exiting
09:44:41 (2148): No heartbeat from core client for 30 sec - exiting
09:44:42 (2148): No heartbeat from core client for 30 sec - exiting
09:44:43 (2148): No heartbeat from core client for 30 sec - exiting
09:44:44 (2148): No heartbeat from core client for 30 sec - exiting
09:44:45 (2148): No heartbeat from core client for 30 sec - exiting
09:44:46 (2148): No heartbeat from core client for 30 sec - exiting
09:44:47 (2148): No heartbeat from core client for 30 sec - exiting
09:44:48 (2148): No heartbeat from core client for 30 sec - exiting
09:44:49 (2148): No heartbeat from core client for 30 sec - exiting
09:44:50 (2148): No heartbeat from core client for 30 sec - exiting
09:44:51 (2148): No heartbeat from core client for 30 sec - exiting
09:44:52 (2148): No heartbeat from core client for 30 sec - exiting
09:44:53 (2148): No heartbeat from core client for 30 sec - exiting
09:44:54 (2148): No heartbeat from core client for 30 sec - exiting
09:44:55 (2148): No heartbeat from core client for 30 sec - exiting
11:55:46 (3784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:10:14 (4656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:10:15 (4656): No heartbeat from core client for 30 sec - exiting
09:10:16 (4656): No heartbeat from core client for 30 sec - exiting
09:10:17 (4656): No heartbeat from core client for 30 sec - exiting
09:10:18 (4656): No heartbeat from core client for 30 sec - exiting
09:10:19 (4656): No heartbeat from core client for 30 sec - exiting
09:10:20 (4656): No heartbeat from core client for 30 sec - exiting
09:10:21 (4656): No heartbeat from core client for 30 sec - exiting
09:10:22 (4656): No heartbeat from core client for 30 sec - exiting
09:10:23 (4656): No heartbeat from core client for 30 sec - exiting
09:10:24 (4656): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
17:52:56 (1848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
06:07:20 (9296): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
06:32:19 (8592): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o2y3ko.daj3bg0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
06:15:12 (9468): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:23:02 (2940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
10:56:13 (9728): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
10:56:15 (9728): No heartbeat from core client for 30 sec - exiting
10:56:16 (9728): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
05:04:56 (12064): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o2y3ko.dak1bj0
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o2y3ko.dak51p0
Ocean Restart file copy failed on o2y3ko.dak6260
Ocean Restart file copy failed on o2y3ko.dak69q0
Ocean Restart file copy failed on o2y3ko.dak69r0
Ocean Restart file copy failed on o2y3ko.dak69s0
Ocean Restart file copy failed on o2y3ko.dak69t0
Ocean Restart file copy failed on o2y3ko.dak69u0
Ocean Restart file copy failed on o2y3ko.dak6a10
Ocean Restart file copy failed on o2y3ko.dak6a20
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
04:53:11 (11476): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:11:40 (10432): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:44:59 (8800): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Ocean Restart file copy failed on o2y3ko.dal25u0
Ocean Restart file copy failed on o2y3ko.dal2740
Ocean Restart file copy failed on o2y3ko.dal27p0
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7156, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/o2y3ko.pjl5c10
Error converting file to netcdf: dataout/o2y3ko.pil5c10
Error converting file to netcdf: dataout/o2y3ko.pfl5c10
Error converting file to netcdf: dataout/o2y3ka.phl5c10
Error converting file to netcdf: dataout/o2y3ka.pgl5c10
Error converting file to netcdf: dataout/o2y3ka.pel5c10
20:29:39 (3528): No heartbeat from core client for 30 sec - exiting
20:29:40 (3528): No heartbeat from core client for 30 sec - exiting
20:29:41 (3528): No heartbeat from core client for 30 sec - exiting
20:29:42 (3528): No heartbeat from core client for 30 sec - exiting
20:29:43 (3528): No heartbeat from core client for 30 sec - exiting
20:29:44 (3528): No heartbeat from core client for 30 sec - exiting
20:29:45 (3528): No heartbeat from core client for 30 sec - exiting
20:29:46 (3528): No heartbeat from core client for 30 sec - exiting
20:29:47 (3528): No heartbeat from core client for 30 sec - exiting
20:29:48 (3528): No heartbeat from core client for 30 sec - exiting
20:29:49 (3528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/o2y3ko.pjl5c10
Error converting file to netcdf: dataout/o2y3ko.pil5c10
Error converting file to netcdf: dataout/o2y3ko.pfl5c10
Error converting file to netcdf: dataout/o2y3ka.phl5c10
Error converting file to netcdf: dataout/o2y3ka.pgl5c10
Error converting file to netcdf: dataout/o2y3ka.pel5c10
Error converting file to netcdf: dataout/o2y3ka.pdl5c10
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:27:01 (4732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:02:07 (2500): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Ocean Restart file copy failed on o2y3ko.dam04t0
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x77D33FA9 read attempt to address 0xFFFFFFF8

Engaging BOINC Windows Runtime Debugger...

03:50:06 (3120): No heartbeat from core client for 30 sec - exiting
03:50:07 (3120): No heartbeat from core client for 30 sec - exiting
03:50:08 (3120): No heartbeat from core client for 30 sec - exiting
03:50:09 (3120): No heartbeat from core client for 30 sec - exiting


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x77D33AC3 read attempt to address 0x00000000

Engaging BOINC Windows Runtime Debugger...


</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Aug 2013 09:19:33 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 1,036,800 1,607,642 1.5506
25 Aug 2013 20:30:31 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 1,010,880 1,567,967 1.5511
24 Aug 2013 22:51:14 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 984,960 1,528,111 1.5514
23 Aug 2013 22:40:06 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 959,040 1,487,732 1.5513
23 Aug 2013 10:38:19 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 933,120 1,446,489 1.5502
22 Aug 2013 04:23:04 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 907,200 1,405,823 1.5496
20 Aug 2013 20:36:42 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 881,280 1,364,299 1.5481
20 Aug 2013 00:19:36 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 855,360 1,324,677 1.5487
15 Aug 2013 16:03:24 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 829,440 1,281,151 1.5446
15 Aug 2013 01:23:00 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 803,520 1,241,597 1.5452
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 777,600 1,201,536 1.5452
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 751,680 1,162,553 1.5466
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 725,760 1,121,515 1.5453
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 699,840 1,080,186 1.5435
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 673,920 1,037,802 1.5399
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 648,000 999,432 1.5423
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 622,080 961,354 1.5454
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 596,160 921,615 1.5459
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 570,240 882,502 1.5476
14 Aug 2013 17:15:05 1104109 15879196 hadcm3n_o2y3_1980_40_008398136_0 544,320 842,710 1.5482


©2024 cpdn.org