Task 15849942

Name	hadcm3n_z8e3_1960_40_008319991_4
Workunit	8471126
Created	19 Jun 2013, 12:39:58 UTC
Sent	19 Jun 2013, 15:06:23 UTC
Report deadline	18 Sep 2013, 22:33:34 UTC
Received	14 Aug 2013, 16:48:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1284565
Run time	28 days 7 hours 23 min 14 sec
CPU time	23 days 2 hours 8 min
Validate state	Invalid
Credit	9,953.28
Device peak FLOPS	1.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=108728, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=46844, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:23:16 (20080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:23:18 (20080): No heartbeat from core client for 30 sec - exiting 17:23:19 (20080): No heartbeat from core client for 30 sec - exiting 17:23:20 (20080): No heartbeat from core client for 30 sec - exiting 17:23:21 (20080): No heartbeat from core client for 30 sec - exiting 17:23:22 (20080): No heartbeat from core client for 30 sec - exiting 17:23:23 (20080): No heartbeat from core client for 30 sec - exiting 17:23:24 (20080): No heartbeat from core client for 30 sec - exiting 17:23:25 (20080): No heartbeat from core client for 30 sec - exiting 17:23:26 (20080): No heartbeat from core client for 30 sec - exiting 17:23:27 (20080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:07:56 (35672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:57 (35672): No heartbeat from core client for 30 sec - exiting 04:07:58 (35672): No heartbeat from core client for 30 sec - exiting 04:07:59 (35672): No heartbeat from core client for 30 sec - exiting 04:08:00 (35672): No heartbeat from core client for 30 sec - exiting 04:08:01 (35672): No heartbeat from core client for 30 sec - exiting 04:08:02 (35672): No heartbeat from core client for 30 sec - exiting 04:08:03 (35672): No heartbeat from core client for 30 sec - exiting 04:08:04 (35672): No heartbeat from core client for 30 sec - exiting 04:08:06 (35672): No heartbeat from core client for 30 sec - exiting 04:08:07 (35672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/z8e3ko.pji3c10 Error converting file to netcdf: dataout/z8e3ko.pii3c10 Error converting file to netcdf: dataout/z8e3ko.pfi3c10 Error converting file to netcdf: dataout/z8e3ka.phi3c10 Error converting file to netcdf: dataout/z8e3ka.pgi3c10 Error converting file to netcdf: dataout/z8e3ka.pei3c10 Error converting file to netcdf: dataout/z8e3ka.pdi3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jul 2013 10:23:09	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	829,440	1,965,871	2.3701
30 Jul 2013 10:23:09	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	803,520	1,904,383	2.3701
30 Jul 2013 10:23:08	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	777,600	1,843,395	2.3706
25 Jul 2013 21:57:48	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	751,680	1,783,912	2.3732
25 Jul 2013 02:22:02	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	725,760	1,725,389	2.3774
24 Jul 2013 05:23:31	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	699,840	1,664,935	2.3790
23 Jul 2013 21:30:47	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	673,920	1,603,769	2.3798
23 Jul 2013 20:49:06	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	648,000	1,541,282	2.3785
23 Jul 2013 19:47:52	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	622,080	1,474,823	2.3708
23 Jul 2013 15:04:25	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	596,160	1,415,697	2.3747
23 Jul 2013 15:04:25	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	570,240	1,355,627	2.3773
23 Jul 2013 15:04:25	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	544,320	1,295,046	2.3792
23 Jul 2013 15:04:25	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	518,400	1,226,408	2.3658
11 Jul 2013 18:41:41	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	492,480	1,163,787	2.3631
09 Jul 2013 20:46:59	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	466,560	1,102,916	2.3639
08 Jul 2013 19:42:13	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	440,640	1,042,105	2.3650
06 Jul 2013 18:57:33	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	414,720	980,967	2.3654
06 Jul 2013 04:52:17	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	388,800	917,762	2.3605
04 Jul 2013 14:24:59	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	362,880	856,688	2.3608
03 Jul 2013 15:54:02	1284565	15849942	hadcm3n_z8e3_1960_40_008319991_4	336,960	797,377	2.3664