Task 15287416

Name	hadcm3n_zh5i_1880_40_008199685_3
Workunit	8354809
Created	15 Sep 2012, 10:24:49 UTC
Sent	15 Sep 2012, 10:36:29 UTC
Report deadline	15 Dec 2012, 18:03:40 UTC
Received	19 Oct 2012, 8:21:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1217816
Run time	7 days 7 hours 38 min 21 sec
CPU time	7 days 6 hours 12 min 37 sec
Validate state	Invalid
Credit	7,464.96
Device peak FLOPS	3.37 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> 03:05:20 (1856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:23 (3464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:24 (3464): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/zh5iko.pj82c10 Error converting file to netcdf: dataout/zh5iko.pi82c10 Error converting file to netcdf: dataout/zh5iko.pf82c10 Error converting file to netcdf: dataout/zh5ika.ph82c10 Error converting file to netcdf: dataout/zh5ika.pg82c10 Error converting file to netcdf: dataout/zh5ika.pe82c10 Error converting file to netcdf: dataout/zh5ika.pd82c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6808, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:42:12 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5540, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:19:58 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5772, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4116, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:45:58 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5972, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Oct 2012 21:14:25	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	622,080	619,168	0.9953
16 Oct 2012 09:54:49	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	596,160	593,760	0.9960
15 Oct 2012 06:45:22	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	570,240	568,681	0.9973
05 Oct 2012 04:51:39	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	544,320	542,912	0.9974
02 Oct 2012 08:16:57	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	518,400	516,905	0.9971
01 Oct 2012 08:20:19	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	492,480	491,468	0.9979
01 Oct 2012 00:13:33	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	466,560	465,056	0.9968
29 Sep 2012 02:44:34	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	440,640	439,645	0.9977
28 Sep 2012 01:29:36	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	414,720	414,043	0.9984
27 Sep 2012 01:57:31	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	388,800	388,578	0.9994
26 Sep 2012 09:38:03	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	362,880	362,711	0.9995
25 Sep 2012 22:09:50	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	336,960	337,068	1.0003
25 Sep 2012 04:57:09	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	311,040	311,187	1.0005
24 Sep 2012 21:50:17	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	285,120	285,590	1.0016
24 Sep 2012 07:09:33	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	259,200	259,977	1.0030
23 Sep 2012 23:52:53	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	233,280	233,857	1.0025
23 Sep 2012 04:50:19	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	207,360	208,321	1.0046
22 Sep 2012 11:58:33	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	181,440	182,721	1.0071
20 Sep 2012 12:52:39	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	155,520	156,931	1.0091
20 Sep 2012 06:11:07	1217816	15287416	hadcm3n_zh5i_1880_40_008199685_3	129,600	131,495	1.0146