Task 16037332

Name	hadcm3n_o8wy_1900_40_008466677_0
Workunit	8617516
Created	27 Sep 2013, 9:25:25 UTC
Sent	7 Oct 2013, 18:46:19 UTC
Report deadline	7 Jan 2014, 2:13:30 UTC
Received	25 Nov 2013, 15:48:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1042901
Run time	17 days 4 hours 4 min 27 sec
CPU time	15 days 18 hours 16 min 8 sec
Validate state	Invalid
Credit	12,130.56
Device peak FLOPS	2.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.28</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5768, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:28:20 (1252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:21 (1252): No heartbeat from core client for 30 sec - exiting 09:28:22 (1252): No heartbeat from core client for 30 sec - exiting 09:28:23 (1252): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:48:38 (2184): No heartbeat from core client for 30 sec - exiting 13:48:39 (2184): No heartbeat from core client for 30 sec - exiting 13:48:40 (2184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o8wyko.pjd1c10 Error converting file to netcdf: dataout/o8wyko.pid1c10 Error converting file to netcdf: dataout/o8wyko.pfd1c10 Error converting file to netcdf: dataout/o8wyka.phd1c10 Error converting file to netcdf: dataout/o8wyka.pgd1c10 Error converting file to netcdf: dataout/o8wyka.ped1c10 Error converting file to netcdf: dataout/o8wyka.pdd1c10 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3928, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5472, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 10:54:43 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:44 (5388): No heartbeat from core client for 30 sec - exiting 10:54:45 (5388): No heartbeat from core client for 30 sec - exiting 10:54:46 (5388): No heartbeat from core client for 30 sec - exiting 10:54:47 (5388): No heartbeat from core client for 30 sec - exiting 10:54:48 (5388): No heartbeat from core client for 30 sec - exiting 10:54:49 (5388): No heartbeat from core client for 30 sec - exiting 10:54:50 (5388): No heartbeat from core client for 30 sec - exiting 10:54:51 (5388): No heartbeat from core client for 30 sec - exiting 12:05:49 (6788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:50 (6788): No heartbeat from core client for 30 sec - exiting 12:05:51 (6788): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:57:39 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5688, iMonCtr=1 Model crash detected, will try to restart... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Nov 2013 16:48:04	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	1,010,880	1,333,935	1.3196
24 Nov 2013 00:09:34	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	984,960	1,300,124	1.3200
23 Nov 2013 00:55:31	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	959,040	1,266,524	1.3206
21 Nov 2013 19:51:07	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	933,120	1,232,478	1.3208
20 Nov 2013 15:27:27	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	907,200	1,198,786	1.3214
19 Nov 2013 17:46:46	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	881,280	1,164,229	1.3211
18 Nov 2013 00:52:49	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	855,360	1,129,993	1.3211
17 Nov 2013 00:37:05	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	829,440	1,095,989	1.3214
15 Nov 2013 18:51:41	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	803,520	1,061,946	1.3216
14 Nov 2013 17:31:54	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	777,600	1,027,570	1.3215
13 Nov 2013 02:09:49	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	751,680	992,992	1.3210
12 Nov 2013 01:05:02	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	725,760	959,401	1.3219
11 Nov 2013 14:51:58	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	699,840	925,350	1.3222
10 Nov 2013 02:11:19	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	673,920	891,343	1.3226
09 Nov 2013 16:03:20	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	648,000	857,559	1.3234
08 Nov 2013 15:55:14	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	622,080	823,627	1.3240
07 Nov 2013 15:26:03	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	596,160	789,724	1.3247
06 Nov 2013 18:51:25	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	570,240	755,904	1.3256
05 Nov 2013 19:23:01	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	544,320	721,560	1.3256
03 Nov 2013 22:10:16	1042901	16037332	hadcm3n_o8wy_1900_40_008466677_0	518,400	687,027	1.3253