Task 13363379

Name	hadcm3n_t2sb_1940_40_007449336_0
Workunit	7646839
Created	9 Sep 2011, 23:52:41 UTC
Sent	14 Sep 2011, 9:03:31 UTC
Report deadline	14 Dec 2011, 16:30:42 UTC
Received	17 Oct 2011, 14:33:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1092502
Run time	23 days 15 hours 23 min 7 sec
CPU time	23 days 2 hours 59 min 44 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	0.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:28:37 (8520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:39 (8520): No heartbeat from core client for 30 sec - exiting 18:28:40 (8520): No heartbeat from core client for 30 sec - exiting 18:28:41 (8520): No heartbeat from core client for 30 sec - exiting 18:28:42 (8520): No heartbeat from core client for 30 sec - exiting 18:28:43 (8520): No heartbeat from core client for 30 sec - exiting 18:28:45 (8520): No heartbeat from core client for 30 sec - exiting 18:28:46 (8520): No heartbeat from core client for 30 sec - exiting 18:28:47 (8520): No heartbeat from core client for 30 sec - exiting 18:28:48 (8520): No heartbeat from core client for 30 sec - exiting 02:30:55 (9516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:30:56 (9516): No heartbeat from core client for 30 sec - exiting 02:30:57 (9516): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:35:24 (656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:35:25 (656): No heartbeat from core client for 30 sec - exiting CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:59:05 (2724): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:59:06 (2724): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=524, iMonCtr=1 Model crash detected, will try to restart... 12:34:06 (3824): No heartbeat from core client for 30 sec - exiting 12:34:07 (3824): No heartbeat from core client for 30 sec - exiting 12:34:08 (3824): No heartbeat from core client for 30 sec - exiting 12:34:09 (3824): No heartbeat from core client for 30 sec - exiting 12:34:10 (3824): No heartbeat from core client for 30 sec - exiting 12:34:11 (3824): No heartbeat from core client for 30 sec - exiting 12:34:12 (3824): No heartbeat from core client for 30 sec - exiting 12:34:13 (3824): No heartbeat from core client for 30 sec - exiting 12:34:14 (3824): No heartbeat from core client for 30 sec - exiting 12:34:16 (3824): No heartbeat from core client for 30 sec - exiting 12:34:17 (3824): No heartbeat from core client for 30 sec - exiting 12:34:18 (3824): No heartbeat from core client for 30 sec - exiting 12:34:19 (3824): No heartbeat from core client for 30 sec - exiting 12:34:20 (3824): No heartbeat from core client for 30 sec - exiting 12:34:21 (3824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:18 (748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:38 (1248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:30:23 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:30:28 (5084): No heartbeat from core client for 30 sec - exiting 17:30:29 (5084): No heartbeat from core client for 30 sec - exiting 17:30:31 (5084): No heartbeat from core client for 30 sec - exiting 17:30:32 (5084): No heartbeat from core client for 30 sec - exiting 17:30:33 (5084): No heartbeat from core client for 30 sec - exiting 17:30:34 (5084): No heartbeat from core client for 30 sec - exiting 17:30:35 (5084): No heartbeat from core client for 30 sec - exiting 17:30:36 (5084): No heartbeat from core client for 30 sec - exiting 17:30:37 (5084): No heartbeat from core client for 30 sec - exiting 17:30:38 (5084): No heartbeat from core client for 30 sec - exiting 17:30:40 (5084): No heartbeat from core client for 30 sec - exiting 17:32:15 (4208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:57:40 (6668): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:57:42 (6668): No heartbeat from core client for 30 sec - exiting 20:57:43 (6668): No heartbeat from core client for 30 sec - exiting 20:57:44 (6668): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:53:15 (4800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:53:17 (4800): No heartbeat from core client for 30 sec - exiting 04:53:18 (4800): No heartbeat from core client for 30 sec - exiting 04:53:19 (4800): No heartbeat from core client for 30 sec - exiting 05:17:19 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7184, iMonCtr=1 Model crash detected, will try to restart... 12:28:31 (1832): No heartbeat from core client for 30 sec - exiting 12:28:32 (1832): No heartbeat from core client for 30 sec - exiting 12:28:33 (1832): No heartbeat from core client for 30 sec - exiting 12:28:34 (1832): No heartbeat from core client for 30 sec - exiting 12:28:35 (1832): No heartbeat from core client for 30 sec - exiting 12:28:36 (1832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Oct 2011 03:53:22	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	440,640	1,968,067	4.4664
12 Oct 2011 03:25:21	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	414,720	1,807,864	4.3592
09 Oct 2011 15:53:20	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	388,800	1,635,305	4.2060
07 Oct 2011 10:42:52	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	362,880	1,448,901	3.9928
06 Oct 2011 01:46:22	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	336,960	1,336,301	3.9658
05 Oct 2011 03:09:15	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	311,040	1,255,092	4.0351
04 Oct 2011 05:18:24	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	285,120	1,176,985	4.1280
03 Oct 2011 08:23:12	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	259,200	1,101,971	4.2514
30 Sep 2011 00:28:10	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	233,280	1,020,584	4.3749
29 Sep 2011 03:23:36	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	207,360	944,948	4.5570
28 Sep 2011 01:23:51	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	181,440	854,588	4.7100
26 Sep 2011 04:32:10	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	155,520	722,306	4.6445
24 Sep 2011 08:41:24	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	129,600	607,891	4.6905
22 Sep 2011 19:11:41	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	103,680	497,535	4.7988
21 Sep 2011 10:27:40	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	77,760	380,871	4.8980
20 Sep 2011 12:20:29	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	51,840	305,141	5.8862
19 Sep 2011 06:16:17	1092502	13363379	hadcm3n_t2sb_1940_40_007449336_0	25,920	202,867	7.8267