Task 17358839

Name	hadcm3n_xd4w_1940_40_009153318_2
Workunit	9283654
Created	6 Nov 2014, 18:54:14 UTC
Sent	6 Nov 2014, 19:00:51 UTC
Report deadline	6 Feb 2015, 2:28:02 UTC
Received	19 Nov 2014, 20:53:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1308965
Run time	12 days 19 hours 49 min 37 sec
CPU time	12 days 4 hours 37 min 38 sec
Validate state	Invalid
Credit	10,886.40
Device peak FLOPS	3.58 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:16:14 (8212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:27:55 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:28:31 (6124): No heartbeat from core client for 30 sec - exiting 16:29:12 (6124): No heartbeat from core client for 30 sec - exiting 16:29:13 (6124): No heartbeat from core client for 30 sec - exiting 16:29:14 (6124): No heartbeat from core client for 30 sec - exiting 16:29:15 (6124): No heartbeat from core client for 30 sec - exiting 16:29:16 (6124): No heartbeat from core client for 30 sec - exiting 16:29:17 (6124): No heartbeat from core client for 30 sec - exiting 16:29:18 (6124): No heartbeat from core client for 30 sec - exiting 16:29:19 (6124): No heartbeat from core client for 30 sec - exiting 16:29:20 (6124): No heartbeat from core client for 30 sec - exiting 16:29:21 (6124): No heartbeat from core client for 30 sec - exiting 16:29:22 (6124): No heartbeat from core client for 30 sec - exiting 16:29:23 (6124): No heartbeat from core client for 30 sec - exiting 16:29:24 (6124): No heartbeat from core client for 30 sec - exiting 16:29:25 (6124): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:28:09 (7496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:28:40 (7496): No heartbeat from core client for 30 sec - exiting 16:29:21 (7496): No heartbeat from core client for 30 sec - exiting 16:29:22 (7496): No heartbeat from core client for 30 sec - exiting 16:29:23 (7496): No heartbeat from core client for 30 sec - exiting 16:29:24 (7496): No heartbeat from core client for 30 sec - exiting 16:29:25 (7496): No heartbeat from core client for 30 sec - exiting 16:29:26 (7496): No heartbeat from core client for 30 sec - exiting 16:29:27 (7496): No heartbeat from core client for 30 sec - exiting 16:29:28 (7496): No heartbeat from core client for 30 sec - exiting 16:29:29 (7496): No heartbeat from core client for 30 sec - exiting 16:29:30 (7496): No heartbeat from core client for 30 sec - exiting 16:29:31 (7496): No heartbeat from core client for 30 sec - exiting 16:29:32 (7496): No heartbeat from core client for 30 sec - exiting 16:29:33 (7496): No heartbeat from core client for 30 sec - exiting 16:29:34 (7496): No heartbeat from core client for 30 sec - exiting 16:29:35 (7496): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12444, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12444, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12444, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12444, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12444, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Nov 2014 13:58:58	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	907,200	1,041,888	1.1485
19 Nov 2014 05:08:08	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	881,280	1,011,007	1.1472
18 Nov 2014 19:33:05	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	855,360	979,428	1.1450
18 Nov 2014 11:21:09	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	829,440	948,145	1.1431
18 Nov 2014 02:38:02	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	803,520	917,483	1.1418
17 Nov 2014 17:54:49	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	777,600	886,969	1.1406
17 Nov 2014 08:50:03	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	751,680	855,893	1.1386
16 Nov 2014 23:46:18	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	725,760	825,028	1.1368
16 Nov 2014 14:57:34	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	699,840	793,824	1.1343
16 Nov 2014 05:58:19	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	673,920	763,498	1.1329
15 Nov 2014 21:30:26	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	648,000	734,408	1.1333
15 Nov 2014 12:36:51	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	622,080	705,587	1.1342
15 Nov 2014 03:53:48	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	596,160	675,560	1.1332
14 Nov 2014 19:51:55	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	570,240	645,225	1.1315
14 Nov 2014 09:48:36	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	544,320	613,912	1.1279
14 Nov 2014 00:23:41	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	518,400	582,285	1.1232
13 Nov 2014 15:09:22	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	492,480	551,290	1.1194
13 Nov 2014 06:16:48	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	466,560	521,486	1.1177
12 Nov 2014 21:25:38	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	440,640	491,444	1.1153
12 Nov 2014 11:59:02	1308965	17358839	hadcm3n_xd4w_1940_40_009153318_2	414,720	460,743	1.1110