Task 15764587

Name	hadcm3n_3dqg_1940_40_008258247_2
Workunit	8413371
Created	7 May 2013, 1:23:40 UTC
Sent	7 May 2013, 1:23:45 UTC
Report deadline	6 Aug 2013, 8:50:56 UTC
Received	16 May 2013, 21:21:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1262409
Run time	8 days 14 hours 26 min 9 sec
CPU time	6 days 15 hours 23 min 10 sec
Validate state	Invalid
Credit	10,886.40
Device peak FLOPS	4.07 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 03:24:19 (8324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:20 (8324): No heartbeat from core client for 30 sec - exiting 03:24:21 (8324): No heartbeat from core client for 30 sec - exiting 03:24:22 (8324): No heartbeat from core client for 30 sec - exiting 03:24:23 (8324): No heartbeat from core client for 30 sec - exiting 03:24:24 (8324): No heartbeat from core client for 30 sec - exiting 03:24:25 (8324): No heartbeat from core client for 30 sec - exiting 03:24:26 (8324): No heartbeat from core client for 30 sec - exiting 03:24:27 (8324): No heartbeat from core client for 30 sec - exiting 03:24:28 (8324): No heartbeat from core client for 30 sec - exiting 03:24:29 (8324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:12:15 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:16 (2656): No heartbeat from core client for 30 sec - exiting 03:12:17 (2656): No heartbeat from core client for 30 sec - exiting 03:12:18 (2656): No heartbeat from core client for 30 sec - exiting 03:12:19 (2656): No heartbeat from core client for 30 sec - exiting 03:12:20 (2656): No heartbeat from core client for 30 sec - exiting 03:12:21 (2656): No heartbeat from core client for 30 sec - exiting 03:12:22 (2656): No heartbeat from core client for 30 sec - exiting 03:12:23 (2656): No heartbeat from core client for 30 sec - exiting 03:12:24 (2656): No heartbeat from core client for 30 sec - exiting 03:12:25 (2656): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 09:37:06 (14232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:46:47 (14232): No heartbeat from core client for 30 sec - exiting 09:55:37 (8664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 May 2013 09:22:30	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	907,200	563,735	0.6214
16 May 2013 03:20:15	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	881,280	547,131	0.6208
15 May 2013 21:32:29	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	855,360	530,479	0.6202
15 May 2013 15:58:10	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	829,440	514,302	0.6201
15 May 2013 11:21:25	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	803,520	498,263	0.6201
15 May 2013 04:54:10	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	777,600	481,897	0.6197
14 May 2013 21:20:50	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	751,680	465,502	0.6193
14 May 2013 17:37:47	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	725,760	449,068	0.6188
14 May 2013 10:09:15	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	699,840	432,932	0.6186
14 May 2013 05:27:29	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	673,920	416,783	0.6184
13 May 2013 22:24:20	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	648,000	400,099	0.6174
13 May 2013 14:27:09	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	622,080	383,101	0.6158
13 May 2013 08:48:44	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	596,160	366,639	0.6150
13 May 2013 03:00:22	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	570,240	350,218	0.6142
12 May 2013 20:06:45	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	544,320	333,441	0.6126
12 May 2013 13:37:44	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	518,400	316,531	0.6106
12 May 2013 07:45:41	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	492,480	299,994	0.6091
11 May 2013 13:04:44	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	466,560	283,738	0.6081
11 May 2013 07:27:40	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	440,640	267,498	0.6071
10 May 2013 19:27:49	1262409	15764587	hadcm3n_3dqg_1940_40_008258247_2	414,720	251,273	0.6059