Task 15461917

Name	hadcm3n_zmeo_1880_40_008253749_1
Workunit	8408873
Created	26 Nov 2012, 12:27:24 UTC
Sent	26 Nov 2012, 12:29:47 UTC
Report deadline	25 Feb 2013, 19:56:58 UTC
Received	31 Dec 2012, 16:52:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1228333
Run time	18 days 4 hours 38 min 32 sec
CPU time	17 days 0 hours 6 min 31 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	2.81 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:04:17 (8088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:38 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:19 (9160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:24 (9160): No heartbeat from core client for 30 sec - exiting 01:05:25 (9160): No heartbeat from core client for 30 sec - exiting 01:05:26 (9160): No heartbeat from core client for 30 sec - exiting 01:05:27 (9160): No heartbeat from core client for 30 sec - exiting 01:25:06 (13732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:39 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:44:58 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:18 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:17 (11056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:15:30 (11616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:32 (13664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:17:04 (10120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:19:29 (11196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:23:32 (7292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:25 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:07 (9000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:06:48 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:15 (13512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:06 (12140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:41:01 (13096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:44:09 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:17 (9456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:00:20 (14360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:37 (9744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:56 (14504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:27 (8524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:30:15 (11496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14156, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14156, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14156, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14156, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14156, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14156, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Dec 2012 13:55:33	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	466,560	1,458,396	3.1258
30 Dec 2012 08:29:22	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	440,640	1,414,306	3.2097
30 Dec 2012 08:29:22	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	414,720	1,370,856	3.3055
30 Dec 2012 08:29:22	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	388,800	1,274,623	3.2784
30 Dec 2012 08:29:22	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	362,880	1,158,448	3.1924
30 Dec 2012 08:29:22	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	336,960	1,040,306	3.0873
07 Dec 2012 20:53:01	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	311,040	948,555	3.0496
06 Dec 2012 17:52:48	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	285,120	854,001	2.9952
05 Dec 2012 16:31:06	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	259,200	761,972	2.9397
04 Dec 2012 16:03:50	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	233,280	676,783	2.9012
03 Dec 2012 15:50:55	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	207,360	590,624	2.8483
02 Dec 2012 13:29:29	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	181,440	496,597	2.7370
01 Dec 2012 16:43:00	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	155,520	423,928	2.7259
30 Nov 2012 20:42:46	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	129,600	352,970	2.7235
30 Nov 2012 00:29:54	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	103,680	280,848	2.7088
29 Nov 2012 03:56:33	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	77,760	208,295	2.6787
28 Nov 2012 08:56:51	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	51,840	142,293	2.7448
27 Nov 2012 11:04:07	1228333	15461917	hadcm3n_zmeo_1880_40_008253749_1	25,920	64,763	2.4986