Task 16152786

Name	hadcm3n_73qj_1980_40_008416126_3
Workunit	8566982
Created	21 Dec 2013, 15:29:17 UTC
Sent	21 Dec 2013, 15:29:23 UTC
Report deadline	22 Mar 2014, 22:56:34 UTC
Received	2 Jan 2014, 12:57:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1306776
Run time	3 days 4 hours 20 min 53 sec
CPU time	3 days 1 hours 59 min 15 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	3.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> Das Gerät erkennt den Befehl nicht. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 14:52:08 (3064): No heartbeat from core client for 30 sec - exiting 14:52:09 (3064): No heartbeat from core client for 30 sec - exiting 14:52:10 (3064): No heartbeat from core client for 30 sec - exiting 14:52:11 (3064): No heartbeat from core client for 30 sec - exiting 14:52:12 (3064): No heartbeat from core client for 30 sec - exiting 14:52:13 (3064): No heartbeat from core client for 30 sec - exiting 14:52:14 (3064): No heartbeat from core client for 30 sec - exiting 14:52:15 (3064): No heartbeat from core client for 30 sec - exiting 14:52:16 (3064): No heartbeat from core client for 30 sec - exiting 14:52:17 (3064): No heartbeat from core client for 30 sec - exiting 14:52:18 (3064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:10:12 (2856): No heartbeat from core client for 30 sec - exiting 15:10:14 (2856): No heartbeat from core client for 30 sec - exiting 15:10:15 (2856): No heartbeat from core client for 30 sec - exiting 15:10:16 (2856): No heartbeat from core client for 30 sec - exiting 15:10:17 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 13:58:00 (2516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:56:05 (2148): No heartbeat from core client for 30 sec - exiting 14:56:06 (2148): No heartbeat from core client for 30 sec - exiting 14:56:07 (2148): No heartbeat from core client for 30 sec - exiting 14:56:08 (2148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:09 (2148): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:41:56 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:38:56 (2732): No heartbeat from core client for 30 sec - exiting 01:38:57 (2732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:58 (2732): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:05:03 (2652): No heartbeat from core client for 30 sec - exiting 14:05:04 (2652): No heartbeat from core client for 30 sec - exiting 14:05:05 (2652): No heartbeat from core client for 30 sec - exiting 14:05:06 (2652): No heartbeat from core client for 30 sec - exiting 14:05:07 (2652): No heartbeat from core client for 30 sec - exiting 14:05:08 (2652): No heartbeat from core client for 30 sec - exiting 14:05:09 (2652): No heartbeat from core client for 30 sec - exiting 14:05:10 (2652): No heartbeat from core client for 30 sec - exiting 14:05:11 (2652): No heartbeat from core client for 30 sec - exiting 14:05:12 (2652): No heartbeat from core client for 30 sec - exiting 14:05:13 (2652): No heartbeat from core client for 30 sec - exiting 14:05:14 (2652): No heartbeat from core client for 30 sec - exiting 14:05:15 (2652): No heartbeat from core client for 30 sec - exiting 14:05:16 (2652): No heartbeat from core client for 30 sec - exiting 14:05:17 (2652): No heartbeat from core client for 30 sec - exiting 14:05:18 (2652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:05:19 (2652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 18:09:53 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:17:00 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3068, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3068, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3068, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3068, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3068, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3068, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Dec 2013 20:06:08	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	362,880	263,005	0.7248
30 Dec 2013 19:31:44	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	336,960	244,880	0.7267
28 Dec 2013 21:04:59	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	311,040	225,578	0.7252
27 Dec 2013 16:10:23	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	285,120	206,840	0.7254
26 Dec 2013 18:53:17	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	259,200	188,217	0.7261
25 Dec 2013 18:14:42	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	233,280	169,858	0.7281
24 Dec 2013 15:43:09	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	207,360	151,569	0.7309
23 Dec 2013 23:41:23	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	181,440	132,707	0.7314
23 Dec 2013 18:09:17	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	155,520	113,550	0.7301
23 Dec 2013 12:42:06	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	129,600	94,535	0.7294
22 Dec 2013 21:13:04	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	103,680	75,532	0.7285
22 Dec 2013 15:37:03	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	77,760	56,221	0.7230
22 Dec 2013 10:09:47	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	51,840	37,232	0.7182
21 Dec 2013 20:56:35	1306776	16152786	hadcm3n_73qj_1980_40_008416126_3	25,920	18,448	0.7117