Task 14020962

Name	hadcm3n_t6m0_1940_40_007742599_2
Workunit	7897707
Created	27 Jan 2012, 21:25:49 UTC
Sent	27 Jan 2012, 21:34:22 UTC
Report deadline	28 Apr 2012, 5:01:33 UTC
Received	27 Feb 2012, 16:30:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1151800
Run time	7 days 7 hours 47 min 47 sec
CPU time	5 days 1 hours 20 min 42 sec
Validate state	Invalid
Credit	1,866.24
Device peak FLOPS	2.57 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:01:06 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:37:31 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:27 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:45 (4776): No heartbeat from core client for 30 sec - exiting 11:37:46 (4776): No heartbeat from core client for 30 sec - exiting 11:37:47 (4776): No heartbeat from core client for 30 sec - exiting 11:37:48 (4776): No heartbeat from core client for 30 sec - exiting 11:37:50 (4776): No heartbeat from core client for 30 sec - exiting 11:37:51 (4776): No heartbeat from core client for 30 sec - exiting 11:37:52 (4776): No heartbeat from core client for 30 sec - exiting 11:37:53 (4776): No heartbeat from core client for 30 sec - exiting 11:37:54 (4776): No heartbeat from core client for 30 sec - exiting 11:37:55 (4776): No heartbeat from core client for 30 sec - exiting 11:37:56 (4776): No heartbeat from core client for 30 sec - exiting 11:37:57 (4776): No heartbeat from core client for 30 sec - exiting 11:37:58 (4776): No heartbeat from core client for 30 sec - exiting 11:37:59 (4776): No heartbeat from core client for 30 sec - exiting 11:38:01 (4776): No heartbeat from core client for 30 sec - exiting 11:38:02 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:44:40 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:07:50 (472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:25 (1588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:14 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:15 (5544): No heartbeat from core client for 30 sec - exiting 12:26:54 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:56 (4836):13:11:44 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:27 (1080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:02:24 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:02:54 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:27:31 (2556): No heartbeat from core client for 30 sec - exiting 13:27:32 (2556): No heartbeat from core client for 30 sec - exiting 13:27:33 (2556): No heartbeat from core client for 30 sec - exiting 13:27:34 (2556): No heartbeat from core client for 30 sec - exiting 13:27:35 (2556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:36 (2556): No heartbeat from core client for 30 sec - exiting 18:47:47 (860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:24:10 (2408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:20:52 (552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15072, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15072, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15072, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15072, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15072, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15072, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Feb 2012 15:25:55	1151800	14020962	hadcm3n_t6m0_1940_40_007742599_2	155,520	434,737	2.7954
20 Feb 2012 15:07:22	1151800	14020962	hadcm3n_t6m0_1940_40_007742599_2	129,600	357,995	2.7623
18 Feb 2012 14:52:24	1151800	14020962	hadcm3n_t6m0_1940_40_007742599_2	103,680	277,795	2.6793
16 Feb 2012 09:09:24	1151800	14020962	hadcm3n_t6m0_1940_40_007742599_2	77,760	193,700	2.4910
13 Feb 2012 11:00:26	1151800	14020962	hadcm3n_t6m0_1940_40_007742599_2	51,840	126,457	2.4394
11 Feb 2012 20:44:13	1151800	14020962	hadcm3n_t6m0_1940_40_007742599_2	25,920	62,854	2.4249