Task 15549878

Name	hadcm3n_n2af_1880_40_008286830_0
Workunit	8437965
Created	17 Jan 2013, 21:45:56 UTC
Sent	17 Jan 2013, 21:46:05 UTC
Report deadline	19 Apr 2013, 5:13:16 UTC
Received	21 Feb 2013, 8:40:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1084861
Run time	5 days 21 hours 28 min 39 sec
CPU time	4 days 16 hours 22 min 35 sec
Validate state	Invalid
Credit	2,177.28
Device peak FLOPS	3.04 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:39:31 (4176): No heartbeat from core client for 30 sec - exiting 04:39:32 (4176): No heartbeat from core client for 30 sec - exiting 04:39:33 (4176): No heartbeat from core client for 30 sec - exiting 04:39:34 (4176): No heartbeat from core client for 30 sec - exiting 04:39:36 (4176): No heartbeat from core client for 30 sec - exiting 04:39:37 (4176): No heartbeat from core client for 30 sec - exiting 04:39:38 (4176): No heartbeat from core client for 30 sec - exiting 04:39:39 (4176): No heartbeat from core client for 30 sec - exiting 04:39:40 (4176): No heartbeat from core client for 30 sec - exiting 04:39:41 (4176): No heartbeat from core client for 30 sec - exiting 04:39:42 (4176): No heartbeat from core client for 30 sec - exiting 04:39:43 (4176): No heartbeat from core client for 30 sec - exiting 04:39:44 (4176): No heartbeat from core client for 30 sec - exiting 04:39:45 (4176): No heartbeat from core client for 30 sec - exiting 04:39:46 (4176): No heartbeat from core client for 30 sec - exiting 04:39:48 (4176): No heartbeat from core client for 30 sec - exiting 04:39:49 (4176): No heartbeat from core client for 30 sec - exiting 04:39:50 (4176): No heartbeat from core client for 30 sec - exiting 04:39:51 (4176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:19 (1428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:59 (5192): No heartbeat from core client for 30 sec - exiting 04:42:00 (5192): No heartbeat from core client for 30 sec - exiting 04:42:01 (5192): No heartbeat from core client for 30 sec - exiting 04:42:03 (5192): No heartbeat from core client for 30 sec - exiting 04:42:04 (5192): No heartbeat from core client for 30 sec - exiting 04:42:05 (5192): No heartbeat from core client for 30 sec - exiting 04:42:06 (5192): No heartbeat from core client for 30 sec - exiting 04:42:07 (5192): No heartbeat from core client for 30 sec - exiting 04:42:08 (5192): No heartbeat from core client for 30 sec - exiting 04:42:09 (5192): No heartbeat from core client for 30 sec - exiting 04:42:10 (5192): No heartbeat from core client for 30 sec - exiting 04:42:11 (5192): No heartbeat from core client for 30 sec - exiting 04:42:12 (5192): No heartbeat from core client for 30 sec - exiting 04:42:14 (5192): No heartbeat from core client for 30 sec - exiting 04:42:15 (5192): No heartbeat from core client for 30 sec - exiting 04:42:16 (5192): No heartbeat from core client for 30 sec - exiting 04:42:17 (5192): No heartbeat from core client for 30 sec - exiting 04:42:18 (5192): No heartbeat from core client for 30 sec - exiting 04:42:19 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:45:07 (7028): No heartbeat from core client for 30 sec - exiting 05:45:08 (7028): No heartbeat from core client for 30 sec - exiting 05:45:09 (7028): No heartbeat from core client for 30 sec - exiting 05:45:10 (7028): No heartbeat from core client for 30 sec - exiting 05:45:11 (7028): No heartbeat from core client for 30 sec - exiting 05:45:12 (7028): No heartbeat from core client for 30 sec - exiting 05:45:13 (7028): No heartbeat from core client for 30 sec - exiting 05:45:15 (7028): No heartbeat from core client for 30 sec - exiting 05:45:16 (7028): No heartbeat from core client for 30 sec - exiting 05:45:17 (7028): No heartbeat from core client for 30 sec - exiting 05:45:18 (7028): No heartbeat from core client for 30 sec - exiting 05:45:19 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:42:57 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6928, selfPID=6928, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:39:40 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:49:21 (6060): No heartbeat from core client for 30 sec - exiting 17:49:22 (6060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:09:32 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:14:06 (1432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Feb 2013 21:16:29	1084861	15549878	hadcm3n_n2af_1880_40_008286830_0	181,440	399,270	2.2006
19 Feb 2013 18:13:13	1084861	15549878	hadcm3n_n2af_1880_40_008286830_0	155,520	352,219	2.2648
18 Feb 2013 17:21:13	1084861	15549878	hadcm3n_n2af_1880_40_008286830_0	129,600	292,940	2.2603
17 Feb 2013 22:25:51	1084861	15549878	hadcm3n_n2af_1880_40_008286830_0	103,680	237,562	2.2913
17 Feb 2013 02:35:46	1084861	15549878	hadcm3n_n2af_1880_40_008286830_0	77,760	179,687	2.3108
16 Feb 2013 04:33:04	1084861	15549878	hadcm3n_n2af_1880_40_008286830_0	51,840	129,152	2.4914
14 Feb 2013 11:46:21	1084861	15549878	hadcm3n_n2af_1880_40_008286830_0	25,920	65,168	2.5142