Task 15844929

Name	hadcm3n_3epn_1980_40_008363999_4
Workunit	8514858
Created	16 Jun 2013, 13:58:39 UTC
Sent	16 Jun 2013, 14:10:48 UTC
Report deadline	15 Sep 2013, 21:37:59 UTC
Received	14 Sep 2013, 8:21:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1282453
Run time	5 days 1 hours 18 min 12 sec
CPU time	4 days 22 hours 17 min 36 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	2.72 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:01:26 (3308): No heartbeat from core client for 30 sec - exiting 19:01:27 (3308): No heartbeat from core client for 30 sec - exiting 19:01:28 (3308): No heartbeat from core client for 30 sec - exiting 19:01:29 (3308): No heartbeat from core client for 30 sec - exiting 19:01:30 (3308): No heartbeat from core client for 30 sec - exiting 19:01:31 (3308): No heartbeat from core client for 30 sec - exiting 19:01:32 (3308): No heartbeat from core client for 30 sec - exiting 19:01:33 (3308): No heartbeat from core client for 30 sec - exiting 19:01:34 (3308): No heartbeat from core client for 30 sec - exiting 19:01:35 (3308): No heartbeat from core client for 30 sec - exiting 19:01:36 (3308): No heartbeat from core client for 30 sec - exiting 19:01:37 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 08:23:28 (3228): No heartbeat from core client for 30 sec - exiting 08:23:29 (3228): No heartbeat from core client for 30 sec - exiting 08:23:30 (3228): No heartbeat from core client for 30 sec - exiting 08:23:31 (3228): No heartbeat from core client for 30 sec - exiting 08:23:32 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:53:28 (4640): No heartbeat from core client for 30 sec - exiting 16:53:29 (4640): No heartbeat from core client for 30 sec - exiting 16:53:30 (4640): No heartbeat from core client for 30 sec - exiting 16:53:31 (4640): No heartbeat from core client for 30 sec - exiting 16:53:32 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3304, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3076, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3076, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2364, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2364, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 22:04:53	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	285,120	397,009	1.3924
23 Jul 2013 21:43:08	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	259,200	359,317	1.3863
23 Jul 2013 20:20:49	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	233,280	323,901	1.3885
23 Jul 2013 20:20:49	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	207,360	288,174	1.3897
23 Jul 2013 20:20:49	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	181,440	250,346	1.3798
11 Jul 2013 09:01:14	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	155,520	214,180	1.3772
09 Jul 2013 11:58:25	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	129,600	179,499	1.3850
07 Jul 2013 14:17:10	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	103,680	143,547	1.3845
04 Jul 2013 15:25:08	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	77,760	106,900	1.3747
03 Jul 2013 12:52:23	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	51,840	71,511	1.3795
02 Jul 2013 13:04:09	1282453	15844929	hadcm3n_3epn_1980_40_008363999_4	25,920	35,938	1.3865