Task 15495829

Name	hadcm3n_387a_1940_40_008266423_0
Workunit	8421547
Created	21 Dec 2012, 16:09:59 UTC
Sent	22 Dec 2012, 14:00:27 UTC
Report deadline	23 Mar 2013, 21:27:38 UTC
Received	28 Dec 2012, 14:25:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1252237
Run time	1 days 20 hours 52 min 1 sec
CPU time	1 days 18 hours 20 min 33 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4048, selfPID=4048, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3388, selfPID=3388, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4804, selfPID=4804, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2948, selfPID=2948, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2796, selfPID=2796, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4124, selfPID=4124, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1312, selfPID=1312, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4024, selfPID=4024, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=872, selfPID=872, iMonCtr=1 19:03:15 (5940): No heartbeat from core client for 30 sec - exiting 19:03:16 (5940): No heartbeat from core client for 30 sec - exiting 19:03:17 (5940): No heartbeat from core client for 30 sec - exiting 19:03:18 (5940): No heartbeat from core client for 30 sec - exiting 19:03:19 (5940): No heartbeat from core client for 30 sec - exiting 19:03:21 (5940): No heartbeat from core client for 30 sec - exiting 19:03:22 (5940): No heartbeat from core client for 30 sec - exiting 19:03:23 (5940): No heartbeat from core client for 30 sec - exiting 19:03:24 (5940): No heartbeat from core client for 30 sec - exiting 19:03:25 (5940): No heartbeat from core client for 30 sec - exiting 19:03:26 (5940): No heartbeat from core client for 30 sec - exiting 19:03:27 (5940): No heartbeat from core client for 30 sec - exiting 19:03:28 (5940): No heartbeat from core client for 30 sec - exiting 19:03:29 (5940): No heartbeat from core client for 30 sec - exiting 19:03:30 (5940): No heartbeat from core client for 30 sec - exiting 19:03:31 (5940): No heartbeat from core client for 30 sec - exiting 19:03:33 (5940): No heartbeat from core client for 30 sec - exiting 19:03:34 (5940): No heartbeat from core client for 30 sec - exiting 19:03:35 (5940): No heartbeat from core client for 30 sec - exiting 19:03:36 (5940): No heartbeat from core client for 30 sec - exiting 19:03:37 (5940): No heartbeat from core client for 30 sec - exiting 19:03:38 (5940): No heartbeat from core client for 30 sec - exiting 19:03:39 (5940): No heartbeat from core client for 30 sec - exiting 19:03:40 (5940): No heartbeat from core client for 30 sec - exiting 19:03:41 (5940): No heartbeat from core client for 30 sec - exiting 19:03:42 (5940): No heartbeat from core client for 30 sec - exiting 19:03:44 (5940): No heartbeat from core client for 30 sec - exiting 19:03:45 (5940): No heartbeat from core client for 30 sec - exiting 19:03:46 (5940): No heartbeat from core client for 30 sec - exiting 19:03:47 (5940): No heartbeat from core client for 30 sec - exiting 19:03:48 (5940): No heartbeat from core client for 30 sec - exiting 19:03:49 (5940): No heartbeat from core client for 30 sec - exiting 19:03:50 (5940): No heartbeat from core client for 30 sec - exiting 19:03:51 (5940): No heartbeat from core client for 30 sec - exiting 19:03:52 (5940): No heartbeat from core client for 30 sec - exiting 19:03:53 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Atmos Hold Restart file rename failed on atmos_restart.hold Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Dec 2012 23:35:21	1252237	15495829	hadcm3n_387a_1940_40_008266423_0	77,760	131,237	1.6877
24 Dec 2012 06:22:16	1252237	15495829	hadcm3n_387a_1940_40_008266423_0	51,840	86,704	1.6725
23 Dec 2012 08:17:54	1252237	15495829	hadcm3n_387a_1940_40_008266423_0	25,920	43,695	1.6858