Task 15610539

Name	hadcm3n_49kf_1940_40_008308386_1
Workunit	8459521
Created	16 Feb 2013, 17:16:31 UTC
Sent	16 Feb 2013, 17:16:36 UTC
Report deadline	19 May 2013, 0:43:47 UTC
Received	17 Mar 2013, 15:42:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1169062
Run time	2 days 20 hours 27 min 10 sec
CPU time	1 days 1 hours 46 min 4 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:43:26 (7812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:46 (6624): No heartbeat from core client for 30 sec - exiting 19:47:48 (6624): No heartbeat from core client for 30 sec - exiting 19:47:49 (6624): No heartbeat from core client for 30 sec - exiting 19:47:50 (6624): No heartbeat from core client for 30 sec - exiting 19:47:51 (6624): No heartbeat from core client for 30 sec - exiting 19:47:52 (6624): No heartbeat from core client for 30 sec - exiting 19:47:53 (6624): No heartbeat from core client for 30 sec - exiting 19:47:54 (6624): No heartbeat from core client for 30 sec - exiting 19:47:55 (6624): No heartbeat from core client for 30 sec - exiting 19:47:56 (6624): No heartbeat from core client for 30 sec - exiting 19:47:57 (6624): No heartbeat from core client for 30 sec - exiting 19:47:58 (6624): No heartbeat from core client for 30 sec - exiting 19:48:00 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:01 (6624): No heartbeat from core client for 30 sec - exiting 19:48:02 (6624): No heartbeat from core client for 30 sec - exiting 19:48:03 (6624): No heartbeat from core client for 30 sec - exiting 19:52:20 (7032): No heartbeat from core client for 30 sec - exiting 19:52:21 (7032): No heartbeat from core client for 30 sec - exiting 19:52:22 (7032): No heartbeat from core client for 30 sec - exiting 19:52:23 (7032): No heartbeat from core client for 30 sec - exiting 19:52:24 (7032): No heartbeat from core client for 30 sec - exiting 19:52:25 (7032): No heartbeat from core client for 30 sec - exiting 19:52:26 (7032): No heartbeat from core client for 30 sec - exiting 19:52:27 (7032): No heartbeat from core client for 30 sec - exiting 19:52:28 (7032): No heartbeat from core client for 30 sec - exiting 19:52:29 (7032): No heartbeat from core client for 30 sec - exiting 19:52:31 (7032): No heartbeat from core client for 30 sec - exiting 19:52:32 (7032): No heartbeat from core client for 30 sec - exiting 19:52:33 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:34 (7032): No heartbeat from core client for 30 sec - exiting 19:52:35 (7032): No heartbeat from core client for 30 sec - exiting 19:52:36 (7032): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7976, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Mar 2013 21:46:37	1169062	15610539	hadcm3n_49kf_1940_40_008308386_1	77,760	70,206	0.9029
23 Feb 2013 18:06:57	1169062	15610539	hadcm3n_49kf_1940_40_008308386_1	51,840	46,157	0.8904
19 Feb 2013 17:57:14	1169062	15610539	hadcm3n_49kf_1940_40_008308386_1	25,920	23,098	0.8911