Task 16020927

Name	hadcm3n_o2v5_1940_40_008379676_1
Workunit	8530535
Created	17 Sep 2013, 11:13:52 UTC
Sent	17 Sep 2013, 11:21:07 UTC
Report deadline	17 Dec 2013, 18:48:18 UTC
Received	12 Nov 2013, 7:01:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1237173
Run time	12 hours 28 min 7 sec
CPU time	9 hours 9 min
Validate state	Invalid
Credit	311.04
Device peak FLOPS	3.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 20:15:26 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:29 (3904): No heartbeat from core client for 30 sec - exiting 20:20:09 (2768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:28:37 (14340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:23 (28768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:30 (28768): No heartbeat from core client for 30 sec - exiting 21:09:31 (28768): No heartbeat from core client for 30 sec - exiting 21:09:32 (28768): No heartbeat from core client for 30 sec - exiting 21:09:33 (28768): No heartbeat from core client for 30 sec - exiting 21:09:34 (28768): No heartbeat from core client for 30 sec - exiting 21:09:35 (28768): No heartbeat from core client for 30 sec - exiting 21:09:36 (28768): No heartbeat from core client for 30 sec - exiting 21:09:37 (28768): No heartbeat from core client for 30 sec - exiting 21:09:38 (28768): No heartbeat from core client for 30 sec - exiting 21:09:39 (28768): No heartbeat from core client for 30 sec - exiting 21:50:35 (34364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:05 (8288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:04 (11284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:44:34 (38096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:44:38 (38096): No heartbeat from core client for 30 sec - exiting 23:44:39 (38096): No heartbeat from core client for 30 sec - exiting 23:44:40 (38096): No heartbeat from core client for 30 sec - exiting 23:44:41 (38096): No heartbeat from core client for 30 sec - exiting 23:44:42 (38096): No heartbeat from core client for 30 sec - exiting 23:44:43 (38096): No heartbeat from core client for 30 sec - exiting 23:44:44 (38096): No heartbeat from core client for 30 sec - exiting 23:44:45 (38096): No heartbeat from core client for 30 sec - exiting 23:44:46 (38096): No heartbeat from core client for 30 sec - exiting 23:44:47 (38096): No heartbeat from core client for 30 sec - exiting 23:54:50 (12608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:53 (12608): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 00:15:10 (12004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:11 (12004): No heartbeat from core client for 30 sec - exiting 00:15:12 (12004): No heartbeat from core client for 30 sec - exiting 00:15:13 (12004): No heartbeat from core client for 30 sec - exiting 00:15:14 (12004): No heartbeat from core client for 30 sec - exiting 01:09:28 (20760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:37 (20760): No heartbeat from core client for 30 sec - exiting 01:09:38 (20760): No heartbeat from core client for 30 sec - exiting 01:09:39 (20760): No heartbeat from core client for 30 sec - exiting 01:09:40 (20760): No heartbeat from core client for 30 sec - exiting 02:13:48 (23216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:52 (23216): No heartbeat from core client for 30 sec - exiting 02:13:53 (23216): No heartbeat from core client for 30 sec - exiting 02:13:54 (23216): No heartbeat from core client for 30 sec - exiting 02:13:55 (23216): No heartbeat from core client for 30 sec - exiting 02:13:56 (23216): No heartbeat from core client for 30 sec - exiting 02:13:57 (23216): No heartbeat from core client for 30 sec - exiting 02:13:58 (23216): No heartbeat from core client for 30 sec - exiting 02:22:17 (41972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 00:41:30 (104284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=103216, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=103216, iMonCtr=1 Model crash detected, will try to restart... 01:47:04 (103216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=105668, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=115584, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=115584, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=115584, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Oct 2013 06:28:30	1237173	16020927	hadcm3n_o2v5_1940_40_008379676_1	25,920	28,340	1.0934