Task 15790363

Name	hadcm3n_4kip_1940_40_008303910_2
Workunit	8455045
Created	19 May 2013, 20:57:35 UTC
Sent	19 May 2013, 20:57:43 UTC
Report deadline	19 Aug 2013, 4:24:54 UTC
Received	13 Jun 2013, 21:19:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1284994
Run time	3 days 2 hours 29 min 15 sec
CPU time	2 days 20 hours 13 min 19 sec
Validate state	Invalid
Credit	1,866.24
Device peak FLOPS	3.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> デバイスがコマンドを認識できません。 (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4696, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 19:08:16 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:17 (1496): No heartbeat from core client for 30 sec - exiting 19:08:18 (1496): No heartbeat from core client for 30 sec - exiting 19:08:19 (1496): No heartbeat from core client for 30 sec - exiting 19:08:20 (1496): No heartbeat from core client for 30 sec - exiting 19:08:21 (1496): No heartbeat from core client for 30 sec - exiting 19:08:23 (1496): No heartbeat from core client for 30 sec - exiting 19:08:24 (1496): No heartbeat from core client for 30 sec - exiting 19:08:25 (1496): No heartbeat from core client for 30 sec - exiting 19:08:26 (1496): No heartbeat from core client for 30 sec - exiting 19:08:27 (1496): No heartbeat from core client for 30 sec - exiting 07:05:34 (2988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:34 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:53:57 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:51:19 (3316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:51:24 (3316): No heartbeat from core client for 30 sec - exiting 18:51:25 (3316): No heartbeat from core client for 30 sec - exiting 18:51:26 (3316): No heartbeat from core client for 30 sec - exiting 18:51:27 (3316): No heartbeat from core client for 30 sec - exiting 18:51:28 (3316): No heartbeat from core client for 30 sec - exiting 18:51:29 (3316): No heartbeat from core client for 30 sec - exiting 18:51:31 (3316): No heartbeat from core client for 30 sec - exiting 18:51:32 (3316): No heartbeat from core client for 30 sec - exiting 18:51:33 (3316): No heartbeat from core client for 30 sec - exiting 18:51:34 (3316): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 06:08:28 (3680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:35:32 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:35:33 (1388): No heartbeat from core client for 30 sec - exiting 06:35:34 (1388): No heartbeat from core client for 30 sec - exiting 06:35:35 (1388): No heartbeat from core client for 30 sec - exiting 06:35:36 (1388): No heartbeat from core client for 30 sec - exiting 06:35:37 (1388): No heartbeat from core client for 30 sec - exiting 06:35:38 (1388): No heartbeat from core client for 30 sec - exiting 06:35:39 (1388): No heartbeat from core client for 30 sec - exiting 06:35:41 (1388): No heartbeat from core client for 30 sec - exiting 06:35:42 (1388): No heartbeat from core client for 30 sec - exiting 06:35:43 (1388): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4976, iMonCtr=1 Model crash detected, will try to restart... 20:00:51 (2880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:56 (2880): No heartbeat from core client for 30 sec - exiting 20:00:57 (2880): No heartbeat from core client for 30 sec - exiting 20:00:59 (2880): No heartbeat from core client for 30 sec - exiting 20:01:00 (2880): No heartbeat from core client for 30 sec - exiting 20:01:01 (2880): No heartbeat from core client for 30 sec - exiting 20:01:02 (2880): No heartbeat from core client for 30 sec - exiting 20:01:03 (2880): No heartbeat from core client for 30 sec - exiting 20:01:04 (2880): No heartbeat from core client for 30 sec - exiting 20:01:05 (2880): No heartbeat from core client for 30 sec - exiting 20:01:06 (2880): No heartbeat from core client for 30 sec - exiting 20:03:30 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 20:09:53 (5600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:54 (5600): No heartbeat from core client for 30 sec - exiting 20:09:55 (5600): No heartbeat from core client for 30 sec - exiting 20:09:57 (5600): No heartbeat from core client for 30 sec - exiting 20:09:58 (5600): No heartbeat from core client for 30 sec - exiting 20:09:59 (5600): No heartbeat from core client for 30 sec - exiting 20:10:00 (5600): No heartbeat from core client for 30 sec - exiting 20:10:01 (5600): No heartbeat from core client for 30 sec - exiting 20:10:02 (5600): No heartbeat from core client for 30 sec - exiting 20:10:03 (5600): No heartbeat from core client for 30 sec - exiting 20:10:04 (5600): No heartbeat from core client for 30 sec - exiting 20:13:49 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 21:28:29 (3784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... 21:31:01 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:02 (3116): No heartbeat from core client for 30 sec - exiting 21:31:04 (3116): No heartbeat from core client for 30 sec - exiting 21:31:05 (3116): No heartbeat from core client for 30 sec - exiting 21:31:06 (3116): No heartbeat from core client for 30 sec - exiting 21:31:07 (3116): No heartbeat from core client for 30 sec - exiting 21:31:08 (3116): No heartbeat from core client for 30 sec - exiting 21:31:09 (3116): No heartbeat from core client for 30 sec - exiting 21:31:10 (3116): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5600, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5600, iMonCtr=1 Model crash detected, will try to restart... 21:32:37 (5600): No heartbeat from core client for 30 sec - exiting 21:32:38 (5600): No heartbeat from core client for 30 sec - exiting 21:32:39 (5600): No heartbeat from core client for 30 sec - exiting 21:32:40 (5600): No heartbeat from core client for 30 sec - exiting 21:32:42 (5600): No heartbeat from core client for 30 sec - exiting 21:32:43 (5600): No heartbeat from core client for 30 sec - exiting 21:32:44 (5600): No heartbeat from core client for 30 sec - exiting 21:32:45 (5600): No heartbeat from core client for 30 sec - exiting 21:32:46 (5600): No heartbeat from core client for 30 sec - exiting 21:32:47 (5600): No heartbeat from core client for 30 sec - exiting 21:32:48 (5600): No heartbeat from core client for 30 sec - exiting 21:32:49 (5600): No heartbeat from core client for 30 sec - exiting 21:32:50 (5600): No heartbeat from core client for 30 sec - exiting 21:32:51 (5600): No heartbeat from core client for 30 sec - exiting 21:32:52 (5600): No heartbeat from core client for 30 sec - exiting 21:32:54 (5600): No heartbeat from core client for 30 sec - exiting 21:32:55 (5600): No heartbeat from core client for 30 sec - exiting 21:32:56 (5600): No heartbeat from core client for 30 sec - exiting 21:32:57 (5600): No heartbeat from core client for 30 sec - exiting 21:32:58 (5600): No heartbeat from core client for 30 sec - exiting Sorry, too many model crashes! :-( 06:08:43 (2292): No heartbeat from core client for 30 sec - exiting 06:08:47 (2292): No heartbeat from core client for 30 sec - exiting 06:08:48 (2292): No heartbeat from core client for 30 sec - exiting 06:08:49 (2292): No heartbeat from core client for 30 sec - exiting 06:08:50 (2292): No heartbeat from core client for 30 sec - exiting 06:08:51 (2292): No heartbeat from core client for 30 sec - exiting 06:08:52 (2292): No heartbeat from core client for 30 sec - exiting 06:08:53 (2292): No heartbeat from core client for 30 sec - exiting 06:08:54 (2292): No heartbeat from core client for 30 sec - exiting 06:08:56 (2292): No heartbeat from core client for 30 sec - exiting 06:08:57 (2292): No heartbeat from core client for 30 sec - exiting 06:08:58 (2292): No heartbeat from core client for 30 sec - exiting 06:08:59 (2292): No heartbeat from core client for 30 sec - exiting 06:09:00 (2292): No heartbeat from core client for 30 sec - exiting 06:09:01 (2292): No heartbeat from core client for 30 sec - exiting 06:09:02 (2292): No heartbeat from core client for 30 sec - exiting 06:09:03 (2292): No heartbeat from core client for 30 sec - exiting 06:09:04 (2292): No heartbeat from core client for 30 sec - exiting 06:09:05 (2292): No heartbeat from core client for 30 sec - exiting 06:09:07 (2292): No heartbeat from core client for 30 sec - exiting 06:09:08 (2292): No heartbeat from core client for 30 sec - exiting 06:09:09 (2292): No heartbeat from core client for 30 sec - exiting 06:09:10 (2292): No heartbeat from core client for 30 sec - exiting 06:09:11 (2292): No heartbeat from core client for 30 sec - exiting 06:09:12 (2292): No heartbeat from core client for 30 sec - exiting 06:09:13 (2292): No heartbeat from core client for 30 sec - exiting 06:09:14 (2292): No heartbeat from core client for 30 sec - exiting 06:09:15 (2292): No heartbeat from core client for 30 sec - exiting 06:09:16 (2292): No heartbeat from core client for 30 sec - exiting 06:09:17 (2292): No heartbeat from core client for 30 sec - exiting 06:09:19 (2292): No heartbeat from core client for 30 sec - exiting 06:09:20 (2292): No heartbeat from core client for 30 sec - exiting 06:09:21 (2292): No heartbeat from core client for 30 sec - exiting 06:09:22 (2292): No heartbeat from core client for 30 sec - exiting 06:09:23 (2292): No heartbeat from core client for 30 sec - exiting 06:09:24 (2292): No heartbeat from core client for 30 sec - exiting 06:09:25 (2292): No heartbeat from core client for 30 sec - exiting 06:09:26 (2292): No heartbeat from core client for 30 sec - exiting 06:09:27 (2292): No heartbeat from core client for 30 sec - exiting 06:09:28 (2292): No heartbeat from core client for 30 sec - exiting 06:09:29 (2292): No heartbeat from core client for 30 sec - exiting 06:09:31 (2292): No heartbeat from core client for 30 sec - exiting 06:09:32 (2292): No heartbeat from core client for 30 sec - exiting 06:09:33 (2292): No heartbeat from core client for 30 sec - exiting 06:09:34 (2292): No heartbeat from core client for 30 sec - exiting 06:09:35 (2292): No heartbeat from core client for 30 sec - exiting 06:09:36 (2292): No heartbeat from core client for 30 sec - exiting 06:09:37 (2292): No heartbeat from core client for 30 sec - exiting 06:09:38 (2292): No heartbeat from core client for 30 sec - exiting 06:09:39 (2292): No heartbeat from core client for 30 sec - exiting 06:09:40 (2292): No heartbeat from core client for 30 sec - exiting 06:09:41 (2292): No heartbeat from core client for 30 sec - exiting 06:09:43 (2292): No heartbeat from core client for 30 sec - exiting 06:09:44 (2292): No heartbeat from core client for 30 sec - exiting 06:09:45 (2292): No heartbeat from core client for 30 sec - exiting 06:09:46 (2292): No heartbeat from core client for 30 sec - exiting 06:09:47 (2292): No heartbeat from core client for 30 sec - exiting 06:09:48 (2292): No heartbeat from core client for 30 sec - exiting 06:09:49 (2292): No heartbeat from core client for 30 sec - exiting 06:09:50 (2292): No heartbeat from core client for 30 sec - exiting 06:09:51 (2292): No heartbeat from core client for 30 sec - exiting 06:09:52 (2292): No heartbeat from core client for 30 sec - exiting 06:09:53 (2292): No heartbeat from core client for 30 sec - exiting 06:09:55 (2292): No heartbeat from core client for 30 sec - exiting 06:09:56 (2292): No heartbeat from core client for 30 sec - exiting 06:09:57 (2292): No heartbeat from core client for 30 sec - exiting 06:09:58 (2292): No heartbeat from core client for 30 sec - exiting 06:09:59 (2292): No heartbeat from core client for 30 sec - exiting 06:10:00 (2292): No heartbeat from core client for 30 sec - exiting 06:10:01 (2292): No heartbeat from core client for 30 sec - exiting 06:10:02 (2292): No heartbeat from core client for 30 sec - exiting 06:10:03 (2292): No heartbeat from core client for 30 sec - exiting 06:10:04 (2292): No heartbeat from core client for 30 sec - exiting 06:10:05 (2292): No heartbeat from core client for 30 sec - exiting 06:10:07 (2292): No heartbeat from core client for 30 sec - exiting 06:10:08 (2292): No heartbeat from core client for 30 sec - exiting 06:10:09 (2292): No heartbeat from core client for 30 sec - exiting 06:10:10 (2292): No heartbeat from core client for 30 sec - exiting 06:10:11 (2292): No heartbeat from core client for 30 sec - exiting 06:10:12 (2292): No heartbeat from core client for 30 sec - exiting 06:10:13 (2292): No heartbeat from core client for 30 sec - exiting 06:10:14 (2292): No heartbeat from core client for 30 sec - exiting 06:10:15 (2292): No heartbeat from core client for 30 sec - exiting 06:10:16 (2292): No heartbeat from core client for 30 sec - exiting 06:10:17 (2292): No heartbeat from core client for 30 sec - exiting 06:10:19 (2292): No heartbeat from core client for 30 sec - exiting 06:10:20 (2292): No heartbeat from core client for 30 sec - exiting 06:10:21 (2292): No heartbeat from core client for 30 sec - exiting 06:10:22 (2292): No heartbeat from core client for 30 sec - exiting 06:10:23 (2292): No heartbeat from core client for 30 sec - exiting 06:10:24 (2292): No heartbeat from core client for 30 sec - exiting 06:10:25 (2292): No heartbeat from core client for 30 sec - exiting 06:10:26 (2292): No heartbeat from core client for 30 sec - exiting 06:10:27 (2292): No heartbeat from core client for 30 sec - exiting 06:10:28 (2292): No heartbeat from core client for 30 sec - exiting 06:10:29 (2292): No heartbeat from core client for 30 sec - exiting 06:10:31 (2292): No heartbeat from core client for 30 sec - exiting 06:10:32 (2292): No heartbeat from core client for 30 sec - exiting 06:10:33 (2292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:10:34 (2292): No heartbeat from core client for 30 sec - exiting 06:10:35 (2292): No heartbeat from core client for 30 sec - exiting 06:10:36 (2292): No heartbeat from core client for 30 sec - exiting 06:10:37 (2292): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=1 Model crash detected, will try to restart... 06:12:53 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:54 (4936): No heartbeat from core client for 30 sec - exiting 06:12:55 (4936): No heartbeat from core client for 30 sec - exiting 06:12:56 (4936): No heartbeat from core client for 30 sec - exiting 06:12:57 (4936): No heartbeat from core client for 30 sec - exiting 06:12:58 (4936): No heartbeat from core client for 30 sec - exiting 06:12:59 (4936): No heartbeat from core client for 30 sec - exiting 06:13:00 (4936): No heartbeat from core client for 30 sec - exiting 06:13:01 (4936): No heartbeat from core client for 30 sec - exiting 06:13:02 (4936): No heartbeat from core client for 30 sec - exiting 06:13:04 (4936): No heartbeat from core client for 30 sec - exiting 06:18:41 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:03 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3452, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Jun 2013 22:15:23	1130983	15790363	hadcm3n_4kip_1940_40_008303910_2	155,520	238,248	1.5319
09 Jun 2013 02:52:20	1130983	15790363	hadcm3n_4kip_1940_40_008303910_2	129,600	197,164	1.5213
08 Jun 2013 05:17:10	1130983	15790363	hadcm3n_4kip_1940_40_008303910_2	103,680	160,378	1.5469
07 Jun 2013 08:50:32	1130983	15790363	hadcm3n_4kip_1940_40_008303910_2	77,760	122,393	1.5740
06 Jun 2013 10:52:10	1130983	15790363	hadcm3n_4kip_1940_40_008303910_2	51,840	81,384	1.5699
03 Jun 2013 11:15:38	1130983	15790363	hadcm3n_4kip_1940_40_008303910_2	25,920	40,680	1.5694