Task 13121806

Name	hadcm3n_yk59_1900_40_007358967_1
Workunit	7556397
Created	6 Jul 2011, 15:03:11 UTC
Sent	8 Jul 2011, 3:08:57 UTC
Report deadline	7 Oct 2011, 10:36:08 UTC
Received	4 Aug 2011, 20:25:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1032424
Run time	13 days 16 hours 44 min 6 sec
CPU time	12 days 8 hours 19 min 15 sec
Validate state	Invalid
Credit	7,153.92
Device peak FLOPS	2.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:26:16 (408): No heartbeat from core client for 30 sec - exiting 13:26:18 (408): No heartbeat from core client for 30 sec - exiting 13:26:19 (408): No heartbeat from core client for 30 sec - exiting 13:26:20 (408): No heartbeat from core client for 30 sec - exiting 13:26:21 (408): No heartbeat from core client for 30 sec - exiting 13:26:22 (408): No heartbeat from core client for 30 sec - exiting 13:26:23 (408): No heartbeat from core client for 30 sec - exiting 13:26:24 (408): No heartbeat from core client for 30 sec - exiting 13:26:25 (408): No heartbeat from core client for 30 sec - exiting 13:26:26 (408): No heartbeat from core client for 30 sec - exiting 13:26:27 (408): No heartbeat from core client for 30 sec - exiting 13:26:29 (408): No heartbeat from core client for 30 sec - exiting 13:26:30 (408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:31 (408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:30:36 (3624): No heartbeat from core client for 30 sec - exiting 09:30:38 (3624): No heartbeat from core client for 30 sec - exiting 09:30:39 (3624): No heartbeat from core client for 30 sec - exiting 09:30:40 (3624): No heartbeat from core client for 30 sec - exiting 09:30:41 (3624): No heartbeat from core client for 30 sec - exiting 09:30:42 (3624): No heartbeat from core client for 30 sec - exiting 09:30:43 (3624): No heartbeat from core client for 30 sec - exiting 09:30:44 (3624): No heartbeat from core client for 30 sec - exiting 09:30:45 (3624): No heartbeat from core client for 30 sec - exiting 09:30:46 (3624): No heartbeat from core client for 30 sec - exiting 09:30:47 (3624): No heartbeat from core client for 30 sec - exiting 09:30:48 (3624): No heartbeat from core client for 30 sec - exiting 09:30:50 (3624): No heartbeat from core client for 30 sec - exiting 09:30:51 (3624): No heartbeat from core client for 30 sec - exiting 09:30:52 (3624): No heartbeat from core client for 30 sec - exiting 09:30:53 (3624): No heartbeat from core client for 30 sec - exiting 09:30:54 (3624): No heartbeat from core client for 30 sec - exiting 09:30:55 (3624): No heartbeat from core client for 30 sec - exiting 09:30:56 (3624): No heartbeat from core client for 30 sec - exiting 09:30:57 (3624): No heartbeat from core client for 30 sec - exiting 09:30:58 (3624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:26:38 (2076): No heartbeat from core client for 30 sec - exiting 11:26:40 (2076): No heartbeat from core client for 30 sec - exiting 11:26:41 (2076): No heartbeat from core client for 30 sec - exiting 11:26:42 (2076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:43 (2076): No heartbeat from core client for 30 sec - exiting 14:58:50 (2808): No heartbeat from core client for 30 sec - exiting 14:58:51 (2808): No heartbeat from core client for 30 sec - exiting 14:58:52 (2808): No heartbeat from core client for 30 sec - exiting 14:58:54 (2808): No heartbeat from core client for 30 sec - exiting 14:58:55 (2808): No heartbeat from core client for 30 sec - exiting 14:58:56 (2808): No heartbeat from core client for 30 sec - exiting 14:58:57 (2808): No heartbeat from core client for 30 sec - exiting 14:58:58 (2808): No heartbeat from core client for 30 sec - exiting 14:58:59 (2808): No heartbeat from core client for 30 sec - exiting 14:59:00 (2808): No heartbeat from core client for 30 sec - exiting 14:59:01 (2808): No heartbeat from core client for 30 sec - exiting 14:59:02 (2808): No heartbeat from core client for 30 sec - exiting 14:59:03 (2808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:59:04 (2808): No heartbeat from core client for 30 sec - exiting 14:59:06 (2808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 08:45:26 (2740): No heartbeat from core client for 30 sec - exiting 08:45:28 (2740): No heartbeat from core client for 30 sec - exiting 08:45:29 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Aug 2011 08:58:13	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	596,160	1,027,311	1.7232
02 Aug 2011 18:28:23	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	570,240	981,315	1.7209
29 Jul 2011 12:10:45	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	544,320	936,425	1.7204
28 Jul 2011 22:45:26	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	518,400	891,492	1.7197
28 Jul 2011 10:00:31	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	492,480	847,797	1.7215
27 Jul 2011 21:20:33	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	466,560	804,936	1.7253
27 Jul 2011 08:16:04	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	440,640	760,659	1.7263
26 Jul 2011 19:10:55	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	414,720	717,135	1.7292
25 Jul 2011 23:04:21	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	388,800	673,142	1.7313
25 Jul 2011 22:25:51	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	362,880	628,614	1.7323
25 Jul 2011 21:48:19	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	336,960	584,418	1.7344
25 Jul 2011 20:23:27	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	311,040	540,637	1.7382
25 Jul 2011 19:24:57	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	285,120	496,949	1.7429
25 Jul 2011 19:07:33	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	259,200	455,256	1.7564
25 Jul 2011 18:59:28	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	233,280	411,317	1.7632
25 Jul 2011 18:04:49	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	207,360	367,818	1.7738
25 Jul 2011 17:43:00	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	181,440	320,066	1.7640
25 Jul 2011 17:19:30	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	155,520	272,486	1.7521
25 Jul 2011 16:01:56	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	129,600	225,445	1.7395
25 Jul 2011 15:03:53	1032424	13121806	hadcm3n_yk59_1900_40_007358967_1	103,680	185,388	1.7881