Task 13133760

Name	hadcm3n_yjhp_1900_40_007358119_2
Workunit	7555549
Created	8 Jul 2011, 19:22:17 UTC
Sent	8 Jul 2011, 19:25:29 UTC
Report deadline	8 Oct 2011, 2:52:40 UTC
Received	15 Jul 2011, 15:07:08 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	22 (0x00000016) Unknown error code
Computer ID	908900
Run time	2 days 17 hours 32 min 9 sec
CPU time	2 days 17 hours 32 min 9 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	1.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.10.45</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 16:38:12 (1728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:38:13 (1728): No heartbeat from core client for 30 sec - exiting 16:38:15 (1728): No heartbeat from core client for 30 sec - exiting 16:38:16 (1728): No heartbeat from core client for 30 sec - exiting 16:38:17 (1728): No heartbeat from core client for 30 sec - exiting 20:25:23 (1972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:24 (1972): No heartbeat from core client for 30 sec - exiting 20:25:25 (1972): No heartbeat from core client for 30 sec - exiting 20:25:26 (1972): No heartbeat from core client for 30 sec - exiting 21:00:26 (868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:27 (868): No heartbeat from core client for 30 sec - exiting 21:00:28 (868): No heartbeat from core client for 30 sec - exiting 22:18:48 (1972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:49 (1972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 01:18:18 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:19 (2232): No heartbeat from core client for 30 sec - exiting 01:18:21 (2232): No heartbeat from core client for 30 sec - exiting 01:18:22 (2232): No heartbeat from core client for 30 sec - exiting 04:45:05 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:06 (4008): No heartbeat from core client for 30 sec - exiting 04:45:08 (4008): No heartbeat from core client for 30 sec - exiting 04:45:09 (4008): No heartbeat from core client for 30 sec - exiting 12:45:51 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:53 (2656): No heartbeat from core client for 30 sec - exiting 12:45:54 (2656): No heartbeat from core client for 30 sec - exiting 12:45:55 (2656): No heartbeat from core client for 30 sec - exiting 12:45:56 (2656): No heartbeat from core client for 30 sec - exiting 12:45:57 (2656): No heartbeat from core client for 30 sec - exiting 12:56:55 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:07 (624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:09 (624): No heartbeat from core client for 30 sec - exiting 13:06:10 (624): No heartbeat from core client for 30 sec - exiting 13:14:11 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:12 (3688): No heartbeat from core client for 30 sec - exiting 13:14:14 (3688): No heartbeat from core client for 30 sec - exiting 13:26:04 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:05 (3008): No heartbeat from core client for 30 sec - exiting 13:26:06 (3008): No heartbeat from core client for 30 sec - exiting 13:26:07 (3008): No heartbeat from core client for 30 sec - exiting 18:42:04 (4056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:08:24 (1948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:25 (1948): No heartbeat from core client for 30 sec - exiting 01:08:26 (1948): No heartbeat from core client for 30 sec - exiting 01:08:28 (1948): No heartbeat from core client for 30 sec - exiting 01:08:29 (1948): No heartbeat from core client for 30 sec - exiting 01:08:30 (1948): No heartbeat from core client for 30 sec - exiting 02:03:46 (3156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:47 (3156): No heartbeat from core client for 30 sec - exiting 02:03:49 (3156): No heartbeat from core client for 30 sec - exiting 02:03:50 (3156): No heartbeat from core client for 30 sec - exiting 08:08:55 (704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:56 (704): No heartbeat from core client for 30 sec - exiting 08:08:57 (704): No heartbeat from core client for 30 sec - exiting 08:08:59 (704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 13:29:57 (1360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:59 (1360): No heartbeat from core client for 30 sec - exiting 13:30:00 (1360): No heartbeat from core client for 30 sec - exiting 13:30:01 (1360): No heartbeat from core client for 30 sec - exiting 13:39:53 (3788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:54 (3788): No heartbeat from core client for 30 sec - exiting 13:39:56 (3788): No heartbeat from core client for 30 sec - exiting 13:39:57 (3788): No heartbeat from core client for 30 sec - exiting 13:49:39 (2168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:33 (184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:34 (184): No heartbeat from core client for 30 sec - exiting 20:19:36 (184): No heartbeat from core client for 30 sec - exiting 20:19:37 (184): No heartbeat from core client for 30 sec - exiting 22:19:16 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:18 (3020): No heartbeat from core client for 30 sec - exiting 22:19:19 (3020): No heartbeat from core client for 30 sec - exiting 22:19:20 (3020): No heartbeat from core client for 30 sec - exiting 22:19:21 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:24:31 (2128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:24:33 (2128): No heartbeat from core client for 30 sec - exiting 06:02:08 (1712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:02:09 (1712): No heartbeat from core client for 30 sec - exiting 06:02:10 (1712): No heartbeat from core client for 30 sec - exiting 06:02:12 (1712): No heartbeat from core client for 30 sec - exiting 07:12:19 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:20 (2132): No heartbeat from core client for 30 sec - exiting 07:12:21 (2132): No heartbeat from core client for 30 sec - exiting 07:12:23 (2132): No heartbeat from core client for 30 sec - exiting 08:29:17 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:19 (3568): No heartbeat from core client for 30 sec - exiting 08:29:20 (3568): No heartbeat from core client for 30 sec - exiting 08:29:21 (3568): No heartbeat from core client for 30 sec - exiting 08:29:22 (3568): No heartbeat from core client for 30 sec - exiting 12:52:14 (2040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:17 (2040): No heartbeat from core client for 30 sec - exiting 12:52:18 (2040): No heartbeat from core client for 30 sec - exiting 12:52:19 (2040): No heartbeat from core client for 30 sec - exiting 13:48:24 (2448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:25 (2448): No heartbeat from core client for 30 sec - exiting 13:48:26 (2448): No heartbeat from core client for 30 sec - exiting 13:48:27 (2448): No heartbeat from core client for 30 sec - exiting 13:48:28 (2448): No heartbeat from core client for 30 sec - exiting 13:48:29 (2448): No heartbeat from core client for 30 sec - exiting 14:05:19 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:05:21 (2748): No heartbeat from core client for 30 sec - exiting 14:05:22 (2748): No heartbeat from core client for 30 sec - exiting 14:05:23 (2748): No heartbeat from core client for 30 sec - exiting 14:05:24 (2748): No heartbeat from core client for 30 sec - exiting 14:15:38 (984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:22:05 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:34 (2732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:36 (2732): No heartbeat from core client for 30 sec - exiting 20:07:37 (2732): No heartbeat from core client for 30 sec - exiting 20:07:38 (2732): No heartbeat from core client for 30 sec - exiting 20:07:39 (2732): No heartbeat from core client for 30 sec - exiting 20:22:14 (1060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:15 (1060): No heartbeat from core client for 30 sec - exiting 20:22:17 (1060): No heartbeat from core client for 30 sec - exiting 20:22:18 (1060): No heartbeat from core client for 30 sec - exiting 21:23:02 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:04 (3176): No heartbeat from core client for 30 sec - exiting 21:23:05 (3176): No heartbeat from core client for 30 sec - exiting 21:23:06 (3176): No heartbeat from core client for 30 sec - exiting 22:14:07 (2428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:08 (2428): No heartbeat from core client for 30 sec - exiting 22:14:10 (2428): No heartbeat from core client for 30 sec - exiting 22:14:11 (2428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:23:15 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:41 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:57 (3388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:59 (3388): No heartbeat from core client for 30 sec - exiting 06:39:00 (3388): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 13:23:41	908900	13133760	hadcm3n_yjhp_1900_40_007358119_2	25,920	158,095	6.0993