Task 13636680

Name	hadcm3n_o4kl_1980_40_007426230_2
Workunit	7623733
Created	15 Nov 2011, 22:39:59 UTC
Sent	15 Nov 2011, 22:40:19 UTC
Report deadline	15 Feb 2012, 6:07:30 UTC
Received	22 Dec 2011, 11:53:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1082830
Run time	2 days 16 hours 16 min 23 sec
CPU time	2 days 15 hours 18 min 30 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	2.57 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:14:04 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:05 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:28:38 (13600): No heartbeat from core client for 30 sec - exiting 18:28:39 (13600): No heartbeat from core client for 30 sec - exiting 18:28:40 (13600): No heartbeat from core client for 30 sec - exiting 18:28:41 (13600): No heartbeat from core client for 30 sec - exiting 18:28:42 (13600): No heartbeat from core client for 30 sec - exiting 18:29:13 (13600): No heartbeat from core client for 30 sec - exiting 18:29:14 (13600): No heartbeat from core client for 30 sec - exiting 18:29:15 (13600): No heartbeat from core client for 30 sec - exiting 18:29:16 (13600): No heartbeat from core client for 30 sec - exiting 18:29:17 (13600): No heartbeat from core client for 30 sec - exiting 18:33:10 (13900): No heartbeat from core client for 30 sec - exiting 18:33:11 (13900): No heartbeat from core client for 30 sec - exiting 18:33:12 (13900): No heartbeat from core client for 30 sec - exiting 18:33:13 (13900): No heartbeat from core client for 30 sec - exiting 18:33:14 (13900): No heartbeat from core client for 30 sec - exiting 18:33:15 (13900): No heartbeat from core client for 30 sec - exiting 18:33:16 (13900): No heartbeat from core client for 30 sec - exiting 18:51:06 (10692): No heartbeat from core client for 30 sec - exiting 18:51:07 (10692): No heartbeat from core client for 30 sec - exiting 18:51:08 (10692): No heartbeat from core client for 30 sec - exiting 18:51:09 (10692): No heartbeat from core client for 30 sec - exiting 18:51:10 (10692): No heartbeat from core client for 30 sec - exiting 18:51:11 (10692): No heartbeat from core client for 30 sec - exiting 18:51:12 (10692): No heartbeat from core client for 30 sec - exiting 18:51:13 (10692): No heartbeat from core client for 30 sec - exiting 18:51:14 (10692): No heartbeat from core client for 30 sec - exiting 18:51:15 (10692): No heartbeat from core client for 30 sec - exiting 18:51:16 (10692): No heartbeat from core client for 30 sec - exiting 18:51:17 (10692): No heartbeat from core client for 30 sec - exiting 18:51:18 (10692): No heartbeat from core client for 30 sec - exiting 18:51:19 (10692): No heartbeat from core client for 30 sec - exiting 18:51:20 (10692): No heartbeat from core client for 30 sec - exiting 18:51:21 (10692): No heartbeat from core client for 30 sec - exiting 18:51:22 (10692): No heartbeat from core client for 30 sec - exiting 18:51:23 (10692): No heartbeat from core client for 30 sec - exiting 18:51:24 (10692): No heartbeat from core client for 30 sec - exiting 18:51:25 (10692): No heartbeat from core client for 30 sec - exiting 18:51:26 (10692): No heartbeat from core client for 30 sec - exiting 18:51:27 (10692): No heartbeat from core client for 30 sec - exiting 18:51:28 (10692): No heartbeat from core client for 30 sec - exiting 18:51:29 (10692): No heartbeat from core client for 30 sec - exiting 18:51:30 (10692): No heartbeat from core client for 30 sec - exiting 18:51:31 (10692): No heartbeat from core client for 30 sec - exiting 18:51:32 (10692): No heartbeat from core client for 30 sec - exiting 18:51:33 (10692): No heartbeat from core client for 30 sec - exiting 18:51:34 (10692): No heartbeat from core client for 30 sec - exiting 18:51:35 (10692): No heartbeat from core client for 30 sec - exiting 18:51:36 (10692): No heartbeat from core client for 30 sec - exiting 18:51:37 (10692): No heartbeat from core client for 30 sec - exiting 18:51:38 (10692): No heartbeat from core client for 30 sec - exiting 18:51:39 (10692): No heartbeat from core client for 30 sec - exiting 18:51:40 (10692): No heartbeat from core client for 30 sec - exiting 18:51:41 (10692): No heartbeat from core client for 30 sec - exiting 18:51:42 (10692): No heartbeat from core client for 30 sec - exiting 18:51:43 (10692): No heartbeat from core client for 30 sec - exiting 18:51:44 (10692): No heartbeat from core client for 30 sec - exiting 18:51:45 (10692): No heartbeat from core client for 30 sec - exiting 18:51:46 (10692): No heartbeat from core client for 30 sec - exiting 18:51:47 (10692): No heartbeat from core client for 30 sec - exiting 18:51:48 (10692): No heartbeat from core client for 30 sec - exiting 18:51:49 (10692): No heartbeat from core client for 30 sec - exiting 18:51:50 (10692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: INITDUMP: Wrong no of atmos prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of atmos prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of atmos prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of atmos prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of atmos prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of atmos prognostic fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Dec 2011 21:55:01	1082830	13636680	hadcm3n_o4kl_1980_40_007426230_2	129,600	207,817	1.6035
09 Dec 2011 14:03:55	1082830	13636680	hadcm3n_o4kl_1980_40_007426230_2	103,680	164,438	1.5860
25 Nov 2011 12:57:03	1082830	13636680	hadcm3n_o4kl_1980_40_007426230_2	77,760	122,534	1.5758
21 Nov 2011 22:41:02	1082830	13636680	hadcm3n_o4kl_1980_40_007426230_2	51,840	81,201	1.5664
16 Nov 2011 23:40:58	1082830	13636680	hadcm3n_o4kl_1980_40_007426230_2	25,920	39,793	1.5352