Task 17229827

Name	hadcm3n_s0rt_1940_40_009094162_0
Workunit	9224498
Created	20 Oct 2014, 16:59:32 UTC
Sent	20 Oct 2014, 18:28:27 UTC
Report deadline	20 Jan 2015, 1:55:38 UTC
Received	13 Nov 2014, 14:08:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1300761
Run time	1 days 14 hours 15 min 30 sec
CPU time	1 days 13 hours 53 min 47 sec
Validate state	Invalid
Credit	1,244.16
Device peak FLOPS	3.10 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <message> Das Gerät erkennt den Befehl nicht. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:06:55 (8464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:00 (8464): No heartbeat from core client for 30 sec - exiting 05:07:04 (8464): No heartbeat from core client for 30 sec - exiting 05:07:05 (8464): No heartbeat from core client for 30 sec - exiting 05:07:07 (8464): No heartbeat from core client for 30 sec - exiting 05:07:08 (8464): No heartbeat from core client for 30 sec - exiting 05:07:09 (8464): No heartbeat from core client for 30 sec - exiting 05:07:10 (8464): No heartbeat from core client for 30 sec - exiting 05:09:08 (9492): No heartbeat from core client for 30 sec - exiting 05:09:09 (9492): No heartbeat from core client for 30 sec - exiting 05:09:10 (9492): No heartbeat from core client for 30 sec - exiting 05:09:11 (9492): No heartbeat from core client for 30 sec - exiting 05:09:12 (9492): No heartbeat from core client for 30 sec - exiting 05:09:13 (9492): No heartbeat from core client for 30 sec - exiting 05:09:14 (9492): No heartbeat from core client for 30 sec - exiting 05:09:15 (9492): No heartbeat from core client for 30 sec - exiting 05:09:16 (9492): No heartbeat from core client for 30 sec - exiting 05:09:17 (9492): No heartbeat from core client for 30 sec - exiting 05:09:18 (9492): No heartbeat from core client for 30 sec - exiting 05:09:19 (9492): No heartbeat from core client for 30 sec - exiting 05:09:20 (9492): No heartbeat from core client for 30 sec - exiting 05:09:21 (9492): No heartbeat from core client for 30 sec - exiting 05:09:22 (9492): No heartbeat from core client for 30 sec - exiting 05:09:23 (9492): No heartbeat from core client for 30 sec - exiting 05:09:24 (9492): No heartbeat from core client for 30 sec - exiting 05:09:25 (9492): No heartbeat from core client for 30 sec - exiting 05:09:26 (9492): No heartbeat from core client for 30 sec - exiting 05:09:27 (9492): No heartbeat from core client for 30 sec - exiting 05:09:28 (9492): No heartbeat from core client for 30 sec - exiting 05:09:29 (9492): No heartbeat from core client for 30 sec - exiting 05:09:30 (9492): No heartbeat from core client for 30 sec - exiting 05:09:31 (9492): No heartbeat from core client for 30 sec - exiting 05:09:32 (9492): No heartbeat from core client for 30 sec - exiting 05:09:33 (9492): No heartbeat from core client for 30 sec - exiting 05:09:34 (9492): No heartbeat from core client for 30 sec - exiting 05:09:35 (9492): No heartbeat from core client for 30 sec - exiting 05:09:36 (9492): No heartbeat from core client for 30 sec - exiting 05:09:37 (9492): No heartbeat from core client for 30 sec - exiting 05:09:38 (9492): No heartbeat from core client for 30 sec - exiting 05:09:39 (9492): No heartbeat from core client for 30 sec - exiting 05:09:40 (9492): No heartbeat from core client for 30 sec - exiting 05:09:41 (9492): No heartbeat from core client for 30 sec - exiting 05:09:42 (9492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:43 (9492): No heartbeat from core client for 30 sec - exiting 05:32:04 (10108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:36 (8208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:23:16 (10096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:23:20 (10096): No heartbeat from core client for 30 sec - exiting 06:23:23 (10096): No heartbeat from core client for 30 sec - exiting 06:23:24 (10096): No heartbeat from core client for 30 sec - exiting 06:23:25 (10096): No heartbeat from core client for 30 sec - exiting 06:23:26 (10096): No heartbeat from core client for 30 sec - exiting 06:23:27 (10096): No heartbeat from core client for 30 sec - exiting 06:24:42 (8076): No heartbeat from core client for 30 sec - exiting 06:24:43 (8076): No heartbeat from core client for 30 sec - exiting 06:24:44 (8076): No heartbeat from core client for 30 sec - exiting 06:24:45 (8076): No heartbeat from core client for 30 sec - exiting 06:24:46 (8076): No heartbeat from core client for 30 sec - exiting 06:24:47 (8076): No heartbeat from core client for 30 sec - exiting 06:24:48 (8076): No heartbeat from core client for 30 sec - exiting 06:24:49 (8076): No heartbeat from core client for 30 sec - exiting 06:24:50 (8076): No heartbeat from core client for 30 sec - exiting 06:24:51 (8076): No heartbeat from core client for 30 sec - exiting 06:24:52 (8076): No heartbeat from core client for 30 sec - exiting 06:24:53 (8076): No heartbeat from core client for 30 sec - exiting 06:24:54 (8076): No heartbeat from core client for 30 sec - exiting 06:24:55 (8076): No heartbeat from core client for 30 sec - exiting 06:24:56 (8076): No heartbeat from core client for 30 sec - exiting 06:24:57 (8076): No heartbeat from core client for 30 sec - exiting 06:24:58 (8076): No heartbeat from core client for 30 sec - exiting 06:24:59 (8076): No heartbeat from core client for 30 sec - exiting 06:25:00 (8076): No heartbeat from core client for 30 sec - exiting 06:25:01 (8076): No heartbeat from core client for 30 sec - exiting 06:25:02 (8076): No heartbeat from core client for 30 sec - exiting 06:25:03 (8076): No heartbeat from core client for 30 sec - exiting 06:25:04 (8076): No heartbeat from core client for 30 sec - exiting 06:25:05 (8076): No heartbeat from core client for 30 sec - exiting 06:25:06 (8076): No heartbeat from core client for 30 sec - exiting 06:25:07 (8076): No heartbeat from core client for 30 sec - exiting 06:25:08 (8076): No heartbeat from core client for 30 sec - exiting 06:25:09 (8076): No heartbeat from core client for 30 sec - exiting 06:25:10 (8076): No heartbeat from core client for 30 sec - exiting 06:25:11 (8076): No heartbeat from core client for 30 sec - exiting 06:25:12 (8076): No heartbeat from core client for 30 sec - exiting 06:25:13 (8076): No heartbeat from core client for 30 sec - exiting 06:25:14 (8076): No heartbeat from core client for 30 sec - exiting 06:25:15 (8076): No heartbeat from core client for 30 sec - exiting 06:25:16 (8076): No heartbeat from core client for 30 sec - exiting 06:25:17 (8076): No heartbeat from core client for 30 sec - exiting 06:25:18 (8076): No heartbeat from core client for 30 sec - exiting 06:25:19 (8076): No heartbeat from core client for 30 sec - exiting 06:25:20 (8076): No heartbeat from core client for 30 sec - exiting 06:25:21 (8076): No heartbeat from core client for 30 sec - exiting 06:25:22 (8076): No heartbeat from core client for 30 sec - exiting 06:25:23 (8076): No heartbeat from core client for 30 sec - exiting 06:25:24 (8076): No heartbeat from core client for 30 sec - exiting 06:25:25 (8076): No heartbeat from core client for 30 sec - exiting 06:25:26 (8076): No heartbeat from core client for 30 sec - exiting 06:25:27 (8076): No heartbeat from core client for 30 sec - exiting 06:25:28 (8076): No heartbeat from core client for 30 sec - exiting 06:25:29 (8076): No heartbeat from core client for 30 sec - exiting 06:25:30 (8076): No heartbeat from core client for 30 sec - exiting 06:25:31 (8076): No heartbeat from core client for 30 sec - exiting 06:25:32 (8076): No heartbeat from core client for 30 sec - exiting 06:25:33 (8076): No heartbeat from core client for 30 sec - exiting 06:25:34 (8076): No heartbeat from core client for 30 sec - exiting 06:25:35 (8076): No heartbeat from core client for 30 sec - exiting 06:25:36 (8076): No heartbeat from core client for 30 sec - exiting 06:25:37 (8076): No heartbeat from core client for 30 sec - exiting 06:25:38 (8076): No heartbeat from core client for 30 sec - exiting 06:25:39 (8076): No heartbeat from core client for 30 sec - exiting 06:25:40 (8076): No heartbeat from core client for 30 sec - exiting 06:25:41 (8076): No heartbeat from core client for 30 sec - exiting 06:25:42 (8076): No heartbeat from core client for 30 sec - exiting 06:25:43 (8076): No heartbeat from core client for 30 sec - exiting 06:25:44 (8076): No heartbeat from core client for 30 sec - exiting 06:25:45 (8076): No heartbeat from core client for 30 sec - exiting 06:25:46 (8076): No heartbeat from core client for 30 sec - exiting 06:25:47 (8076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:45:40 (7940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:28 (1888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:31 (1888): No heartbeat from core client for 30 sec - exiting 07:52:32 (1888): No heartbeat from core client for 30 sec - exiting 07:52:33 (1888): No heartbeat from core client for 30 sec - exiting 07:52:34 (1888): No heartbeat from core client for 30 sec - exiting 07:52:35 (1888): No heartbeat from core client for 30 sec - exiting 07:52:36 (1888): No heartbeat from core client for 30 sec - exiting 07:55:24 (10040): No heartbeat from core client for 30 sec - exiting 07:55:25 (10040): No heartbeat from core client for 30 sec - exiting 07:55:26 (10040): No heartbeat from core client for 30 sec - exiting 07:55:27 (10040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:37 (5844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:17 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:12:17 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:02:01 (5456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Nov 2014 05:35:22	1300761	17229827	hadcm3n_s0rt_1940_40_009094162_0	103,680	109,034	1.0516
21 Oct 2014 17:13:25	1300761	17229827	hadcm3n_s0rt_1940_40_009094162_0	77,760	81,005	1.0417
21 Oct 2014 09:54:33	1300761	17229827	hadcm3n_s0rt_1940_40_009094162_0	51,840	54,986	1.0607
21 Oct 2014 02:35:26	1300761	17229827	hadcm3n_s0rt_1940_40_009094162_0	25,920	28,714	1.1078