Task 13419285

Name	hadcm3n_t6zb_1940_40_007461821_2
Workunit	7659324
Created	25 Sep 2011, 1:14:33 UTC
Sent	25 Sep 2011, 1:15:03 UTC
Report deadline	25 Dec 2011, 8:42:14 UTC
Received	25 Oct 2011, 15:08:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1100678
Run time	4 days 2 hours 14 min 13 sec
CPU time	3 days 19 hours 16 min 45 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	3.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t6zbko.pje1c10 Error converting file to netcdf: dataout/t6zbko.pie1c10 Error converting file to netcdf: dataout/t6zbko.pfe1c10 Error converting file to netcdf: dataout/t6zbka.phe1c10 Error converting file to netcdf: dataout/t6zbka.pge1c10 Error converting file to netcdf: dataout/t6zbka.pee1c10 Error converting file to netcdf: dataout/t6zbka.pde1c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:18:59 (5608): No heartbeat from core client for 30 sec - exiting 07:19:02 (5608): No heartbeat from core client for 30 sec - exiting 07:19:03 (5608): No heartbeat from core client for 30 sec - exiting 07:19:04 (5608): No heartbeat from core client for 30 sec - exiting 07:19:05 (5608): No heartbeat from core client for 30 sec - exiting 07:19:06 (5608): No heartbeat from core client for 30 sec - exiting 07:19:07 (5608): No heartbeat from core client for 30 sec - exiting 07:19:08 (5608): No heartbeat from core client for 30 sec - exiting 07:19:09 (5608): No heartbeat from core client for 30 sec - exiting 07:19:10 (5608): No heartbeat from core client for 30 sec - exiting 07:19:11 (5608): No heartbeat from core client for 30 sec - exiting 07:19:12 (5608): No heartbeat from core client for 30 sec - exiting 07:19:13 (5608): No heartbeat from core client for 30 sec - exiting 07:19:14 (5608): No heartbeat from core client for 30 sec - exiting 07:19:15 (5608): No heartbeat from core client for 30 sec - exiting 07:19:16 (5608): No heartbeat from core client for 30 sec - exiting 07:19:17 (5608): No heartbeat from core client for 30 sec - exiting 07:19:18 (5608): No heartbeat from core client for 30 sec - exiting 07:19:19 (5608): No heartbeat from core client for 30 sec - exiting 07:19:20 (5608): No heartbeat from core client for 30 sec - exiting 07:19:21 (5608): No heartbeat from core client for 30 sec - exiting 07:19:22 (5608): No heartbeat from core client for 30 sec - exiting 07:19:23 (5608): No heartbeat from core client for 30 sec - exiting 07:19:24 (5608): No heartbeat from core client for 30 sec - exiting 07:19:25 (5608): No heartbeat from core client for 30 sec - exiting 07:19:26 (5608): No heartbeat from core client for 30 sec - exiting 07:19:27 (5608): No heartbeat from core client for 30 sec - exiting 07:19:28 (5608): No heartbeat from core client for 30 sec - exiting 07:19:29 (5608): No heartbeat from core client for 30 sec - exiting 07:19:30 (5608): No heartbeat from core client for 30 sec - exiting 07:19:31 (5608): No heartbeat from core client for 30 sec - exiting 07:19:32 (5608): No heartbeat from core client for 30 sec - exiting 07:19:33 (5608): No heartbeat from core client for 30 sec - exiting 07:19:34 (5608): No heartbeat from core client for 30 sec - exiting 07:19:35 (5608): No heartbeat from core client for 30 sec - exiting 07:19:36 (5608): No heartbeat from core client for 30 sec - exiting 07:19:37 (5608): No heartbeat from core client for 30 sec - exiting 07:19:38 (5608): No heartbeat from core client for 30 sec - exiting 07:19:39 (5608): No heartbeat from core client for 30 sec - exiting 07:19:40 (5608): No heartbeat from core client for 30 sec - exiting 07:19:41 (5608): No heartbeat from core client for 30 sec - exiting 07:19:42 (5608): No heartbeat from core client for 30 sec - exiting 07:19:43 (5608): No heartbeat from core client for 30 sec - exiting 07:19:44 (5608): No heartbeat from core client for 30 sec - exiting 07:19:45 (5608): No heartbeat from core client for 30 sec - exiting 07:19:46 (5608): No heartbeat from core client for 30 sec - exiting 07:19:47 (5608): No heartbeat from core client for 30 sec - exiting 07:19:48 (5608): No heartbeat from core client for 30 sec - exiting 07:19:49 (5608): No heartbeat from core client for 30 sec - exiting 07:19:50 (5608): No heartbeat from core client for 30 sec - exiting 07:19:51 (5608): No heartbeat from core client for 30 sec - exiting 07:19:52 (5608): No heartbeat from core client for 30 sec - exiting 07:19:53 (5608): No heartbeat from core client for 30 sec - exiting 07:19:54 (5608): No heartbeat from core client for 30 sec - exiting 07:19:55 (5608): No heartbeat from core client for 30 sec - exiting 07:19:56 (5608): No heartbeat from core client for 30 sec - exiting 07:19:57 (5608): No heartbeat from core client for 30 sec - exiting 07:19:58 (5608): No heartbeat from core client for 30 sec - exiting 07:19:59 (5608): No heartbeat from core client for 30 sec - exiting 07:20:00 (5608): No heartbeat from core client for 30 sec - exiting 07:20:01 (5608): No heartbeat from core client for 30 sec - exiting 07:20:02 (5608): No heartbeat from core client for 30 sec - exiting 07:20:03 (5608): No heartbeat from core client for 30 sec - exiting 07:20:04 (5608): No heartbeat from core client for 30 sec - exiting 07:20:05 (5608): No heartbeat from core client for 30 sec - exiting 07:20:06 (5608): No heartbeat from core client for 30 sec - exiting 07:20:07 (5608): No heartbeat from core client for 30 sec - exiting 07:20:08 (5608): No heartbeat from core client for 30 sec - exiting 07:20:09 (5608): No heartbeat from core client for 30 sec - exiting 07:20:10 (5608): No heartbeat from core client for 30 sec - exiting 07:20:11 (5608): No heartbeat from core client for 30 sec - exiting 07:20:12 (5608): No heartbeat from core client for 30 sec - exiting 07:20:13 (5608): No heartbeat from core client for 30 sec - exiting 07:20:14 (5608): No heartbeat from core client for 30 sec - exiting 07:20:15 (5608): No heartbeat from core client for 30 sec - exiting 07:20:16 (5608): No heartbeat from core client for 30 sec - exiting 07:20:17 (5608): No heartbeat from core client for 30 sec - exiting 07:20:18 (5608): No heartbeat from core client for 30 sec - exiting 07:20:19 (5608): No heartbeat from core client for 30 sec - exiting 07:20:20 (5608): No heartbeat from core client for 30 sec - exiting 07:20:21 (5608): No heartbeat from core client for 30 sec - exiting 07:20:22 (5608): No heartbeat from core client for 30 sec - exiting 07:20:23 (5608): No heartbeat from core client for 30 sec - exiting 07:20:24 (5608): No heartbeat from core client for 30 sec - exiting 07:20:25 (5608): No heartbeat from core client for 30 sec - exiting 07:20:26 (5608): No heartbeat from core client for 30 sec - exiting 07:20:27 (5608): No heartbeat from core client for 30 sec - exiting 07:20:28 (5608): No heartbeat from core client for 30 sec - exiting 07:20:29 (5608): No heartbeat from core client for 30 sec - exiting 07:20:30 (5608): No heartbeat from core client for 30 sec - exiting 07:20:31 (5608): No heartbeat from core client for 30 sec - exiting 07:20:32 (5608): No heartbeat from core client for 30 sec - exiting 07:20:33 (5608): No heartbeat from core client for 30 sec - exiting 07:20:34 (5608): No heartbeat from core client for 30 sec - exiting 07:20:35 (5608): No heartbeat from core client for 30 sec - exiting 07:20:36 (5608): No heartbeat from core client for 30 sec - exiting 07:20:37 (5608): No heartbeat from core client for 30 sec - exiting 07:20:38 (5608): No heartbeat from core client for 30 sec - exiting 07:20:39 (5608): No heartbeat from core client for 30 sec - exiting 07:20:40 (5608): No heartbeat from core client for 30 sec - exiting 07:20:41 (5608): No heartbeat from core client for 30 sec - exiting 07:20:42 (5608): No heartbeat from core client for 30 sec - exiting 07:20:43 (5608): No heartbeat from core client for 30 sec - exiting 07:20:44 (5608): No heartbeat from core client for 30 sec - exiting 07:20:45 (5608): No heartbeat from core client for 30 sec - exiting 07:20:46 (5608): No heartbeat from core client for 30 sec - exiting 07:20:47 (5608): No heartbeat from core client for 30 sec - exiting 07:20:48 (5608): No heartbeat from core client for 30 sec - exiting 07:20:49 (5608): No heartbeat from core client for 30 sec - exiting 07:20:50 (5608): No heartbeat from core client for 30 sec - exiting 07:20:51 (5608): No heartbeat from core client for 30 sec - exiting 07:20:52 (5608): No heartbeat from core client for 30 sec - exiting 07:20:53 (5608): No heartbeat from core client for 30 sec - exiting 07:20:54 (5608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Oct 2011 22:53:22	1100678	13419285	hadcm3n_t6zb_1940_40_007461821_2	207,360	322,541	1.5555
17 Oct 2011 05:53:20	1100678	13419285	hadcm3n_t6zb_1940_40_007461821_2	181,440	282,773	1.5585
16 Oct 2011 04:28:47	1100678	13419285	hadcm3n_t6zb_1940_40_007461821_2	155,520	242,509	1.5593
11 Oct 2011 09:43:13	1100678	13419285	hadcm3n_t6zb_1940_40_007461821_2	129,600	203,054	1.5668
02 Oct 2011 07:14:29	1100678	13419285	hadcm3n_t6zb_1940_40_007461821_2	103,680	162,179	1.5642
01 Oct 2011 19:29:02	1100678	13419285	hadcm3n_t6zb_1940_40_007461821_2	77,760	121,574	1.5635
01 Oct 2011 07:07:05	1100678	13419285	hadcm3n_t6zb_1940_40_007461821_2	51,840	80,922	1.5610
30 Sep 2011 14:16:04	1100678	13419285	hadcm3n_t6zb_1940_40_007461821_2	25,920	40,377	1.5578