Task 15556109

Name	hadcm3n_o2ik_2140_40_008270417_1
Workunit	8425541
Created	24 Jan 2013, 2:28:21 UTC
Sent	24 Jan 2013, 2:28:35 UTC
Report deadline	25 Apr 2013, 9:55:46 UTC
Received	14 Mar 2013, 23:22:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	895093
Run time	22 days 18 hours 30 min 17 sec
CPU time	20 days 12 hours 18 min 42 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.23 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5184, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5804, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 07:14:50 PM No files match the supplied pattern. MainError: 07:14:50 PM No files match the supplied pattern. MainError: 01:49:50 PM No files match the supplied pattern. MainError: 01:49:50 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 10:51:32 AM No files match the supplied pattern. MainError: 10:51:33 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 10:41:23 PM No files match the supplied pattern. MainError: 10:41:23 PM No files match the supplied pattern. MainError: 02:10:56 AM No files match the supplied pattern. MainError: 02:10:56 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 12:29:24 AM No files match the supplied pattern. MainError: 12:29:24 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 01:32:49 AM No files match the supplied pattern. MainError: 01:32:49 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 11:24:02 PM No files match the supplied pattern. MainError: 11:24:02 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 08:03:05 PM No files match the supplied pattern. MainError: 08:03:05 PM No files match the supplied pattern. MainError: 03:27:49 PM No files match the supplied pattern. MainError: 03:27:49 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: dataout/o2ikka.ph11c10 Error converting file to netcdf: dataout/o2ikka.pg11c10 Error converting file to netcdf: dataout/o2ikka.pe11c10 MainError: 08:30:04 PM No files match the supplied pattern. MainError: 08:30:04 PM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Mar 2013 20:53:55	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	777,600	1,830,237	2.3537
13 Mar 2013 15:30:32	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	751,680	1,765,029	2.3481
12 Mar 2013 20:39:42	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	725,760	1,697,685	2.3392
10 Mar 2013 23:54:57	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	699,840	1,630,199	2.3294
10 Mar 2013 02:04:57	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	673,920	1,555,210	2.3077
09 Mar 2013 01:20:37	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	648,000	1,482,638	2.2880
06 Mar 2013 02:34:23	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	622,080	1,403,428	2.2560
04 Mar 2013 22:57:50	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	596,160	1,308,266	2.1945
03 Mar 2013 11:36:29	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	570,240	1,227,997	2.1535
28 Feb 2013 13:50:08	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	544,320	1,150,141	2.1130
27 Feb 2013 19:21:45	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	518,400	1,085,711	2.0943
26 Feb 2013 20:01:25	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	492,480	1,010,585	2.0520
25 Feb 2013 19:54:14	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	466,560	937,903	2.0103
24 Feb 2013 21:49:30	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	440,640	865,641	1.9645
24 Feb 2013 01:42:35	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	414,720	799,530	1.9279
22 Feb 2013 22:29:45	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	388,800	731,522	1.8815
22 Feb 2013 00:55:18	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	362,880	663,060	1.8272
21 Feb 2013 05:13:53	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	336,960	595,017	1.7658
20 Feb 2013 10:58:31	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	311,040	533,128	1.7140
19 Feb 2013 17:52:08	895093	15556109	hadcm3n_o2ik_2140_40_008270417_1	285,120	471,742	1.6545