Task 15612702

Name	hadcm3n_o4w9_2140_40_008269412_3
Workunit	8424536
Created	18 Feb 2013, 22:15:14 UTC
Sent	18 Feb 2013, 22:15:45 UTC
Report deadline	21 May 2013, 5:42:56 UTC
Received	28 Feb 2013, 11:15:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1305670
Run time	8 days 18 hours 14 min 30 sec
CPU time	8 days 8 hours 39 min 44 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14420, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 01:24:08 PM No files match the supplied pattern. MainError: 01:24:08 PM No files match the supplied pattern. MainError: 07:27:50 PM No files match the supplied pattern. MainError: 07:27:50 PM No files match the supplied pattern. MainError: 01:25:45 AM No files match the supplied pattern. MainError: 01:25:45 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 10:46:47 AM No files match the supplied pattern. MainError: 10:46:47 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 04:51:05 PM No files match the supplied pattern. MainError: 04:51:05 PM No files match the supplied pattern. MainError: 10:50:12 PM No files match the supplied pattern. MainError: 10:50:12 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 06:47:57 AM No files match the supplied pattern. MainError: 06:47:57 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 01:28:10 PM No files match the supplied pattern. MainError: 01:28:10 PM No files match the supplied pattern. MainError: 07:36:11 PM No files match the supplied pattern. MainError: 07:36:11 PM No files match the supplied pattern. MainError: 01:38:17 AM No files match the supplied pattern. MainError: 01:38:17 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/o4w9ka.ph11c10 Error converting file to netcdf: dataout/o4w9ka.pg11c10 Error converting file to netcdf: dataout/o4w9ka.pe11c10 MainError: 10:23:55 AM No files match the supplied pattern. MainError: 10:23:55 AM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Feb 2013 11:18:20	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	777,600	726,158	0.9338
28 Feb 2013 02:11:00	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	751,680	698,291	0.9290
27 Feb 2013 20:12:30	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	725,760	676,693	0.9324
27 Feb 2013 14:00:18	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	699,840	654,804	0.9356
27 Feb 2013 07:31:31	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	673,920	631,966	0.9377
26 Feb 2013 23:14:26	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	648,000	606,097	0.9353
26 Feb 2013 17:16:22	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	622,080	584,677	0.9399
26 Feb 2013 11:41:11	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	596,160	563,061	0.9445
26 Feb 2013 01:58:00	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	570,240	534,153	0.9367
25 Feb 2013 19:59:30	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	544,320	512,731	0.9420
25 Feb 2013 13:56:30	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	518,400	491,000	0.9471
25 Feb 2013 06:13:53	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	492,480	466,947	0.9482
24 Feb 2013 22:25:11	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	466,560	441,395	0.9461
24 Feb 2013 16:21:34	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	440,640	419,832	0.9528
24 Feb 2013 11:06:19	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	414,720	398,418	0.9607
24 Feb 2013 01:27:27	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	388,800	369,724	0.9509
23 Feb 2013 19:41:48	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	362,880	348,183	0.9595
23 Feb 2013 13:20:14	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	336,960	326,421	0.9687
23 Feb 2013 07:01:47	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	311,040	302,836	0.9736
22 Feb 2013 22:54:53	1136999	15612702	hadcm3n_o4w9_2140_40_008269412_3	285,120	276,844	0.9710