Task 15745821

Name	hadcm3n_o14r_2140_40_008281485_3
Workunit	8432620
Created	22 Apr 2013, 4:42:28 UTC
Sent	22 Apr 2013, 4:42:34 UTC
Report deadline	22 Jul 2013, 12:09:45 UTC
Received	4 May 2013, 3:44:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1305670
Run time	8 days 19 hours 55 min 13 sec
CPU time	7 days 9 hours 29 min 39 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.82 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 10:39:40 AM No files match the supplied pattern. MainError: 10:39:40 AM No files match the supplied pattern. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6292, iMonCtr=1 Model crash detected, will try to restart... MainError: 04:46:40 PM No files match the supplied pattern. MainError: 04:46:40 PM No files match the supplied pattern. MainError: 10:49:50 PM No files match the supplied pattern. MainError: 10:49:50 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 06:06:57 AM No files match the supplied pattern. MainError: 06:06:57 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... 13:50:52 (6240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:53 (6240): No heartbeat from core client for 30 sec - exiting 13:50:54 (6240): No heartbeat from core client for 30 sec - exiting 13:50:55 (6240): No heartbeat from core client for 30 sec - exiting 13:50:56 (6240): No heartbeat from core client for 30 sec - exiting 13:50:57 (6240): No heartbeat from core client for 30 sec - exiting 13:50:58 (6240): No heartbeat from core client for 30 sec - exiting 13:50:59 (6240): No heartbeat from core client for 30 sec - exiting 13:51:00 (6240): No heartbeat from core client for 30 sec - exiting 13:51:01 (6240): No heartbeat from core client for 30 sec - exiting 13:51:02 (6240): No heartbeat from core client for 30 sec - exiting MainError: 01:04:37 PM No files match the supplied pattern. MainError: 01:04:37 PM No files match the supplied pattern. MainError: 07:02:23 PM No files match the supplied pattern. MainError: 07:02:23 PM No files match the supplied pattern. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5856, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... MainError: 01:14:00 AM No files match the supplied pattern. MainError: 01:14:00 AM No files match the supplied pattern. MainError: 08:10:11 AM No files match the supplied pattern. MainError: 08:10:11 AM No files match the supplied pattern. MainError: 02:48:31 PM No files match the supplied pattern. MainError: 02:48:31 PM No files match the supplied pattern. MainError: 09:01:57 PM No files match the supplied pattern. MainError: 09:01:57 PM No files match the supplied pattern. Error converting file to netcdf: dataout/o14rka.ph11c10 Error converting file to netcdf: dataout/o14rka.pg11c10 Error converting file to netcdf: dataout/o14rka.pe11c10 MainError: 03:02:30 AM No files match the supplied pattern. MainError: 03:02:30 AM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 May 2013 03:44:53	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	777,600	733,921	0.9438
03 May 2013 21:58:08	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	751,680	712,406	0.9478
03 May 2013 14:55:29	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	725,760	690,162	0.9510
03 May 2013 08:48:41	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	699,840	666,309	0.9521
03 May 2013 01:36:31	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	673,920	641,442	0.9518
02 May 2013 19:07:28	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	648,000	619,461	0.9560
02 May 2013 13:07:43	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	622,080	598,030	0.9613
02 May 2013 07:00:16	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	596,160	575,817	0.9659
01 May 2013 22:52:32	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	570,240	550,372	0.9652
01 May 2013 16:51:38	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	544,320	528,710	0.9713
01 May 2013 10:44:26	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	518,400	506,979	0.9780
30 Apr 2013 21:40:23	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	492,480	485,559	0.9859
30 Apr 2013 15:35:52	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	466,560	463,885	0.9943
30 Apr 2013 09:50:50	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	440,640	442,169	1.0035
30 Apr 2013 02:43:34	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	414,720	417,042	1.0056
29 Apr 2013 19:50:05	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	388,800	394,130	1.0137
29 Apr 2013 14:35:23	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	362,880	372,172	1.0256
29 Apr 2013 08:12:30	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	336,960	350,515	1.0402
28 Apr 2013 22:49:29	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	311,040	323,150	1.0389
28 Apr 2013 16:51:25	1136999	15745821	hadcm3n_o14r_2140_40_008281485_3	285,120	301,680	1.0581