climateprediction.net home page
Task 15712068

Task 15712068

Name hadcm3n_o6u0_2140_40_008270235_2
Workunit 8425359
Created 6 Apr 2013, 3:08:51 UTC
Sent 6 Apr 2013, 3:53:43 UTC
Report deadline 6 Jul 2013, 11:20:54 UTC
Received 2 May 2013, 7:30:28 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1157390
Run time 24 days 17 hours 40 min 11 sec
CPU time 22 days 10 hours 45 min 58 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.39 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:51:06 (19456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
08:52:18 (22927): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
08:59:15 (22987): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:16 (23053): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:08:58 (23117): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	05:04:39 PM	No files match the supplied pattern.
MainError:	05:04:39 PM	No files match the supplied pattern.
MainError:	12:51:11 AM	No files match the supplied pattern.
MainError:	12:51:11 AM	No files match the supplied pattern.
MainError:	08:34:20 AM	No files match the supplied pattern.
MainError:	08:34:20 AM	No files match the supplied pattern.
MainError:	04:24:10 AM	No files match the supplied pattern.
MainError:	04:24:10 AM	No files match the supplied pattern.
MainError:	12:12:11 AM	No files match the supplied pattern.
MainError:	12:12:11 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	08:05:36 PM	No files match the supplied pattern.
MainError:	08:05:36 PM	No files match the supplied pattern.
22:48:47 (23181): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:51:46 (8143): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:54:23 (8203): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:07:04 (8265): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:02:32 (8325): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:03:18 (8396): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:05:07 (8456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:06:00 (8516): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:00:24 (8576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:01:37 (8644): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:34:42 (8704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:36:28 (8778): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:38:13 (8838): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:40:00 (8898): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:43:08 (8958): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:47:26 (9018): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:53:54 (9078): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:56:57 (9140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:02:20 (9200): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:04:37 (9260): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:09:31 (9320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:37 (9380): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:57:00 (9440): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:58:51 (9508): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:41:22 (9568): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:43:08 (9634): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:44:51 (9694): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:46:36 (9754): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:48:24 (9814): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:50:04 (9874): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:51:47 (9934): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:53:29 (9994): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:55:15 (10056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:56:59 (10116): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:58:45 (10176): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:00:31 (10236): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:02:15 (10296): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:03:50 (10332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:05:35 (10392): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:07:22 (10452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:09:07 (10512): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:10:52 (10572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:17:47 (10632): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:20:56 (10696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:22:35 (10756): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:24:20 (10816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:32:40 (10878): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:34:24 (10938): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:36:09 (10998): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:37:52 (11058): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:39:35 (11118): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:41:17 (11178): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:43:02 (11238): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:44:46 (11298): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:46:33 (11358): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:48:16 (11418): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:03 (11478): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:51:47 (11538): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:14:47 (11598): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:39:48 (11620): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:57:21 (11753): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
MainError:	05:52:49 PM	No files match the supplied pattern.
MainError:	05:52:49 PM	No files match the supplied pattern.
19:30:50 (11823): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:37:59 (12321): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
MainError:	01:46:29 PM	No files match the supplied pattern.
MainError:	01:46:29 PM	No files match the supplied pattern.
15:01:22 (12381): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:13:48 (13195): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:15:29 (13260): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:17:14 (13322): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
MainError:	09:34:16 AM	No files match the supplied pattern.
MainError:	09:34:16 AM	No files match the supplied pattern.
MainError:	05:08:55 AM	No files match the supplied pattern.
MainError:	05:08:55 AM	No files match the supplied pattern.
Error: Input file: dataout/o6u0ko.pjy4c10 is not a valid UM file.
Error converting file to netcdf: dataout/o6u0ko.pjy4c10
Error: Input file: dataout/o6u0ko.piy4c10 is not a valid UM file.
Error converting file to netcdf: dataout/o6u0ko.piy4c10
Error: Input file: dataout/o6u0ko.pfy4c10 is not a valid UM file.
Error converting file to netcdf: dataout/o6u0ko.pfy4c10
Error: Input file: dataout/o6u0ka.phy4c10 is not a valid UM file.
Error converting file to netcdf: dataout/o6u0ka.phy4c10
Error converting file to netcdf: dataout/o6u0ka.ph11c10
Error: Input file: dataout/o6u0ka.pgy4c10 is not a valid UM file.
Error converting file to netcdf: dataout/o6u0ka.pgy4c10
Error converting file to netcdf: dataout/o6u0ka.pg11c10
Error: Input file: dataout/o6u0ka.pey4c10 is not a valid UM file.
Error converting file to netcdf: dataout/o6u0ka.pey4c10
Error converting file to netcdf: dataout/o6u0ka.pe11c10
MainError:	12:49:38 AM	No files match the supplied pattern.
MainError:	12:49:38 AM	No files match the supplied pattern.

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
02 May 2013 00:53:34 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 777,600 2,128,272 2.7370
01 May 2013 05:12:52 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 751,680 2,057,508 2.7372
30 Apr 2013 09:40:42 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 725,760 1,987,088 2.7379
29 Apr 2013 13:50:07 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 699,840 1,916,444 2.7384
28 Apr 2013 17:55:25 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 673,920 1,845,650 2.7387
27 Apr 2013 20:06:11 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 648,000 1,775,132 2.7394
27 Apr 2013 00:15:09 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 622,080 1,703,638 2.7386
26 Apr 2013 04:26:37 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 596,160 1,632,432 2.7382
25 Apr 2013 08:36:51 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 570,240 1,561,118 2.7377
24 Apr 2013 12:51:27 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 544,320 1,490,210 2.7377
23 Apr 2013 17:06:30 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 518,400 1,419,093 2.7374
22 Apr 2013 21:19:47 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 492,480 1,347,870 2.7369
22 Apr 2013 01:26:18 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 466,560 1,276,476 2.7359
21 Apr 2013 05:36:13 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 440,640 1,205,258 2.7352
20 Apr 2013 09:59:18 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 414,720 1,134,491 2.7356
19 Apr 2013 14:15:29 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 388,800 1,063,592 2.7356
18 Apr 2013 18:40:34 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 362,880 993,176 2.7369
17 Apr 2013 23:06:10 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 336,960 922,841 2.7387
17 Apr 2013 03:30:02 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 311,040 852,223 2.7399
16 Apr 2013 07:54:25 1157390 15712068 hadcm3n_o6u0_2140_40_008270235_2 285,120 781,735 2.7418


©2024 climateprediction.net