climateprediction.net home page
Task 16067888

Task 16067888

Name hadcm3n_oa95_1900_40_008468412_3
Workunit 8619251
Created 15 Oct 2013, 9:01:16 UTC
Sent 15 Oct 2013, 9:02:03 UTC
Report deadline 14 Jan 2014, 16:29:14 UTC
Received 8 Nov 2013, 2:53:49 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1296978
Run time 13 days 1 hours 0 min 5 sec
CPU time 12 days 8 hours 56 min 4 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.67 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 62 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/oa95ko.pjc0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ko.pjc0c10
Error: Input file: dataout/oa95ko.pic0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ko.pic0c10
Error: Input file: dataout/oa95ko.pfc0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ko.pfc0c10
Error: Input file: dataout/oa95ko.pcc0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ko.pcc0c10
Error: Input file: dataout/oa95ko.pbc0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ko.pbc0c10
Error: Input file: dataout/oa95ko.pac0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ko.pac0c10
Error: Input file: dataout/oa95ka.phc0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ka.phc0c10
Error: Input file: dataout/oa95ka.pgc0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ka.pgc0c10
Error: Input file: dataout/oa95ka.pec0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ka.pec0c10
Error: Input file: dataout/oa95ka.pdc0c10 is not a valid UM file.
Error converting file to netcdf: dataout/oa95ka.pdc0c10
02:52:25 (5079): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_oa95_1900_40_008468412/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Nov 2013 02:55:41 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 518,400 1,068,986 2.0621
05 Nov 2013 21:18:49 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 492,480 1,011,242 2.0534
03 Nov 2013 20:09:39 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 466,560 955,604 2.0482
01 Nov 2013 21:53:53 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 440,640 903,852 2.0512
31 Oct 2013 00:21:19 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 414,720 850,801 2.0515
28 Oct 2013 22:38:06 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 388,800 794,778 2.0442
24 Oct 2013 11:00:37 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 362,880 740,188 2.0398
23 Oct 2013 20:01:21 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 336,960 689,164 2.0452
23 Oct 2013 05:00:31 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 311,040 638,044 2.0513
22 Oct 2013 12:29:26 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 285,120 581,435 2.0393
21 Oct 2013 20:38:02 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 259,200 527,028 2.0333
21 Oct 2013 05:02:33 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 233,280 474,154 2.0326
20 Oct 2013 14:27:50 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 207,360 423,925 2.0444
19 Oct 2013 23:14:45 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 181,440 371,851 2.0494
19 Oct 2013 06:54:52 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 155,520 316,078 2.0324
18 Oct 2013 14:36:52 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 129,600 259,937 2.0057
17 Oct 2013 21:25:29 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 103,680 206,458 1.9913
17 Oct 2013 04:56:33 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 77,760 151,076 1.9428
16 Oct 2013 14:17:48 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 51,840 100,575 1.9401
15 Oct 2013 23:34:58 1296978 16067888 hadcm3n_oa95_1900_40_008468412_3 25,920 49,808 1.9216


©2024 cpdn.org