climateprediction.net home page
Task 15901702

Task 15901702

Name hadcm3n_o37a_2140_40_008269566_4
Workunit 8424690
Created 22 Jul 2013, 22:06:19 UTC
Sent 22 Jul 2013, 22:20:44 UTC
Report deadline 22 Oct 2013, 5:47:55 UTC
Received 21 Aug 2013, 5:31:19 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1100148
Run time 21 days 0 hours 15 min 51 sec
CPU time 14 days 8 hours 53 min 24 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.52 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:20:41 (12873): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	01:09:40 PM	No files match the supplied pattern.
MainError:	01:09:40 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:00:08 AM	No files match the supplied pattern.
MainError:	07:00:08 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	01:18:48 AM	No files match the supplied pattern.
MainError:	01:18:48 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	08:33:47 PM	No files match the supplied pattern.
MainError:	08:33:47 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	01:48:41 PM	No files match the supplied pattern.
MainError:	01:48:41 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:09:01 AM	No files match the supplied pattern.
MainError:	07:09:01 AM	No files match the supplied pattern.
MainError:	11:39:37 PM	No files match the supplied pattern.
MainError:	11:39:37 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	10:15:59 PM	No files match the supplied pattern.
MainError:	10:15:59 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	05:09:09 PM	No files match the supplied pattern.
MainError:	05:09:09 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	10:10:12 AM	No files match the supplied pattern.
MainError:	10:10:12 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: dataout/o37aka.ph11c10
Error converting file to netcdf: dataout/o37aka.pg11c10
Error converting file to netcdf: dataout/o37aka.pe11c10
MainError:	02:29:56 AM	No files match the supplied pattern.
MainError:	02:29:56 AM	No files match the supplied pattern.

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Aug 2013 02:50:16 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 777,600 1,734,454 2.2305
20 Aug 2013 10:31:30 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 751,680 1,678,106 2.2325
19 Aug 2013 17:31:37 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 725,760 1,620,819 2.2333
18 Aug 2013 22:37:26 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 699,840 1,563,787 2.2345
17 Aug 2013 23:57:40 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 673,920 1,506,096 2.2348
17 Aug 2013 07:29:20 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 648,000 1,448,702 2.2357
16 Aug 2013 14:05:40 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 622,080 1,391,116 2.2362
15 Aug 2013 20:50:14 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 596,160 1,332,885 2.2358
15 Aug 2013 01:38:06 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 570,240 1,274,523 2.2351
14 Aug 2013 16:18:05 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 544,320 1,216,371 2.2347
14 Aug 2013 16:18:04 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 518,400 1,158,954 2.2356
14 Aug 2013 16:18:05 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 492,480 1,105,422 2.2446
14 Aug 2013 16:18:04 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 466,560 1,046,016 2.2420
14 Aug 2013 16:18:04 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 440,640 987,164 2.2403
14 Aug 2013 16:18:04 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 414,720 929,645 2.2416
14 Aug 2013 16:18:05 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 388,800 870,479 2.2389
14 Aug 2013 16:18:04 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 362,880 812,732 2.2397
14 Aug 2013 16:18:04 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 336,960 755,230 2.2413
14 Aug 2013 16:18:05 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 311,040 697,229 2.2416
14 Aug 2013 16:18:05 1100148 15901702 hadcm3n_o37a_2140_40_008269566_4 285,120 642,849 2.2547


©2024 climateprediction.net