climateprediction.net home page
Task 15501831

Task 15501831

Name hadcm3n_o7fr_2140_40_008269057_0
Workunit 8424181
Created 23 Dec 2012, 21:49:08 UTC
Sent 25 Dec 2012, 12:06:13 UTC
Report deadline 26 Mar 2013, 19:33:24 UTC
Received 16 Feb 2013, 19:45:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1243260
Run time 12 days 10 hours 13 min 15 sec
CPU time 11 days 18 hours 50 min 39 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.04 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
06:34:49 (12436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	08:10:31 PM	No files match the supplied pattern.
MainError:	08:10:31 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:04:24 AM	No files match the supplied pattern.
MainError:	07:04:24 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:23:39 PM	No files match the supplied pattern.
MainError:	07:23:39 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	01:19:07 AM	No files match the supplied pattern.
MainError:	01:19:07 AM	No files match the supplied pattern.
MainError:	10:49:15 AM	No files match the supplied pattern.
MainError:	10:49:15 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	11:57:04 PM	No files match the supplied pattern.
MainError:	11:57:04 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:27:48 PM	No files match the supplied pattern.
MainError:	07:27:48 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	05:28:20 AM	No files match the supplied pattern.
MainError:	05:28:20 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	03:32:03 PM	No files match the supplied pattern.
MainError:	03:32:03 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	05:22:57 PM	No files match the supplied pattern.
MainError:	05:22:57 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: dataout/o7frka.ph11c10
Error converting file to netcdf: dataout/o7frka.pg11c10
Error converting file to netcdf: dataout/o7frka.pe11c10
MainError:	06:44:16 PM	No files match the supplied pattern.
MainError:	06:44:16 PM	No files match the supplied pattern.
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Feb 2013 18:50:39 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 777,600 1,018,188 1.3094
04 Feb 2013 17:26:24 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 751,680 985,207 1.3107
03 Feb 2013 15:35:54 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 725,760 952,919 1.3130
03 Feb 2013 05:31:56 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 699,840 919,990 1.3146
02 Feb 2013 19:46:20 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 673,920 886,489 1.3154
02 Feb 2013 00:03:34 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 648,000 852,993 1.3163
01 Feb 2013 10:52:15 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 622,080 819,860 1.3179
01 Feb 2013 01:30:16 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 596,160 787,026 1.3202
26 Jan 2013 20:06:46 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 570,240 752,836 1.3202
25 Jan 2013 07:05:03 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 544,320 718,414 1.3198
24 Jan 2013 20:41:50 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 518,400 682,780 1.3171
24 Jan 2013 10:46:26 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 492,480 648,171 1.3161
23 Jan 2013 23:44:27 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 466,560 613,701 1.3154
10 Jan 2013 23:07:33 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 440,640 579,452 1.3150
10 Jan 2013 13:15:17 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 414,720 545,258 1.3148
07 Jan 2013 22:44:34 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 388,800 511,391 1.3153
07 Jan 2013 11:21:34 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 362,880 477,661 1.3163
07 Jan 2013 01:19:25 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 336,960 443,542 1.3163
06 Jan 2013 15:07:31 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 311,040 409,215 1.3156
06 Jan 2013 05:20:19 1243260 15501831 hadcm3n_o7fr_2140_40_008269057_0 285,120 375,103 1.3156


©2024 cpdn.org