climateprediction.net home page
Task 15502331

Task 15502331

Name hadcm3n_o1mx_2140_40_008269495_0
Workunit 8424619
Created 23 Dec 2012, 23:11:25 UTC
Sent 23 Dec 2012, 23:25:09 UTC
Report deadline 25 Mar 2013, 6:52:20 UTC
Received 13 Feb 2013, 3:42:37 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 973551
Run time 15 days 18 hours 56 min 28 sec
CPU time 11 days 17 hours 25 min 32 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.86 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.60</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:20:15 (876): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
20:20:18 (876): No heartbeat from core client for 30 sec - exiting
20:20:19 (876): No heartbeat from core client for 30 sec - exiting
20:20:20 (876): No heartbeat from core client for 30 sec - exiting
20:20:21 (876): No heartbeat from core client for 30 sec - exiting
20:20:22 (876): No heartbeat from core client for 30 sec - exiting
20:20:23 (876): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:34:59 (700): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
08:35:03 (700): No heartbeat from core client for 30 sec - exiting
08:35:04 (700): No heartbeat from core client for 30 sec - exiting
08:35:05 (700): No heartbeat from core client for 30 sec - exiting
08:35:06 (700): No heartbeat from core client for 30 sec - exiting
08:35:07 (700): No heartbeat from core client for 30 sec - exiting
08:35:08 (700): No heartbeat from core client for 30 sec - exiting
08:35:09 (700): No heartbeat from core client for 30 sec - exiting
08:35:10 (700): No heartbeat from core client for 30 sec - exiting
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/o1mxko.pjz3c10
Error converting file to netcdf: dataout/o1mxko.piz3c10
Error converting file to netcdf: dataout/o1mxko.pfz3c10
Error converting file to netcdf: dataout/o1mxka.phz3c10
Error converting file to netcdf: dataout/o1mxka.pgz3c10
Error converting file to netcdf: dataout/o1mxka.pez3c10
Error converting file to netcdf: dataout/o1mxka.pdz3c10
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:06:57 (3816): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
20:07:00 (3816): No heartbeat from core client for 30 sec - exiting
20:07:01 (3816): No heartbeat from core client for 30 sec - exiting
20:07:02 (3816): No heartbeat from core client for 30 sec - exiting
20:07:03 (3816): No heartbeat from core client for 30 sec - exiting
20:07:04 (3816): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	08:49:39 PM	No files match the supplied pattern.
MainError:	08:49:39 PM	No files match the supplied pattern.
MainError:	08:46:44 AM	No files match the supplied pattern.
MainError:	08:46:44 AM	No files match the supplied pattern.
MainError:	10:05:40 PM	No files match the supplied pattern.
MainError:	10:05:40 PM	No files match the supplied pattern.
MainError:	02:42:24 PM	No files match the supplied pattern.
MainError:	02:42:24 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	12:49:43 AM	No files match the supplied pattern.
MainError:	12:49:43 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	12:42:07 AM	No files match the supplied pattern.
MainError:	12:42:07 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	02:17:19 AM	No files match the supplied pattern.
MainError:	02:17:19 AM	No files match the supplied pattern.
03:30:27 (3656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:28 (3656): No heartbeat from core client for 30 sec - exiting
03:30:29 (3656): No heartbeat from core client for 30 sec - exiting
MainError:	12:09:06 AM	No files match the supplied pattern.
MainError:	12:09:06 AM	No files match the supplied pattern.
MainError:	09:49:15 PM	No files match the supplied pattern.
MainError:	09:49:15 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
19:32:48 (2132): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
19:32:50 (2132): No heartbeat from core client for 30 sec - exiting
19:32:51 (2132): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:32:58 (4060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:32:59 (4060): No heartbeat from core client for 30 sec - exiting
21:33:55 (3136): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:34:58 (1120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:59:56 (3320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:59:57 (3320): No heartbeat from core client for 30 sec - exiting
02:46:40 (4028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:46:41 (4028): No heartbeat from core client for 30 sec - exiting
MainError:	10:10:39 AM	No files match the supplied pattern.
MainError:	10:10:39 AM	No files match the supplied pattern.
06:21:32 (3280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:20:25 (2952): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:20:26 (2952): No heartbeat from core client for 30 sec - exiting
10:21:14 (3944): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:49:34 (604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:49:35 (604): No heartbeat from core client for 30 sec - exiting
10:50:21 (3004): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: dataout/o1mxka.ph11c10
Error converting file to netcdf: dataout/o1mxka.pg11c10
Error converting file to netcdf: dataout/o1mxka.pe11c10
MainError:	02:17:11 AM	No files match the supplied pattern.
MainError:	02:17:11 AM	No files match the supplied pattern.
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Feb 2013 02:40:05 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 777,600 1,027,570 1.3215
12 Feb 2013 10:30:00 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 751,680 992,625 1.3205
08 Feb 2013 21:53:34 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 725,760 958,637 1.3209
08 Feb 2013 12:13:17 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 699,840 924,756 1.3214
08 Feb 2013 02:19:33 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 673,920 890,615 1.3215
07 Feb 2013 12:45:24 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 648,000 856,883 1.3224
05 Feb 2013 12:50:13 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 622,080 822,074 1.3215
03 Feb 2013 14:45:43 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 596,160 788,302 1.3223
02 Feb 2013 22:09:31 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 570,240 754,910 1.3238
02 Feb 2013 08:50:40 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 544,320 721,289 1.3251
01 Feb 2013 20:51:43 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 518,400 687,616 1.3264
01 Feb 2013 08:01:42 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 492,480 653,766 1.3275
31 Jan 2013 18:36:41 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 466,560 618,006 1.3246
31 Jan 2013 06:50:19 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 440,640 583,284 1.3237
30 Jan 2013 19:31:29 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 414,720 549,245 1.3244
30 Jan 2013 07:17:57 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 388,800 513,422 1.3205
29 Jan 2013 19:11:12 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 362,880 478,690 1.3191
22 Jan 2013 09:45:41 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 336,960 444,052 1.3178
21 Jan 2013 12:01:56 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 311,040 408,823 1.3144
20 Jan 2013 20:11:41 973551 15502331 hadcm3n_o1mx_2140_40_008269495_0 285,120 373,771 1.3109


©2024 cpdn.org