climateprediction.net home page
Task 15775754

Task 15775754

Name hadcm3n_zefh_1960_40_008365729_0
Workunit 8516588
Created 11 May 2013, 2:19:48 UTC
Sent 11 May 2013, 2:24:28 UTC
Report deadline 10 Aug 2013, 9:51:39 UTC
Received 10 Jun 2013, 19:46:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1186368
Run time 29 days 16 hours 45 min
CPU time 26 days 8 hours 27 min 26 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.27 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.64</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
03:13:42 (4392): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:13:13 (6652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:58:49 (6544): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:26:13 (5812): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:48:48 (8144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:18:43 (7240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:49:04 (8376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:40:40 (8964): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:54:05 (2828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:19:56 (4244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:24:33 (3564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:50:04 (6096): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:26:03 (6288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:29:36 (7092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:30:19 (4744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:47:06 (4572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:34:49 (6368): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:44:51 (292): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:53:43 (6984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:22:13 (6720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:03:47 (4132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:40:27 (8752): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:37:48 (6712): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:36:42 (5752): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:38:00 (6064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
02:27:34 (3320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:28:15 (5844): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:47:08 (1972): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:02:00 (3816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:03:25 (3112): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:05:10 (5028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:02:28 (5916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:01:06 (484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:20:47 (4280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:20:48 (4280): No heartbeat from core client for 30 sec - exiting
02:07:29 (4824): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:43:54 (3992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:45:25 (552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:26:45 (6572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:59:12 (7100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:55:20 (2328): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:55:21 (2328): No heartbeat from core client for 30 sec - exiting
04:27:57 (6528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:27:59 (6528): No heartbeat from core client for 30 sec - exiting
03:13:49 (4452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
22:50:12 (3064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:58:36 (1120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:56:23 (6476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5188, iMonCtr=1
Model crash detected, will try to restart...
08:49:02 (752): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:50:11 (4844): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:53:05 (732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:15:52 (3196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:18:19 (5004): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
16:45:52 (6484): No heartbeat from core client for 30 sec - exiting
16:45:53 (6484): No heartbeat from core client for 30 sec - exiting
16:45:54 (6484): No heartbeat from core client for 30 sec - exiting
16:45:55 (6484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:45:56 (6484): No heartbeat from core client for 30 sec - exiting
16:45:57 (6484): No heartbeat from core client for 30 sec - exiting
16:45:58 (6484): No heartbeat from core client for 30 sec - exiting
16:45:59 (6484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
05:54:15 (4528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
BUFFIN: C I/O Error feof - Unit 62 - Return code = 16
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/zefhko.pjj0c10
Error converting file to netcdf: dataout/zefhko.pij0c10
Error converting file to netcdf: dataout/zefhko.pfj0c10
Error converting file to netcdf: dataout/zefhko.pcj0c10
Error converting file to netcdf: dataout/zefhko.pbj0c10
Error converting file to netcdf: dataout/zefhko.paj0c10
Error converting file to netcdf: dataout/zefhka.phj0c10
Error converting file to netcdf: dataout/zefhka.pgj0c10
Error converting file to netcdf: dataout/zefhka.pej0c10
Error converting file to netcdf: dataout/zefhka.pdj0c10
CPDN Monitor - Quit request from BOINC...

zip error: Could not create output file (was replacing the original zip file)
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zefh_1960_40_008365729/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Jun 2013 10:03:21 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 777,600 2,276,748 2.9279
10 Jun 2013 00:03:55 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 751,680 2,202,156 2.9296
08 Jun 2013 14:16:00 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 725,760 2,127,616 2.9316
07 Jun 2013 14:53:14 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 699,840 2,052,445 2.9327
06 Jun 2013 14:26:03 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 673,920 1,977,461 2.9343
05 Jun 2013 14:58:03 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 648,000 1,902,184 2.9355
04 Jun 2013 14:47:33 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 622,080 1,825,673 2.9348
03 Jun 2013 15:34:15 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 596,160 1,750,491 2.9363
02 Jun 2013 16:21:44 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 570,240 1,674,828 2.9371
01 Jun 2013 14:21:35 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 544,320 1,596,519 2.9331
31 May 2013 12:17:38 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 518,400 1,519,660 2.9314
30 May 2013 06:53:23 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 492,480 1,443,104 2.9303
29 May 2013 05:11:39 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 466,560 1,366,149 2.9281
27 May 2013 23:09:54 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 440,640 1,289,842 2.9272
26 May 2013 21:39:30 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 414,720 1,212,166 2.9229
25 May 2013 22:26:57 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 388,800 1,135,989 2.9218
24 May 2013 20:21:36 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 362,880 1,059,396 2.9194
23 May 2013 19:46:45 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 336,960 983,377 2.9184
22 May 2013 20:01:53 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 311,040 906,063 2.9130
21 May 2013 20:57:54 1186368 15775754 hadcm3n_zefh_1960_40_008365729_0 285,120 829,998 2.9110


©2024 cpdn.org