climateprediction.net home page
Task 13363719

Task 13363719

Name hadcm3n_o41y_1980_40_007449452_0
Workunit 7646955
Created 10 Sep 2011, 0:17:49 UTC
Sent 10 Sep 2011, 0:21:50 UTC
Report deadline 10 Dec 2011, 7:49:01 UTC
Received 1 Jan 2012, 22:15:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 4681
Run time 79 days 19 hours 19 min 52 sec
CPU time 72 days 15 hours 47 min 36 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 1.37 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.18</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
21:03:09 (2408): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:55:40 (940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:02:53 (3820): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:42:16 (4084): No heartbeat from core client for 30 sec - exiting
21:42:17 (4084): No heartbeat from core client for 30 sec - exiting
21:42:18 (4084): No heartbeat from core client for 30 sec - exiting
21:42:19 (4084): No heartbeat from core client for 30 sec - exiting
21:42:20 (4084): No heartbeat from core client for 30 sec - exiting
21:42:21 (4084): No heartbeat from core client for 30 sec - exiting
21:42:22 (4084): No heartbeat from core client for 30 sec - exiting
21:42:23 (4084): No heartbeat from core client for 30 sec - exiting
21:42:24 (4084): No heartbeat from core client for 30 sec - exiting
21:42:25 (4084): No heartbeat from core client for 30 sec - exiting
21:42:26 (4084): No heartbeat from core client for 30 sec - exiting
21:42:27 (4084): No heartbeat from core client for 30 sec - exiting
21:42:28 (4084): No heartbeat from core client for 30 sec - exiting
21:42:29 (4084): No heartbeat from core client for 30 sec - exiting
21:42:30 (4084): No heartbeat from core client for 30 sec - exiting
21:42:31 (4084): No heartbeat from core client for 30 sec - exiting
21:42:32 (4084): No heartbeat from core client for 30 sec - exiting
21:42:33 (4084): No heartbeat from core client for 30 sec - exiting
21:42:34 (4084): No heartbeat from core client for 30 sec - exiting
21:42:35 (4084): No heartbeat from core client for 30 sec - exiting
21:42:36 (4084): No heartbeat from core client for 30 sec - exiting
21:42:37 (4084): No heartbeat from core client for 30 sec - exiting
21:42:38 (4084): No heartbeat from core client for 30 sec - exiting
21:42:39 (4084): No heartbeat from core client for 30 sec - exiting
21:42:40 (4084): No heartbeat from core client for 30 sec - exiting
21:42:41 (4084): No heartbeat from core client for 30 sec - exiting
21:42:42 (4084): No heartbeat from core client for 30 sec - exiting
21:42:43 (4084): No heartbeat from core client for 30 sec - exiting
21:42:44 (4084): No heartbeat from core client for 30 sec - exiting
21:42:45 (4084): No heartbeat from core client for 30 sec - exiting
21:42:46 (4084): No heartbeat from core client for 30 sec - exiting
21:42:47 (4084): No heartbeat from core client for 30 sec - exiting
21:42:48 (4084): No heartbeat from core client for 30 sec - exiting
21:42:49 (4084): No heartbeat from core client for 30 sec - exiting
21:42:50 (4084): No heartbeat from core client for 30 sec - exiting
21:42:51 (4084): No heartbeat from core client for 30 sec - exiting
21:42:52 (4084): No heartbeat from core client for 30 sec - exiting
21:42:53 (4084): No heartbeat from core client for 30 sec - exiting
21:42:54 (4084): No heartbeat from core client for 30 sec - exiting
21:42:55 (4084): No heartbeat from core client for 30 sec - exiting
21:42:56 (4084): No heartbeat from core client for 30 sec - exiting
21:42:57 (4084): No heartbeat from core client for 30 sec - exiting
21:42:58 (4084): No heartbeat from core client for 30 sec - exiting
21:42:59 (4084): No heartbeat from core client for 30 sec - exiting
21:43:01 (4084): No heartbeat from core client for 30 sec - exiting
21:43:02 (4084): No heartbeat from core client for 30 sec - exiting
21:43:03 (4084): No heartbeat from core client for 30 sec - exiting
21:43:04 (4084): No heartbeat from core client for 30 sec - exiting
21:43:05 (4084): No heartbeat from core client for 30 sec - exiting
21:43:06 (4084): No heartbeat from core client for 30 sec - exiting
21:43:07 (4084): No heartbeat from core client for 30 sec - exiting
21:43:08 (4084): No heartbeat from core client for 30 sec - exiting
21:43:09 (4084): No heartbeat from core client for 30 sec - exiting
21:43:10 (4084): No heartbeat from core client for 30 sec - exiting
21:43:11 (4084): No heartbeat from core client for 30 sec - exiting
21:43:12 (4084): No heartbeat from core client for 30 sec - exiting
21:43:13 (4084): No heartbeat from core client for 30 sec - exiting
21:43:14 (4084): No heartbeat from core client for 30 sec - exiting
21:43:15 (4084): No heartbeat from core client for 30 sec - exiting
21:43:16 (4084): No heartbeat from core client for 30 sec - exiting
21:43:17 (4084): No heartbeat from core client for 30 sec - exiting
21:43:18 (4084): No heartbeat from core client for 30 sec - exiting
21:43:19 (4084): No heartbeat from core client for 30 sec - exiting
21:43:20 (4084): No heartbeat from core client for 30 sec - exiting
21:43:21 (4084): No heartbeat from core client for 30 sec - exiting
21:43:22 (4084): No heartbeat from core client for 30 sec - exiting
21:43:23 (4084): No heartbeat from core client for 30 sec - exiting
21:43:24 (4084): No heartbeat from core client for 30 sec - exiting
21:43:25 (4084): No heartbeat from core client for 30 sec - exiting
21:43:26 (4084): No heartbeat from core client for 30 sec - exiting
21:43:27 (4084): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

zip error: Could not create output file (was replacing the original zip file)
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:27:19 (4012): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/o41yko.pjj2c10
Error converting file to netcdf: dataout/o41yko.pij2c10
Error converting file to netcdf: dataout/o41yko.pfj2c10
Error converting file to netcdf: dataout/o41yka.phj2c10
Error converting file to netcdf: dataout/o41yka.pgj2c10
Error converting file to netcdf: dataout/o41yka.pej2c10
Error converting file to netcdf: dataout/o41yka.pdj2c10
22:08:54 (2528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:52:24 (3380): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:08:50 (2528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
22:25:51 (3964): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:04:04 (3824): No heartbeat from core client for 30 sec - exiting
23:04:05 (3824): No heartbeat from core client for 30 sec - exiting
23:04:06 (3824): No heartbeat from core client for 30 sec - exiting
23:04:07 (3824): No heartbeat from core client for 30 sec - exiting
23:04:09 (3824): No heartbeat from core client for 30 sec - exiting
23:04:10 (3824): No heartbeat from core client for 30 sec - exiting
23:04:11 (3824): No heartbeat from core client for 30 sec - exiting
23:04:12 (3824): No heartbeat from core client for 30 sec - exiting
23:04:13 (3824): No heartbeat from core client for 30 sec - exiting
23:04:14 (3824): No heartbeat from core client for 30 sec - exiting
23:04:15 (3824): No heartbeat from core client for 30 sec - exiting
23:04:16 (3824): No heartbeat from core client for 30 sec - exiting
23:04:17 (3824): No heartbeat from core client for 30 sec - exiting
23:04:18 (3824): No heartbeat from core client for 30 sec - exiting
23:04:20 (3824): No heartbeat from core client for 30 sec - exiting
23:04:21 (3824): No heartbeat from core client for 30 sec - exiting
23:04:22 (3824): No heartbeat from core client for 30 sec - exiting
23:04:23 (3824): No heartbeat from core client for 30 sec - exiting
23:04:24 (3824): No heartbeat from core client for 30 sec - exiting
23:04:25 (3824): No heartbeat from core client for 30 sec - exiting
23:04:26 (3824): No heartbeat from core client for 30 sec - exiting
23:04:27 (3824): No heartbeat from core client for 30 sec - exiting
23:04:28 (3824): No heartbeat from core client for 30 sec - exiting
23:04:29 (3824): No heartbeat from core client for 30 sec - exiting
23:04:30 (3824): No heartbeat from core client for 30 sec - exiting
23:04:32 (3824): No heartbeat from core client for 30 sec - exiting
23:04:33 (3824): No heartbeat from core client for 30 sec - exiting
23:04:34 (3824): No heartbeat from core client for 30 sec - exiting
23:04:35 (3824): No heartbeat from core client for 30 sec - exiting
23:04:36 (3824): No heartbeat from core client for 30 sec - exiting
23:04:37 (3824): No heartbeat from core client for 30 sec - exiting
23:04:38 (3824): No heartbeat from core client for 30 sec - exiting
23:04:39 (3824): No heartbeat from core client for 30 sec - exiting
23:04:40 (3824): No heartbeat from core client for 30 sec - exiting
23:04:41 (3824): No heartbeat from core client for 30 sec - exiting
23:04:43 (3824): No heartbeat from core client for 30 sec - exiting
23:04:44 (3824): No heartbeat from core client for 30 sec - exiting
23:04:45 (3824): No heartbeat from core client for 30 sec - exiting
23:04:46 (3824): No heartbeat from core client for 30 sec - exiting
23:04:47 (3824): No heartbeat from core client for 30 sec - exiting
23:04:48 (3824): No heartbeat from core client for 30 sec - exiting
23:04:49 (3824): No heartbeat from core client for 30 sec - exiting
23:04:50 (3824): No heartbeat from core client for 30 sec - exiting
23:04:51 (3824): No heartbeat from core client for 30 sec - exiting
23:04:52 (3824): No heartbeat from core client for 30 sec - exiting
23:04:53 (3824): No heartbeat from core client for 30 sec - exiting
23:04:55 (3824): No heartbeat from core client for 30 sec - exiting
23:04:56 (3824): No heartbeat from core client for 30 sec - exiting
23:04:57 (3824): No heartbeat from core client for 30 sec - exiting
23:04:58 (3824): No heartbeat from core client for 30 sec - exiting
23:04:59 (3824): No heartbeat from core client for 30 sec - exiting
23:05:00 (3824): No heartbeat from core client for 30 sec - exiting
23:05:01 (3824): No heartbeat from core client for 30 sec - exiting
23:05:02 (3824): No heartbeat from core client for 30 sec - exiting
23:05:03 (3824): No heartbeat from core client for 30 sec - exiting
23:05:05 (3824): No heartbeat from core client for 30 sec - exiting
23:05:06 (3824): No heartbeat from core client for 30 sec - exiting
23:05:07 (3824): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

zip error: Could not create output file (was replacing the original zip file)
CPDN Monitor - Quit request from BOINC...
23:02:42 (792): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:02:43 (792): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
22:27:57 (3808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/o41yko.pjk3c10
Error converting file to netcdf: dataout/o41yko.pik3c10
Error converting file to netcdf: dataout/o41yko.pfk3c10
Error converting file to netcdf: dataout/o41yka.phk3c10
Error converting file to netcdf: dataout/o41yka.pgk3c10
Error converting file to netcdf: dataout/o41yka.pek3c10
Error converting file to netcdf: dataout/o41yka.pdk3c10
CPDN Monitor - Quit request from BOINC...
22:17:01 (3296): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:41:21 (444): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:08:17 (2340): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:06:00 (3436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:14:09 (2472): No heartbeat from core client for 30 sec - exiting
15:14:10 (2472): No heartbeat from core client for 30 sec - exiting
15:14:11 (2472): No heartbeat from core client for 30 sec - exiting
15:14:12 (2472): No heartbeat from core client for 30 sec - exiting
15:14:13 (2472): No heartbeat from core client for 30 sec - exiting
15:14:14 (2472): No heartbeat from core client for 30 sec - exiting
15:14:15 (2472): No heartbeat from core client for 30 sec - exiting
15:14:16 (2472): No heartbeat from core client for 30 sec - exiting
15:14:17 (2472): No heartbeat from core client for 30 sec - exiting
15:14:18 (2472): No heartbeat from core client for 30 sec - exiting
15:14:19 (2472): No heartbeat from core client for 30 sec - exiting
15:14:20 (2472): No heartbeat from core client for 30 sec - exiting
15:14:21 (2472): No heartbeat from core client for 30 sec - exiting
15:14:22 (2472): No heartbeat from core client for 30 sec - exiting
15:14:23 (2472): No heartbeat from core client for 30 sec - exiting
15:14:24 (2472): No heartbeat from core client for 30 sec - exiting
15:14:26 (2472): No heartbeat from core client for 30 sec - exiting
15:14:27 (2472): No heartbeat from core client for 30 sec - exiting
15:14:28 (2472): No heartbeat from core client for 30 sec - exiting
15:14:29 (2472): No heartbeat from core client for 30 sec - exiting
15:14:30 (2472): No heartbeat from core client for 30 sec - exiting
15:14:31 (2472): No heartbeat from core client for 30 sec - exiting
15:14:32 (2472): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

zip error: Could not create output file (was replacing the original zip file)
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o41y_1980_40_007449452/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Jan 2012 21:16:53 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 1,036,800 6,277,746 6.0549
31 Dec 2011 00:24:10 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 1,010,880 6,130,863 6.0649
29 Dec 2011 01:21:47 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 984,960 5,974,215 6.0654
27 Dec 2011 00:35:26 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 959,040 5,815,606 6.0640
24 Dec 2011 20:20:24 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 933,120 5,653,877 6.0591
22 Dec 2011 16:40:34 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 907,200 5,493,289 6.0552
20 Dec 2011 17:25:40 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 881,280 5,343,423 6.0633
18 Dec 2011 16:59:11 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 855,360 5,190,349 6.0680
16 Dec 2011 11:57:32 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 829,440 5,026,493 6.0601
14 Dec 2011 09:42:56 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 803,520 4,866,475 6.0564
12 Dec 2011 09:08:30 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 777,600 4,710,905 6.0583
10 Dec 2011 09:16:10 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 751,680 4,549,078 6.0519
08 Dec 2011 08:33:09 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 725,760 4,392,363 6.0521
06 Dec 2011 06:54:16 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 699,840 4,237,327 6.0547
04 Dec 2011 02:03:22 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 673,920 4,072,506 6.0430
02 Dec 2011 01:24:56 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 648,000 3,914,664 6.0411
30 Nov 2011 02:34:38 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 622,080 3,760,400 6.0449
28 Nov 2011 04:34:22 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 596,160 3,607,637 6.0515
26 Nov 2011 02:07:55 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 570,240 3,456,721 6.0619
24 Nov 2011 01:34:28 4681 13363719 hadcm3n_o41y_1980_40_007449452_0 544,320 3,303,232 6.0685


©2024 climateprediction.net