climateprediction.net home page
hadam3p_anz download errors

hadam3p_anz download errors

Message boards : Number crunching : hadam3p_anz download errors
Message board moderation

To post messages, you must log in.

AuthorMessage
MarkJ
Avatar

Send message
Joined: 28 Mar 09
Posts: 126
Credit: 9,825,980
RAC: 0
Message 52079 - Posted: 23 Jun 2015, 13:33:10 UTC
Last modified: 23 Jun 2015, 13:33:41 UTC

It seems the latest batch submitted in the last few hours are missing some files.

climateprediction.net 23-06-2015 11:01 PM Started download of hadam3p_anz_d003_2013_1_009937381.zip
climateprediction.net 23-06-2015 11:01 PM Giving up on download of hadam3p_anz_d003_2013_1_009937381.zip: permanent HTTP error


If you spot these trying to download AND the hapam3p_anz_xxx.zip is 0k then there is no point downloading the other 46Mb of work unit data. I've been aborting the few that I spotted. If its 10k then it will be fine, its only the 0 bytes ones.

So far I have only seen hadam3p_anz_d???_2013_1_???.zip files that have this problem.
BOINC blog
ID: 52079 · Report as offensive     Reply Quote
Profile Byron Leigh Hatch @ team Carl ...
Avatar

Send message
Joined: 17 Aug 04
Posts: 289
Credit: 44,103,664
RAC: 0
Message 52081 - Posted: 23 Jun 2015, 14:05:34 UTC

My computer just Downloaded:

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/results.php?hostid=1364207

6/23/2015 6:24:26 AM | climateprediction.net | Requesting new tasks for CPU
6/23/2015 6:24:28 AM | climateprediction.net | Scheduler request completed: got 6 new tasks
6/23/2015 6:24:31 AM | climateprediction.net | Started download of hadam3p_anz_d7al_2013_1_009941573.zip
6/23/2015 6:24:31 AM | climateprediction.net | Started download of atmos_restart_d7al_ENSO.day.gz
6/23/2015 6:24:32 AM | climateprediction.net | Finished download of hadam3p_anz_d7al_2013_1_009941573.zip
6/23/2015 6:24:32 AM | climateprediction.net | Started download of region_restart_d7al_ENSO.day.gz
6/23/2015 6:24:45 AM | climateprediction.net | Finished download of atmos_restart_d7al_ENSO.day.gz
6/23/2015 6:24:45 AM | climateprediction.net | Started download of ancil_OSTIA_deltaSST_MIROC-ESM_Neutral_2014.gz
6/23/2015 6:24:49 AM | climateprediction.net | Finished download of ancil_OSTIA_deltaSST_MIROC-ESM_Neutral_2014.gz
6/23/2015 6:24:49 AM | climateprediction.net | Started download of hadam3p_anz_d0ig_2013_1_009940104.zip
6/23/2015 6:24:50 AM | climateprediction.net | Finished download of region_restart_d7al_ENSO.day.gz
6/23/2015 6:24:50 AM | climateprediction.net | Finished download of hadam3p_anz_d0ig_2013_1_009940104.zip
6/23/2015 6:24:50 AM | climateprediction.net | Started download of atmos_restart_d0ig_ENSO.day.gz
6/23/2015 6:24:50 AM | climateprediction.net | Started download of region_restart_d0ig_ENSO.day.gz
6/23/2015 6:25:08 AM | climateprediction.net | Finished download of region_restart_d0ig_ENSO.day.gz
6/23/2015 6:25:08 AM | climateprediction.net | Started download of hadam3p_anz_d7we_2013_1_009942031.zip
6/23/2015 6:25:09 AM | climateprediction.net | Finished download of atmos_restart_d0ig_ENSO.day.gz
6/23/2015 6:25:09 AM | climateprediction.net | Finished download of hadam3p_anz_d7we_2013_1_009942031.zip
6/23/2015 6:25:09 AM | climateprediction.net | Started download of atmos_restart_d7we_ENSO.day.gz
6/23/2015 6:25:09 AM | climateprediction.net | Started download of region_restart_d7we_ENSO.day.gz
6/23/2015 6:25:26 AM | climateprediction.net | Finished download of atmos_restart_d7we_ENSO.day.gz
6/23/2015 6:25:26 AM | climateprediction.net | Started download of hadam3p_anz_d47z_2013_1_009940764.zip
6/23/2015 6:25:28 AM | climateprediction.net | Finished download of hadam3p_anz_d47z_2013_1_009940764.zip
6/23/2015 6:25:28 AM | climateprediction.net | Started download of atmos_restart_d47z_ENSO.day.gz
6/23/2015 6:25:33 AM | climateprediction.net | Finished download of region_restart_d7we_ENSO.day.gz
6/23/2015 6:25:33 AM | climateprediction.net | Started download of region_restart_d47z_ENSO.day.gz
6/23/2015 6:25:42 AM | climateprediction.net | Finished download of atmos_restart_d47z_ENSO.day.gz
6/23/2015 6:25:42 AM | climateprediction.net | Started download of ancil_OSTIA_deltaSST_GISS-E2-H_Neutral_2014.gz
6/23/2015 6:25:46 AM | climateprediction.net | Finished download of ancil_OSTIA_deltaSST_GISS-E2-H_Neutral_2014.gz
6/23/2015 6:25:46 AM | climateprediction.net | Started download of hadam3p_pnw_b3bx_2054_1_009936731.zip
6/23/2015 6:25:47 AM | climateprediction.net | Finished download of hadam3p_pnw_b3bx_2054_1_009936731.zip
6/23/2015 6:25:47 AM | climateprediction.net | Started download of ic19610315_16_N96.gz
6/23/2015 6:25:50 AM | climateprediction.net | Finished download of ic19610315_16_N96.gz
6/23/2015 6:25:50 AM | climateprediction.net | Started download of pnw_rcp45_cam5_b07e_2054_atmos.day.gz
6/23/2015 6:25:54 AM | climateprediction.net | Finished download of region_restart_d47z_ENSO.day.gz
6/23/2015 6:25:54 AM | climateprediction.net | Started download of pnw_rcp45_cam5_b07e_2054_region.day.gz
6/23/2015 6:26:05 AM | climateprediction.net | Finished download of pnw_rcp45_cam5_b07e_2054_region.day.gz
6/23/2015 6:26:05 AM | climateprediction.net | Started download of SICE_RCP45_cam5_r3_2054_12_2055_12.gz
6/23/2015 6:26:07 AM | climateprediction.net | Finished download of pnw_rcp45_cam5_b07e_2054_atmos.day.gz
6/23/2015 6:26:07 AM | climateprediction.net | Finished download of SICE_RCP45_cam5_r3_2054_12_2055_12.gz
6/23/2015 6:26:07 AM | climateprediction.net | Started download of OSTIA_RCP45_cam5_r3_2054_12_2055_12.gz
6/23/2015 6:26:07 AM | climateprediction.net | Started download of hadam3p_anz_d5fa_2013_1_009941290.zip
6/23/2015 6:26:08 AM | climateprediction.net | Finished download of hadam3p_anz_d5fa_2013_1_009941290.zip
6/23/2015 6:26:08 AM | climateprediction.net | Started download of atmos_restart_d5fa_ENSO.day.gz
6/23/2015 6:26:11 AM | climateprediction.net | Finished download of OSTIA_RCP45_cam5_r3_2054_12_2055_12.gz
6/23/2015 6:26:11 AM | climateprediction.net | Started download of region_restart_d5fa_ENSO.day.gz
6/23/2015 6:26:28 AM | climateprediction.net | Finished download of atmos_restart_d5fa_ENSO.day.gz
6/23/2015 6:26:28 AM | climateprediction.net | Started download of ancil_OSTIA_deltaSST_HadGEM2-ES_Neutral_2014.gz
6/23/2015 6:26:31 AM | climateprediction.net | Finished download of region_restart_d5fa_ENSO.day.gz
6/23/2015 6:26:33 AM | climateprediction.net | Finished download of ancil_OSTIA_deltaSST_HadGEM2-ES_Neutral_2014.gz
6/23/2015 6:37:36 AM | climateprediction.net | Started upload of hadam3p_anz_d0u6_2012_1_009784323_1_10.zip
6/23/2015 6:38:31 AM | climateprediction.net | Finished upload of hadam3p_anz_d0u6_2012_1_009784323_1_10.zip
ID: 52081 · Report as offensive     Reply Quote
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1079
Credit: 6,904,049
RAC: 6,657
Message 52083 - Posted: 23 Jun 2015, 14:26:05 UTC

MarkJ's wingmen have failed too, which argues for a configuration error on those work units. However, two models downloaded without error on my Mac matching that pattern, so it appears to be something more specific or perhaps platform-dependent.
ID: 52083 · Report as offensive     Reply Quote
MarkJ
Avatar

Send message
Joined: 28 Mar 09
Posts: 126
Credit: 9,825,980
RAC: 0
Message 52167 - Posted: 4 Jul 2015, 13:27:37 UTC
Last modified: 4 Jul 2015, 13:32:40 UTC

A heap more. This time they are the hadam3p_anz_u???_2013_1_??? series. They all appear to be checksum errors. And before I'm told it must be me, my wingmen also have download errors for the same work units.

The last lot were also Jan 2013 work units so maybe that's a common theme here.

04-07-2015 11:12 PM [error] MD5 check failed for hadam3p_anz_u0ot_2013_1_009998589.zip
04-07-2015 11:12 PM [error] expected b031e384b89ac9ee2cf46b76085503a3, got ec890bfc2d0edf85e25aea42dacf335c
04-07-2015 11:12 PM [error] Checksum or signature error for hadam3p_anz_u0ot_2013_1_009998589.zip

04-07-2015 11:12 PM [error] MD5 check failed for hadam3p_anz_u0aq_2013_1_009998082.zip
04-07-2015 11:12 PM [error] expected 37bfe482d612f8e4c03c54c0b765acb0, got 910b15c08459b1b50179cdf9c54348cf
04-07-2015 11:12 PM [error] Checksum or signature error for hadam3p_anz_u0aq_2013_1_009998082.zip

04-07-2015 11:06 PM [error] MD5 check failed for hadam3p_anz_u0t2_2013_1_009998742.zip
04-07-2015 11:06 PM [error] expected 32c5e563e2fa8a5b71ca68c9f9bf4428, got 68e14bf99e8553b60ac6b386341a54c0
04-07-2015 11:06 PM [error] Checksum or signature error for hadam3p_anz_u0t2_2013_1_009998742.zip

BOINC blog
ID: 52167 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 52181 - Posted: 7 Jul 2015, 15:00:28 UTC - in response to Message 52167.  
Last modified: 7 Jul 2015, 15:06:10 UTC

Same here:-



<core_client_version>7.4.42</core_client_version>
<![CDATA[
<message>
WU download error: couldn't get input files:
<file_xfer_error>
<file_name>hadam3p_anz_u0as_2013_1_009998084.zip</file_name>
<error_code>-119 (md5 checksum failed for file)</error_code>
<error_message>MD5 check failed</error_message>
</file_xfer_error>

</message>
]]>

This one has done it 3 times so is now "dead".

But I have another one from the same series _u..._2013 which is apparenntly running OK.
ID: 52181 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 52182 - Posted: 7 Jul 2015, 15:28:06 UTC
Last modified: 7 Jul 2015, 15:30:16 UTC

The ANZ models are all "2013 series", because that's the year that's being studied.

Weather@home ANZ 2013: the causes of recent heatwaves and drought in Australia and New Zealand

The distinguishing feature of the failures, may be the "U" part of the 4 letter name, which CAN be considered a "series".
ID: 52182 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 52188 - Posted: 7 Jul 2015, 18:53:45 UTC - in response to Message 52182.  

The one that failed to downlaod is _u0.._ whereas the one that is running OK is _u2.._ so presumably a different part of the series.
ID: 52188 · Report as offensive     Reply Quote
Profile Byron Leigh Hatch @ team Carl ...
Avatar

Send message
Joined: 17 Aug 04
Posts: 289
Credit: 44,103,664
RAC: 0
Message 52223 - Posted: 11 Jul 2015, 14:04:55 UTC - in response to Message 52188.  
Last modified: 11 Jul 2015, 14:35:30 UTC

Alan wrote the following:
<quote>
The one that failed to downlaod is _u0.._ whereas the one that is running OK is _u2.._ so presumably a different part of the series.
</quote>

Yes thank you Les, Alan, Iain and MarkJ for that information.
also, that appears to be the case with mine also:
application version UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10

Stderr show hide <core_client_version>7.4.42</core_client_version>
<![CDATA[

<message>

WU download error: couldn't get input files:
<file_xfer_error>
<file_name>hadam3p_anz_u0e3_2013_1_009998203.zip</file_name>
<error_code>-119 (md5 checksum failed for file)</error_code>
<error_message>MD5 check failed</error_message>
</file_xfer_error>

</message>
]]>

name hadam3p_anz_u0e3_2013_1_009998203
application UK Met Office HadAM3P-HadRM3P Australia New Zealand
created 3 Jul 2015 10:03:20 UTC

it looks like my two other wingman got the same:

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/workunit.php?wuid=9996561

I hope this helps.
Byron
ID: 52223 · Report as offensive     Reply Quote

Message boards : Number crunching : hadam3p_anz download errors

©2024 climateprediction.net