getting upload problems on short runs:

21/09/2014 09:54:20 | climateprediction.net | Started upload of hadcm3s_11f8_1980_2_008906126_2_1.zip
21/09/2014 09:54:20 | climateprediction.net | Started upload of hadcm3s_2juk_2001_2_009033699_0_1.zip
21/09/2014 09:54:43 | climateprediction.net | Temporarily failed upload of hadcm3s_11f8_1980_2_008906126_2_1.zip: connect() failed
21/09/2014 09:54:43 | climateprediction.net | Backing off 04:33:53 on upload of hadcm3s_11f8_1980_2_008906126_2_1.zip
21/09/2014 09:54:46 | | Project communication failed: attempting access to reference site
21/09/2014 09:54:48 | | Internet access OK - project servers may be temporarily down.
21/09/2014 09:57:29 | climateprediction.net | Temporarily failed upload of hadcm3s_2juk_2001_2_009033699_0_1.zip: transient HTTP error
21/09/2014 09:57:29 | climateprediction.net | Backing off 00:11:07 on upload of hadcm3s_2juk_2001_2_009033699_0_1.zip
21/09/2014 09:57:32 | | Project communication failed: attempting access to reference site
21/09/2014 09:57:34 | | Internet access OK - project servers may be temporarily down.

Is another of theservers down?

I have the same problem. There are 3 zip files stuck in the transfer tab of my second fastest machine. It is the only one running the hadcm shorties.

---

Yep...same thing...

9/21/2014 10:05:55 AM | climateprediction.net | Computation for task hadcm3s_2egt_2001_2_009026724_0 finished
9/21/2014 10:05:55 AM | climateprediction.net | Output file hadcm3s_2egt_2001_2_009026724_0_1.zip for task hadcm3s_2egt_2001_2_009026724_0 absent
9/21/2014 10:05:55 AM | climateprediction.net | Output file hadcm3s_2egt_2001_2_009026724_0_2.zip for task hadcm3s_2egt_2001_2_009026724_0 absent
9/21/2014 10:58:29 AM | climateprediction.net | Started upload of hadcm3s_2egp_2001_2_009026720_0_1.zip
9/21/2014 10:58:51 AM | climateprediction.net | Temporarily failed upload of hadcm3s_2egp_2001_2_009026720_0_1.zip: connect() failed
9/21/2014 10:58:51 AM | climateprediction.net | Backing off 00:03:41 on upload of hadcm3s_2egp_2001_2_009026720_0_1.zip
9/21/2014 10:58:54 AM | | Project communication failed: attempting access to reference site
9/21/2014 10:58:57 AM | | Internet access OK - project servers may be temporarily down.
9/21/2014 10:59:22 AM | climateprediction.net | Sending scheduler request: To send trickle-up message.
9/21/2014 10:59:22 AM | climateprediction.net | Reporting 1 completed tasks
9/21/2014 10:59:22 AM | climateprediction.net | Requesting new tasks for CPU
9/21/2014 10:59:24 AM | climateprediction.net | Scheduler request completed: got 0 new tasks
9/21/2014 10:59:24 AM | climateprediction.net | No work sent
9/21/2014 10:59:24 AM | climateprediction.net | This computer has finished a daily quota of 1 tasks)
9/21/2014 11:22:51 AM | climateprediction.net | Started upload of hadcm3s_2egs_2001_2_009026723_0_1.zip
9/21/2014 11:23:14 AM | climateprediction.net | Temporarily failed upload of hadcm3s_2egs_2001_2_009026723_0_1.zip: connect() failed
9/21/2014 11:23:14 AM | climateprediction.net | Backing off 00:02:33 on upload of hadcm3s_2egs_2001_2_009026723_0_1.zip
9/21/2014 11:23:17 AM | | Project communication failed: attempting access to reference site
9/21/2014 11:23:19 AM | | Internet access OK - project servers may be temporarily down.

All Zip files have uploaded.

No hadcm3s zip files have uploaded from here yet, not since last Friday.
But the equinoctial morning sun is shining at 5/4 degree west -- good odds the problem - whatever it might have been - will be mostly gone in hours or days.

I'll not be hitting the "retry now" button any time soon.

---

I am having upload issues too since Friday. Does the server need a reboot. I was looking at the server status page and it appears that there are other upload servers as well. How do I repoint my client to those servers (if that is something that will resolve he issue?

---

TrueBlue

Afriad pointing them at a different server won't help. The most common reasons I read recently for upload problems are in no particular order, (because I can't remember what the post said exactly) disk full, disk come unmounted and server needing rebooting. At least the problem this time doesn't upload the data before telling us things aren't working!

If you set the logging flag for http_debug, for hadcm3s you get (currently):

22/09/2014 17:09:32 | climateprediction.net | [http] [ID#570] Info: About to connect() to rapid-watch.badc.rl.ac.uk port 80 (#1144)
22/09/2014 17:09:32 | climateprediction.net | [http] [ID#570] Info: Trying 130.246.191.84...
22/09/2014 17:09:54 | climateprediction.net | [http] [ID#570] Info: Failed connect to rapid-watch.badc.rl.ac.uk:80; No error
22/09/2014 17:09:54 | climateprediction.net | Temporarily failed upload of hadcm3s_2jcd_2001_2_009033044_1_1.zip: connect() failed

- which does sound like a server needing a restart, in this case. (or perhaps just a restart of the Apache service)

Just had a dowload failure as well:_

22/09/2014 22:50:15 | climateprediction.net | Started download of hadcm3s_1a0k_2001_2_008988374.zip
22/09/2014 22:50:15 | climateprediction.net | Started download of 1m7a_2001.astart.gz
22/09/2014 22:50:17 | climateprediction.net | Finished download of hadcm3s_1a0k_2001_2_008988374.zip
22/09/2014 22:50:17 | climateprediction.net | Giving up on download of 1m7a_2001.astart.gz: permanent HTTP error
22/09/2014 22:50:17 | climateprediction.net | Started download of 1m7a_2001.ostart.gz
22/09/2014 22:50:19 | climateprediction.net | Giving up on download of 1m7a_2001.ostart.gz: permanent HTTP error
22/09/2014 22:50:26 | climateprediction.net | Temporarily failed upload of hadcm3s_2a94_2001_2_009021263_1_1.zip: connect() failed

Error on upload of zip file for hadcm3n since 0740 GMT (transient HTTP error).

Error on upload of zip file for hadcm3n since 0740 GMT (transient HTTP error).

Is that heading towards the same 'rapid-watch.badc' server as the cm3s uploads?

Apparently that server isn't under the direct control of the CPDN project staff, but is administered by http://www.ceda.ac.uk/blog/. A message has been sent...

Error on upload of zip file for hadcm3n since 0740 GMT (transient HTTP error).

Is that heading towards the same 'rapid-watch.badc' server as the cm3s uploads?

I don't know, Richard. How do I find out?

NB: Now getting "connect () failed" error.

hadam3p_anz zip uploaded normally.

Had3cms zip uploads currently total over 2.5GB on this computer alone. Do you guys have an explanation you can share? It's not a big problem .. yet .. But it would be nice to use this months internet usage allowance sometime this month?
With Thanks from a UTC+10 colonial ...

23/09/2014 9:48:00 PM | climateprediction.net | Started upload of hadcm3s_2e8c_2001_2_009026419_0_1.zip
23/09/2014 9:48:00 PM | climateprediction.net | Started upload of hadcm3s_2e89_2001_2_009026416_0_1.zip
23/09/2014 9:48:22 PM | climateprediction.net | Temporarily failed upload of hadcm3s_2e8c_2001_2_009026419_0_1.zip: connect() failed
23/09/2014 9:48:22 PM | climateprediction.net | Backing off 00:13:22 on upload of hadcm3s_2e8c_2001_2_009026419_0_1.zip
23/09/2014 9:48:22 PM | climateprediction.net | Temporarily failed upload of hadcm3s_2e89_2001_2_009026416_0_1.zip: connect() failed
23/09/2014 9:48:22 PM | climateprediction.net | Backing off 00:13:48 on upload of hadcm3s_2e89_2001_2_009026416_0_1.zip
23/09/2014 9:48:47 PM | | Project communication failed: attempting access to reference site
23/09/2014 9:48:49 PM | | Internet access OK - project servers may be temporarily down.

It needs a kick up the backside.

Just under 2,000 WUs available a no way to report them. Currently got two queued and a third on the way.

---

I don't know, Richard. How do I find out?

Either look - DON'T CHANGE ANYTHING - inside client_state.xml for the upload urls.

Or enable http_debug logging, to display the sort of event log messages I posted.

I don't know, Richard. How do I find out?

Either look - DON'T CHANGE ANYTHING - inside client_state.xml for the upload urls.

Or enable http_debug logging, to display the sort of event log messages I posted.

From what I can see, these zips seem to be being sent to http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler, so I take that as a yes.

I imagine this will be fixed at the same time as the hadcm3s bug is fixed, then.

Hi guys!

I'm having upload problems for some days too:

24/09/2014 03:27:12 p.m. | climateprediction.net | Started upload of hadcm3s_27t8_1991_2_009018099_0_2.zip
24/09/2014 03:27:12 p.m. | climateprediction.net | Started upload of hadcm3s_2j1k_2001_2_009032655_0_1.zip
24/09/2014 03:32:20 p.m. | climateprediction.net | Temporarily failed upload of hadcm3s_27t8_1991_2_009018099_0_2.zip: transient HTTP error
24/09/2014 03:32:20 p.m. | climateprediction.net | Backing off 05:17:15 on upload of hadcm3s_27t8_1991_2_009018099_0_2.zip
24/09/2014 03:32:20 p.m. | climateprediction.net | Temporarily failed upload of hadcm3s_2j1k_2001_2_009032655_0_1.zip: transient HTTP error
24/09/2014 03:32:20 p.m. | climateprediction.net | Backing off 05:31:53 on upload of hadcm3s_2j1k_2001_2_009032655_0_1.zip

These are just examples. I�m having ten tasks waiting theirs uploads to complete.

Anything to do? Or should I just wait?

---

Hi Gabriel

Just wait.
Look through the recent posts in this thread if you want to know what's going on.

rapid-watch seems to be up, but with a big backlog. Like locally, here, almost 100 63GB uploads to go.

Please don't try hitting the "retry now" -- that just makes it worse.

The files will be uploaded, the data will be saved and archived.

Patience is a virtue. As I remind myself time to time.

This time a peripheral server was down for about 5 days, and is catching up very well thank you.

Please consider the time scales of heat-death vs "models that anticipate heat-death"

Yup. Please smile. Thanks.

---

With Thanks from a UTC+10 colonial for the explanation.