climateprediction.net home page
Upload process locked

Upload process locked

Message boards : Number crunching : Upload process locked
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · Next

AuthorMessage
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 38976 - Posted: 23 Feb 2010, 11:08:36 UTC

Thanks again, Bill. The extra block you\'ve copied for us confirms that HadAM3P file #2 does indeed go to to cpdn-upload1.comlab as my list of servers on paper says.

As Milo\'s found something wrong with the server that accepts the upload of file #1, I wouldn\'t be surprised if he also finds a problem with cpdn-upload1.comlab.

The files stuck in the Transfers tab should come to no harm because of this wait as long as nobody keeps repeatedly pressing the Try again button while the files can\'t upload.
Cpdn news
ID: 38976 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 38977 - Posted: 23 Feb 2010, 12:14:03 UTC - in response to Message 38976.  

Thanks for keeping me updated!

I will hold off pressing the \'Try Agin\' key for as long as I am able ;-)

Bill H
ID: 38977 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 38992 - Posted: 24 Feb 2010, 18:45:12 UTC
Last modified: 24 Feb 2010, 18:48:33 UTC

Bill, Milo has said that cpdn-upload1.comlab which takes the HadAM3P #2 file seems to be OK.

Have your #2 files uploaded or are they still stuck in Transfers?

I see from the first messages you posted that they were stuck on the morning of Sunday 21st. I have a HadSM MH which also uploads to cpdn-upload1.comlab. It successfully uploaded its file at the end of phase 3 on the evening of Sunday 21st. We\'re both in the UK so our times should be the same.

I\'ve posted in the News thread about HadAM3P #1 files unable to upload to uploader.oerc. Could something different be blocking the upload of your #2 files?

[FVG]bax - which files are still stuck in your Transfers tab? We need to know the final number of each file, please.
Cpdn news
ID: 38992 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 38995 - Posted: 24 Feb 2010, 21:35:09 UTC - in response to Message 38992.  

They are still stuck in transfers. In the meantime I am running on a second hard disk configuation as BOINC is screwing up the network connection. I switch back at intervals just to see if they will upload correctly but no joy so far...

Is there any information or anything you\'d like me to try?

Bill H
ID: 38995 · Report as offensive     Reply Quote
Thorsten Schmidt

Send message
Joined: 19 Mar 09
Posts: 1
Credit: 180,978
RAC: 0
Message 38996 - Posted: 24 Feb 2010, 21:38:53 UTC
Last modified: 24 Feb 2010, 21:46:38 UTC

Hi!
The following files:
hadam3p_npir_2000_2_006583729_2_1.zip (25,20 MB)
hadam3p_npir_2000_2_006583729_2_3.zip (212,36 KB),
both remain stuck in the Transfers tab.

Is there any information when the uploader.oerc is ok?

Thorsten Schmidt
ID: 38996 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 38997 - Posted: 24 Feb 2010, 21:39:25 UTC - in response to Message 38995.  

Mine are all haram3p_npdh and _npdg (if that means anything) and although the transfers are all supposidly deferred for an hour or so the netwrk traffic from them is still high.

Bill H
ID: 38997 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 38999 - Posted: 24 Feb 2010, 22:52:15 UTC
Last modified: 24 Feb 2010, 23:02:32 UTC

Hi Bill, Thorsten and everybody

We are posting announcements about this problem in the News thread at the top of the Number Crunching section.

While uploader.oerc is down it is normal for HadAM3P files #1 and #3 to remain stuck in Transfers. We cannot do anything to make them upload.

Bill\'s #3 files, which are small, must have successfully uploaded while uploader.oerc was working partially.

Please suspend Boinc network activity as much as possible. If you do not need it for other projects and do not need new work you can suspend it all the time at the moment. I think Boinc will still try to upload the files at intervals and will restart network activity, but only for five minutes each time. I hope that will reduce your network usage.
Cpdn news
ID: 38999 · Report as offensive     Reply Quote
Ingleside

Send message
Joined: 5 Aug 04
Posts: 108
Credit: 19,038,648
RAC: 36,817
Message 39016 - Posted: 25 Feb 2010, 17:20:30 UTC - in response to Message 38999.  
Last modified: 25 Feb 2010, 17:21:57 UTC

Please suspend Boinc network activity as much as possible. If you do not need it for other projects and do not need new work you can suspend it all the time at the moment. I think Boinc will still try to upload the files at intervals and will restart network activity, but only for five minutes each time. I hope that will reduce your network usage.

BOINC won\'t re-enable network again of it\'s own accord if the user has disabled it...

But, if user does something active, like hiting \"update\" on a file or project, or attachs to a new project, it will open-up for network-connections for 5 minutes.
ID: 39016 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 39017 - Posted: 25 Feb 2010, 17:33:42 UTC

Bill, your two #2 files in Transfers must be blocked for a different reason. Have you recently changed anything on this computer? Firewall? AV? Which AV please? Any other new software?

This is unlikely to be the cause of the blockage as a change would probably also have affected the #3 files which did upload, but it would be useful to know.

I assume your #2 files are still stuck?

If you say there have been no recent changes, tomorrow or at the weekend one of us will explain how you can set up a Boinc debugging tool which will make your Boinc produce extra messages. The extra info should help identify the source of the problem.
Cpdn news
ID: 39017 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 39019 - Posted: 25 Feb 2010, 18:37:41 UTC - in response to Message 39017.  

The AntiVirus is AVG and I have been using it for a number of years now. Of course it does update itself fairly regularly.

I am not running a software firewall at the moment. I have recently switched my router from a WG834GT to a WG834PN (two weeks ago) - but have had no problems with anything else (or other BOINC uploads). Will reconnect the old router tomorrow if you think that this may be the issue?

Bill H
ID: 39019 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 942
Credit: 34,174,712
RAC: 6,085
Message 39020 - Posted: 25 Feb 2010, 18:50:18 UTC - in response to Message 39019.  

The AntiVirus is AVG and I have been using it for a number of years now. Of course it does update itself fairly regularly.

I am not running a software firewall at the moment. I have recently switched my router from a WG834GT to a WG834PN (two weeks ago) - but have had no problems with anything else (or other BOINC uploads). Will reconnect the old router tomorrow if you think that this may be the issue?

Bill H
Highly unlikely to be the router, and probably not AVG either.

Milo has now got the new hard disk, and installed it in the server. As soon as the RAID has synchronised, and assuming it tests out OK, he plans to put it back online - keep an eye on the Server Status page.

When the general backlog has cleared - it\'ll take a while, but I can monitor it, because I\'ve got two models (four files) stuck in the same queue - let us know what you\'ve got left that\'s still stuck (post the message log extracts that describe the problem, and the client_state extracts that identify where it\'s trying to get to - like you did before). Then we can start some tests to identify exactly what\'s especially wrong with your task/on your machine.

Sound like a plan?
ID: 39020 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 39021 - Posted: 25 Feb 2010, 18:58:39 UTC - in response to Message 39020.  

Will do.

I would have expected a firewall problem to have blocked access but not have hogged bandwidth. Looks like a server issue but only when the file has been uploaded so write error, insufficent space etc.?

Anyway I will try again tomorrow and see if things get any further.

Thanks for keeping me in the loop!

Bill H
ID: 39021 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 39042 - Posted: 27 Feb 2010, 9:48:14 UTC - in response to Message 39020.  

I\'m sorry but the new disk doesn\'t seem to have done anything for my problem in uploading. It may be that the server is still very overloaded but I attach a copy of the log for the early hours of this morning showing it trying and failing to upload the completed work units. Also there should be the section of the XML file for the uploads.

The Transfer window on BOINC shows all the units at 100% but with a retry scheduled in an hour or so...

My computer seems to be sending the units OK (well they take enough network time) but ultimately them failing or being rejected at the server end at the very end of the upload(?). Is there any sort of server log that would say what is going on from your end?

Thanks

Bill H


-----------------------------------------------------------------------------

27/02/2010 05:15:43 climateprediction.net Sending scheduler request: To fetch work.
27/02/2010 05:15:43 climateprediction.net Requesting new tasks for GPU
27/02/2010 05:15:59 climateprediction.net Scheduler request completed: got 0 new tasks
27/02/2010 05:15:59 climateprediction.net Message from server: No work sent
27/02/2010 05:20:42 Project communication failed: attempting access to reference site
27/02/2010 05:20:42 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: HTTP error
27/02/2010 05:20:42 climateprediction.net Backing off 35 min 40 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
27/02/2010 05:20:42 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 05:20:44 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_1.zip: HTTP error
27/02/2010 05:20:44 climateprediction.net Backing off 2 hr 45 min 12 sec on upload of hadam3p_npdg_2000_2_006583538_1_1.zip
27/02/2010 05:20:44 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_2.zip
27/02/2010 05:20:52 Internet access OK - project servers may be temporarily down.
27/02/2010 05:25:57 Project communication failed: attempting access to reference site
27/02/2010 05:25:57 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
27/02/2010 05:25:57 climateprediction.net Backing off 30 min 23 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 05:25:57 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: HTTP error
27/02/2010 05:25:57 climateprediction.net Backing off 54 min 50 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
27/02/2010 05:26:12 Internet access OK - project servers may be temporarily down.
27/02/2010 05:30:24 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 05:30:32 climateprediction.net [error] Error reported by file upload server: [hadam3p_npdh_2005_2_006583539_0_1.zip] locked by file_upload_handler PID=28679
27/02/2010 05:30:32 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: transient upload error
27/02/2010 05:30:32 climateprediction.net Backing off 1 hr 37 min 8 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 05:32:36 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_2.zip
27/02/2010 05:37:52 Project communication failed: attempting access to reference site
27/02/2010 05:37:52 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: HTTP error
27/02/2010 05:37:52 climateprediction.net Backing off 3 hr 6 min 35 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
27/02/2010 05:38:18 Internet access OK - project servers may be temporarily down.
27/02/2010 06:06:13 climateprediction.net Sending scheduler request: To send trickle-up message.
27/02/2010 06:06:13 climateprediction.net Requesting new tasks for GPU
27/02/2010 06:06:23 climateprediction.net Scheduler request completed: got 0 new tasks
27/02/2010 06:06:23 climateprediction.net Message from server: No work sent
27/02/2010 06:10:53 climateprediction.net Sending scheduler request: To send trickle-up message.
27/02/2010 06:10:53 climateprediction.net Requesting new tasks for GPU
27/02/2010 06:11:13 climateprediction.net Scheduler request completed: got 0 new tasks
27/02/2010 06:11:13 climateprediction.net Message from server: No work sent
27/02/2010 06:20:48 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_2.zip
27/02/2010 06:25:56 Project communication failed: attempting access to reference site
27/02/2010 06:25:56 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: HTTP error
27/02/2010 06:25:56 climateprediction.net Backing off 1 hr 39 min 22 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
27/02/2010 06:26:11 Internet access OK - project servers may be temporarily down.
27/02/2010 07:07:42 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 07:12:51 Project communication failed: attempting access to reference site
27/02/2010 07:12:51 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
27/02/2010 07:12:51 climateprediction.net Backing off 38 min 11 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 07:13:04 Internet access OK - project servers may be temporarily down.
27/02/2010 07:23:38 climateprediction.net Sending scheduler request: To send trickle-up message.
27/02/2010 07:23:38 climateprediction.net Requesting new tasks for GPU
27/02/2010 07:23:43 climateprediction.net Scheduler request completed: got 0 new tasks
27/02/2010 07:23:43 climateprediction.net Message from server: No work sent
27/02/2010 07:51:03 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 07:52:38 climateprediction.net Sending scheduler request: To send trickle-up message.
27/02/2010 07:52:38 climateprediction.net Requesting new tasks for GPU
27/02/2010 07:52:48 climateprediction.net Scheduler request completed: got 0 new tasks
27/02/2010 07:52:48 climateprediction.net Message from server: No work sent
27/02/2010 07:56:12 Project communication failed: attempting access to reference site
27/02/2010 07:56:12 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
27/02/2010 07:56:12 climateprediction.net Backing off 3 hr 14 min 13 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 07:56:30 Internet access OK - project servers may be temporarily down.
27/02/2010 08:05:19 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_2.zip
27/02/2010 08:05:56 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_1.zip
27/02/2010 08:10:27 Project communication failed: attempting access to reference site
27/02/2010 08:10:27 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: HTTP error
27/02/2010 08:10:27 climateprediction.net Backing off 2 hr 40 min 30 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
27/02/2010 08:10:43 Internet access OK - project servers may be temporarily down.
27/02/2010 08:11:12 Project communication failed: attempting access to reference site
27/02/2010 08:11:12 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_1.zip: HTTP error
27/02/2010 08:11:12 climateprediction.net Backing off 2 hr 43 min 18 sec on upload of hadam3p_npdg_2000_2_006583538_1_1.zip
27/02/2010 08:11:21 Internet access OK - project servers may be temporarily down.
27/02/2010 08:14:29 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_2.zip
27/02/2010 08:19:46 Project communication failed: attempting access to reference site
27/02/2010 08:19:46 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: HTTP error
27/02/2010 08:19:46 climateprediction.net Backing off 3 hr 4 min 39 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
27/02/2010 08:20:00 Internet access OK - project servers may be temporarily down.



-----------------------------------------------------------------------------

<file_info>
<name>hadam3p_npdg_2000_2_006583538_1_1.zip</name>
<nbytes>26429666.000000</nbytes>
<max_nbytes>80000000.000000</max_nbytes>
<md5_cksum>84ef44a0a7849a06c98874b21dd3c96b</md5_cksum>
<generated_locally />
<status>1</status>
<upload_when_present />
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
- <persistent_file_xfer>
<num_retries>49</num_retries>
<first_request_time>1266690720.627699</first_request_time>
<next_request_time>1267268070.866326</next_request_time>
<time_so_far>9910.238266</time_so_far>
<last_bytes_xferred>26429666.000000</last_bytes_xferred>
</persistent_file_xfer>
- <signed_xml>
<name>hadam3p_npdg_2000_2_006583538_1_1.zip</name>
<generated_locally />
<upload_when_present />
<max_nbytes>80000000</max_nbytes>
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
</signed_xml>
<xml_signature>498ba8db9391b1d6b0798689ee82ecced61e04f43c0e36cfa1db3e4d5566265c 45c007b739023f6279d8dcfef7cbfb5bb00da7c8fcf81f75cd8df8bda6cda2b7 3e1c9eefdf2fb1a549405b79db22ddcade68a1e78a43f797897249f7f7ee8252 3fb5d0db59795bd4ce7d5903380d90b96345661a3ea802c55a25438a057a82cb .</xml_signature>
</file_info>
- <file_info>
<name>hadam3p_npdg_2000_2_006583538_1_2.zip</name>
<nbytes>21111339.000000</nbytes>
<max_nbytes>50000000.000000</max_nbytes>
<md5_cksum>1284b3c4e21118afca01d7908a974477</md5_cksum>
<generated_locally />
<status>1</status>
<upload_when_present />
<url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
- <persistent_file_xfer>
<num_retries>44</num_retries>
<first_request_time>1266690720.627699</first_request_time>
<next_request_time>1267269866.137853</next_request_time>
<time_so_far>12823.603690</time_so_far>
<last_bytes_xferred>21111339.000000</last_bytes_xferred>
</persistent_file_xfer>
- <signed_xml>
<name>hadam3p_npdg_2000_2_006583538_1_2.zip</name>
<generated_locally />
<upload_when_present />
<max_nbytes>50000000</max_nbytes>
<url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
</signed_xml>
<xml_signature>a4ce46e0b86902764275feefb343bf5b75b70dfdcf57cde3fbd01fd3b5441854 a4c522d7a0322ea254ca70a1963e1c165dbcd7268fec58eab5bf902e73300bac c31d34be91dbe89ed9330a46fac6e18da6fd7479831287e94a6fbab1e5fa7c57 22ff554680318f9a9b01b8228233874d2d368dbaa732e3bdb60c98718f45c5be .</xml_signature>
</file_info>
- <file_info>
<name>hadam3p_npdg_2000_2_006583538_1_3.zip</name>
<nbytes>217557.000000</nbytes>
<max_nbytes>50000000.000000</max_nbytes>
<md5_cksum>c9de2bc4a1e2fde268aa8ccd9e843890</md5_cksum>
<generated_locally />
<status>0</status>
<uploaded />
<upload_when_present />
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
- <signed_xml>
<name>hadam3p_npdg_2000_2_006583538_1_3.zip</name>
<generated_locally />
<upload_when_present />
<max_nbytes>50000000</max_nbytes>
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
</signed_xml>
<xml_signature>ae5726f3a4df24f905a90a917aa1064e5c7762e13faf8719c508fed1f69899cf be1233b6266a8f56f7d0748e509b54d8597d4d1818ec57c2604f8770c178cafe bd4c2bb06301c8c19d92c4d781e4e356bd874db10f57bfd981c74599fa7f65b6 185f1c92c132c12f6156618a81c2309d1d7c28b802acad57da54eddcc4945edd .</xml_signature>
</file_info>
- <file_info>
<name>hadam3p_npdh_2005_2_006583539.zip</name>
<nbytes>13594.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>ad0b9311e63eae39341d7c152f99ae2b</md5_cksum>
<status>1</status>
<url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/hadam3p_npdh_2005_2_006583539.zip</url>
</file_info>
- <file_info>
<name>HadISST_SI_N96_2005_12_2008_01f.gz</name>
<nbytes>1911554.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>59caa2402546b15f980de5ddf9032af7</md5_cksum>
<status>1</status>
<url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/HadISST_SI_N96_2005_12_2008_01f.gz</url>
</file_info>
- <file_info>
<name>HadISST_SST_N96_2005_12_2008_01f.gz</name>
<nbytes>7302546.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>b3670c2ae3962a3ea670f6b21c0b325e</md5_cksum>
<status>1</status>
<url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/HadISST_SST_N96_2005_12_2008_01f.gz</url>
</file_info>
- <file_info>
<name>so2dms_N96_2005_12_2008_02.gz</name>
<nbytes>2593529.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>39c720e08d7d4d62eb2b2e8713654996</md5_cksum>
<status>1</status>
<url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/so2dms_N96_2005_12_2008_02.gz</url>
</file_info>
- <file_info>
<name>2005_12_init.gz</name>
<nbytes>30079572.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>25bd34dea2e71348e7bc9a7f8c52b16c</md5_cksum>
<status>1</status>
<url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/2005_12_init.gz</url>
</file_info>
- <file_info>
<name>ic19610215_14_N96.gz</name>
<nbytes>1311925.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>4ba578c9223a90111eb90395845ba273</md5_cksum>
<status>1</status>
<url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/ic19610215_14_N96.gz</url>
</file_info>
- <file_info>
<name>hadam3p_npdh_2005_2_006583539_0_1.zip</name>
<nbytes>26419294.000000</nbytes>
<max_nbytes>80000000.000000</max_nbytes>
<md5_cksum>185c7982ff7f2e20809c4f677135d7c5</md5_cksum>
<generated_locally />
<status>1</status>
<upload_when_present />
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
- <persistent_file_xfer>
<num_retries>49</num_retries>
<first_request_time>1266656934.528933</first_request_time>
<next_request_time>1267269026.580180</next_request_time>
<time_so_far>10657.860812</time_so_far>
<last_bytes_xferred>26419294.000000</last_bytes_xferred>
</persistent_file_xfer>
- <signed_xml>
<name>hadam3p_npdh_2005_2_006583539_0_1.zip</name>
<generated_locally />
<upload_when_present />
<max_nbytes>80000000</max_nbytes>
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
</signed_xml>
<xml_signature>40441c50412715f69240e9b884da777843fa697d3373800e866b66606cb6d9ba 2cc41fac1321c1df1addc5106514428e3af0ca4b3a4d06bfb57d79c74abb5e47 7533bc1175f8d6509d576fd174863cb189bdf3e5d94eb74f4f5d60e0263a9871 3ee88dba0278a5d6f668cddc08cd5649e3573b12862635488acc57c882d9c9a1 .</xml_signature>
</file_info>
- <file_info>
<name>hadam3p_npdh_2005_2_006583539_0_2.zip</name>
<nbytes>21088403.000000</nbytes>
<max_nbytes>50000000.000000</max_nbytes>
<md5_cksum>5b4b72ed85f186d88585e43416e61a4a</md5_cksum>
<generated_locally />
<status>1</status>
<upload_when_present />
<url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
- <persistent_file_xfer>
<num_retries>50</num_retries>
<first_request_time>1266656934.528933</first_request_time>
<next_request_time>1267267857.970708</next_request_time>
<time_so_far>13629.505518</time_so_far>
<last_bytes_xferred>21088403.000000</last_bytes_xferred>
</persistent_file_xfer>
- <signed_xml>
<name>hadam3p_npdh_2005_2_006583539_0_2.zip</name>
<generated_locally />
<upload_when_present />
<max_nbytes>50000000</max_nbytes>
<url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
</signed_xml>
<xml_signature>29a233433c66d5cd17f3ae2ada32a21075b01cbfb3d71848e10128a0ad0590da 0d1c747ef47c146503adca4f1e72873a3e3dcd6e7511fa7b14e73491fd828071 10ef94fa9b7a0d83ec9d350c3dc8ed811c0334dc83919b84d00e6c008f66e9f7 141bf2118819aa45235a5377286313a1a00ee9323ca18c93760cddf0df64f373 .</xml_signature>
</file_info>
- <file_info>
<name>hadam3p_npdh_2005_2_006583539_0_3.zip</name>
<nbytes>217706.000000</nbytes>
<max_nbytes>50000000.000000</max_nbytes>
<md5_cksum>7cfdd97cde125f7aac02d63e7f145199</md5_cksum>
<generated_locally />
<status>0</status>
<uploaded />
<upload_when_present />
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
- <signed_xml>
<name>hadam3p_npdh_2005_2_006583539_0_3.zip</name>
<generated_locally />
<upload_when_present />
<max_nbytes>50000000</max_nbytes>
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
</signed_xml>
<xml_signature>5eafdd3cadaf9e5cb39db42d0ad89c89006fbf31860f9d7a6573b01afb4ab1db 190645d3c5a86ffae6c013b602282592cc2c3b504b19a6004184089f28c22165 c27444b4a39bef05d1c57187df73b105a2261b17ac4e4815e32d3c4c885a8e2e 72a3b174a83c1d8f657da82b552d62219873286215b82c61e90926191c2995d0 .</xml_signature>
</file_info>
- <file_info>
<name>hadsm3fub_jr5f_006445709.zip</name>
<nbytes>11136.000000</nbytes>
<max_nbytes>0.000000</max_nbytes>
<md5_cksum>988c2a91e0f2d780c74b90a91002799c</md5_cksum>
<status>1</status>
<url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/hadsm3fub_jr5f_006445709.zip</url>
</file_info>
- <file_info>
<name>hadsm3fub_jr5f_006445709_8_1.zip</name>
<nbytes>0.000000</nbytes>
<max_nbytes>50000000.000000</max_nbytes>
<generated_locally />
<status>0</status>
<upload_when_present />
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
- <signed_xml>
<name>hadsm3fub_jr5f_006445709_8_1.zip</name>
<generated_locally />
<upload_when_present />
<max_nbytes>50000000</max_nbytes>
<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
</signed_xml>
<xml_signature>456b4fd01bc475145f8197f0c603a94d3c6bb57a6f43de9d432e4519da056853 1368d1666dbdf82b8ec08b70d3b002dfdea9489814a7dbc38cb19e2846962e92 51c10af51eac110e537c7c3f6c82bc1aa6e8c117a7f004672eb9bcba76186211 5cd21d830faa3f06661149b580e24f5db2ad239a19224f0605e015a3b2fe800e .</xml_signature>
</file_info>
- <file_info>
ID: 39042 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 39044 - Posted: 27 Feb 2010, 10:09:49 UTC

The server disks have been filled up with the hundreds of megabytes of data being uploaded.
When this happens they shut down to protect the data from loss.
Milo is currently moving data.

*********************

Below is a sample of what info is needed to identify the upload servers.
The rest isn\'t needed.

<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
<signed_xml>
<name>hadam3p_m29t_1973_2_1006324107_0_1.zip</name>

<url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
<signed_xml>
<name>hadam3p_m29t_1973_2_1006324107_0_2.zip</name>

<url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
<signed_xml>
<name>hadam3p_m29t_1973_2_1006324107_0_3.zip</name>



Backups: Here
ID: 39044 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 39054 - Posted: 27 Feb 2010, 14:00:47 UTC
Last modified: 27 Feb 2010, 14:01:07 UTC

Thanks, Les.

Hi again, Bill

Your two #2 files can\'t upload at the moment because their upload server, cpdn-upload1.comlab is now down. See Les\'s post in the News thread (link in my signature).

But I would have expected your two #1 files to upload as their server, uploader.oerc, has been up since yesterday when Milo replaced the disk. I see that the attempted upload of one of these files generated a PID error (probably something wrong on the server):

27/02/2010 05:30:24 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 05:30:32 climateprediction.net [error] Error reported by file upload server: [hadam3p_npdh_2005_2_006583539_0_1.zip] locked by file_upload_handler PID=28679


I\'ll ask Milo about this.
Cpdn news
ID: 39054 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 39055 - Posted: 27 Feb 2010, 15:06:59 UTC - in response to Message 39054.  

Thanks for keeping me informed, although I\'m not sure how much further we have moved in understanding the problem. Is there any more information that I can provide?

Yes the #2 files have a connect() error which (presumably means the server isn\'t available) while the #1 files have an HTTP error, which is the one I\'ve had all along. I copy the current position as the upload is being rejected but now it doesn\'t have a PID attached.

Bill
==================================================================
27/02/2010 14:53:33 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_1.zip
27/02/2010 14:53:33 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_2.zip
27/02/2010 14:53:33 climateprediction.net Restarting task hadsm3fub_jr5f_006445709_8 using hadsm3 version 607
27/02/2010 14:53:33 climateprediction.net Restarting task hadsm3fub_jnfh_006440887_7 using hadsm3 version 607
27/02/2010 14:53:33 climateprediction.net Restarting task hadsm3fub_jnfk_006440890_0 using hadsm3 version 607
27/02/2010 14:53:33 climateprediction.net Restarting task hadsm3fub_jneu_006440864_3 using hadsm3 version 607
27/02/2010 14:53:33 rosetta@home Sending scheduler request: To fetch work.
27/02/2010 14:53:33 rosetta@home Requesting new tasks for GPU
27/02/2010 14:53:35 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: connect() failed
27/02/2010 14:53:35 climateprediction.net Backing off 54 min 19 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
27/02/2010 14:53:35 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 14:53:38 rosetta@home Scheduler request completed: got 0 new tasks
27/02/2010 14:54:03 Project communication failed: attempting access to reference site
27/02/2010 14:54:10 Internet access OK - project servers may be temporarily down.
27/02/2010 14:58:43 Project communication failed: attempting access to reference site
27/02/2010 14:58:43 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_1.zip: HTTP error
27/02/2010 14:58:43 climateprediction.net Backing off 1 hr 7 min 28 sec on upload of hadam3p_npdg_2000_2_006583538_1_1.zip
27/02/2010 14:58:43 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_2.zip
27/02/2010 14:58:49 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
27/02/2010 14:58:49 climateprediction.net Backing off 1 hr 43 min 11 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
27/02/2010 14:58:49 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: connect() failed
27/02/2010 14:58:49 climateprediction.net Backing off 23 min 54 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
27/02/2010 14:58:51 Internet access OK - project servers may be temporarily down.
ID: 39055 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 39056 - Posted: 27 Feb 2010, 17:43:51 UTC
Last modified: 27 Feb 2010, 17:45:12 UTC

Here\'s the Server Status page which shows why your #2 files can\'t upload at the moment (though why they didn\'t earlier I don\'t know). It takes ages for large volumes of data to be copied off.

Milo thinks the PID error message that appeared just once could have been because uploader.oerc is still congested, handling a big backlog of uploads.
Cpdn news
ID: 39056 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 39064 - Posted: 27 Feb 2010, 21:02:49 UTC

Bill, could we please confirm that the computer with the problem has Boinc 6.4.7? You can right-click on the tray icon to check.
Cpdn news
ID: 39064 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 39066 - Posted: 28 Feb 2010, 6:03:00 UTC - in response to Message 39064.  

The computer is currently running 6.10.18 and was recently updated (ie after I initially had the issue).

Bill
ID: 39066 · Report as offensive     Reply Quote
Bill H

Send message
Joined: 11 May 07
Posts: 36
Credit: 1,485,638
RAC: 0
Message 39067 - Posted: 28 Feb 2010, 6:29:32 UTC - in response to Message 39064.  
Last modified: 28 Feb 2010, 6:30:42 UTC

Just in case this helps...

All the servers appear to be up and working although my work isn\'t making any progress in completing.
The names appear to be OK (eg. hadam3p_npdg_2000_2_006583538_1_1.zip)
The percentage complete sits at 100%
The size sits at 25.21/25.21
Elapsed time at 2:51:47
Speed at 8648.45 KBps (It comes up once doesn\'t change - but different on each try)
Status Uploading
================
Netstat reports Boinc connections
127.0.0.1:31416 to My PC (ESTABLISHED)
192.168.0.2:49442 to cpdb-upload1:http (FIN_WAIT_1)
192.168.0.2:49452 to gv-in-f147:http (CLOSE_WAIT)
192.168.0.2:49453 to gv-in-f147:http (CLOSE_WAIT)
192.168.0.2:49454 to uploader:http (ESTABLISHED)

then 5 mins later
49452 & 49453 have gone and
49442 is still as same status
49454 has moved to FIN_WAIT_1
plus
192.168.0.2:49455 to 216.239.59.106:http at CLOSE_WAIT
192.168.0.2:49456 to 216.239.59.106:http at CLOSE_WAIT

At all these time network still very active.

Apologies if this means nothing!

Bill
ID: 39067 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · Next

Message boards : Number crunching : Upload process locked

©2024 climateprediction.net