Message boards :
Number crunching :
Upload process locked
Message board moderation
Previous · 1 · 2 · 3 · 4 · 5 · Next
Author | Message |
---|---|
Send message Joined: 11 May 07 Posts: 36 Credit: 1,485,638 RAC: 0 |
I run my Pc mainly on Vista but also have a Windows 7 disk. I have been using this W7 recently due to the high network load generated by the issue on Vista. The W7 Climate model has now completed and has the same symptoms. Bill H ================================================================= 28/02/2010 06:32:38 Starting BOINC client version 6.10.18 for windows_x86_64 28/02/2010 06:32:38 log flags: file_xfer, sched_ops, task 28/02/2010 06:32:38 Libraries: libcurl/7.19.4 OpenSSL/0.9.8l zlib/1.2.3 28/02/2010 06:32:38 Data directory: D:\\ProgramData\\BOINC 28/02/2010 06:32:38 Running under account Bill 28/02/2010 06:32:38 Processor: 4 AuthenticAMD AMD Phenom(tm) II X4 945 Processor [AMD64 Family 16 Model 4 Stepping 2] 28/02/2010 06:32:38 Processor: 512.00 KB cache 28/02/2010 06:32:38 Processor features: fpu tsc pae nx sse sse2 pni 3dnow mmx 28/02/2010 06:32:38 OS: Microsoft Windows 7: Home Premium x64 Edition, (06.01.7600.00) 28/02/2010 06:32:38 Memory: 8.00 GB physical, 16.00 GB virtual 28/02/2010 06:32:38 Disk: 465.83 GB total, 421.89 GB free 28/02/2010 06:32:38 Local time is UTC +0 hours 28/02/2010 06:32:38 NVIDIA GPU 0: GeForce 9500 GT (driver version 19562, CUDA version 3000, compute capability 1.1, 1024MB, 88 GFLOPS peak) 28/02/2010 06:32:39 Not using a proxy 28/02/2010 06:32:39 rosetta@home URL http://boinc.bakerlab.org/rosetta/; Computer ID 1174562; resource share 100 28/02/2010 06:32:39 climateprediction.net URL http://climateprediction.net/; Computer ID 1022723; resource share 100 28/02/2010 06:32:39 rosetta@home General prefs: from rosetta@home (last modified 12-May-2007 22:12:12) 28/02/2010 06:32:39 rosetta@home Host location: none 28/02/2010 06:32:39 rosetta@home General prefs: using your defaults 28/02/2010 06:32:39 Preferences limit memory usage when active to 4095.59MB 28/02/2010 06:32:39 Preferences limit memory usage when idle to 7372.06MB 28/02/2010 06:32:39 Preferences limit disk usage to 100.00GB 28/02/2010 06:32:39 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip 28/02/2010 06:32:39 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip 28/02/2010 06:32:39 climateprediction.net Restarting task hadsm3fub_kdqo_006474986_9 using hadsm3 version 607 28/02/2010 06:32:39 climateprediction.net Restarting task hadsm3fub_jnyh_006441571_7 using hadsm3 version 607 28/02/2010 06:32:39 climateprediction.net Restarting task hadsm3fub_jnx6_006441524_8 using hadsm3 version 607 28/02/2010 06:32:48 rosetta@home Restarting task t345__boinc_filtered_loopbuild_threading_cst_lb_tex_IGNORE_THE_REST_16900_6203_0 using minirosetta version 205 28/02/2010 06:32:48 rosetta@home Sending scheduler request: To fetch work. 28/02/2010 06:32:48 rosetta@home Requesting new tasks for GPU 28/02/2010 06:32:54 rosetta@home Scheduler request completed: got 0 new tasks |
Send message Joined: 13 Jan 07 Posts: 195 Credit: 10,581,566 RAC: 0 |
I have been monitoring this thread since it started because it seems to parallel my own experiences, so Bill H is not alone in the behaviour of his models. I have 2 zip files for completed hadcm3istd models which repeatedly fail to upload, even though zip files for my current hadsm3fub models have been formed and uploaded in between. The first was formed last Tuesday, Feb 23rd, and the second on Friday night, Feb 26th. I too run AVG and I am using Windows 7. So thanks, Bill H, for persisting with this. I suspect there other silent members out there with similar symptoms who aren\'t monitoring their uploads or messages quite as assiduously. EDIT Added an extract from my message log. ============================================ 27/02/2010 08:13:19 Resuming network activity 27/02/2010 08:13:19 climateprediction.net Started upload of hadcm3istd_csap_1920_160_06020805_1_16.zip 27/02/2010 08:13:19 climateprediction.net Started upload of hadsm3fub_jpd3_006443393_8_1.zip 27/02/2010 08:13:19 climateprediction.net Sending scheduler request: To send trickle-up message. 27/02/2010 08:13:19 climateprediction.net Requesting new tasks for GPU 27/02/2010 08:13:35 climateprediction.net Scheduler request completed: got 0 new tasks 27/02/2010 08:16:23 climateprediction.net Finished upload of hadsm3fub_jpd3_006443393_8_1.zip 27/02/2010 08:18:36 Project communication failed: attempting access to reference site 27/02/2010 08:18:36 climateprediction.net Temporarily failed upload of hadcm3istd_csap_1920_160_06020805_1_16.zip: HTTP error 27/02/2010 08:18:36 climateprediction.net Backing off 1 min 0 sec on upload of hadcm3istd_csap_1920_160_06020805_1_16.zip 27/02/2010 08:19:06 climateprediction.net Started upload of hadcm3istd_cssu_1920_160_06021458_6_16.zip 27/02/2010 08:19:06 climateprediction.net Started upload of hadcm3istd_csap_1920_160_06020805_1_16.zip 27/02/2010 08:19:14 climateprediction.net [error] Error reported by file upload server: [hadcm3istd_csap_1920_160_06020805_1_16.zip] locked by file_upload_handler PID=32026 27/02/2010 08:19:14 climateprediction.net Temporarily failed upload of hadcm3istd_csap_1920_160_06020805_1_16.zip: transient upload error 27/02/2010 08:19:14 climateprediction.net Backing off 1 min 40 sec on upload of hadcm3istd_csap_1920_160_06020805_1_16.zip 27/02/2010 08:20:55 climateprediction.net Started upload of hadcm3istd_csap_1920_160_06020805_1_16.zip 27/02/2010 08:22:51 BOINC can\'t access Internet - check network connection or proxy configuration. 27/02/2010 08:24:23 climateprediction.net Temporarily failed upload of hadcm3istd_cssu_1920_160_06021458_6_16.zip: HTTP error 27/02/2010 08:24:23 climateprediction.net Backing off 3 hr 58 min 29 sec on upload of hadcm3istd_cssu_1920_160_06021458_6_16.zip ========================= |
Send message Joined: 11 May 07 Posts: 36 Credit: 1,485,638 RAC: 0 |
A slightly different message set from Windows 7 Bill H ============================================================== 28/02/2010 06:51:04 climateprediction.net Requesting new tasks for GPU 28/02/2010 06:51:25 climateprediction.net Scheduler request completed: got 0 new tasks 28/02/2010 06:51:25 climateprediction.net Message from server: No work sent 28/02/2010 06:53:53 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip 28/02/2010 06:54:25 Project communication failed: attempting access to reference site 28/02/2010 06:54:25 climateprediction.net Temporarily failed upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip: HTTP error 28/02/2010 06:54:25 climateprediction.net Backing off 37 min 18 sec on upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip 28/02/2010 06:54:43 Internet access OK - project servers may be temporarily down. 28/02/2010 06:59:11 Project communication failed: attempting access to reference site 28/02/2010 06:59:11 climateprediction.net Temporarily failed upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip: HTTP error 28/02/2010 06:59:11 climateprediction.net Backing off 28 min 58 sec on upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip 28/02/2010 06:59:27 Internet access OK - project servers may be temporarily down. 28/02/2010 07:28:09 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip 28/02/2010 07:31:43 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip 28/02/2010 07:33:27 Project communication failed: attempting access to reference site 28/02/2010 07:33:27 climateprediction.net Temporarily failed upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip: HTTP error 28/02/2010 07:33:27 climateprediction.net Backing off 2 hr 46 min 30 sec on upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip 28/02/2010 07:33:41 Internet access OK - project servers may be temporarily down. 28/02/2010 07:37:01 Project communication failed: attempting access to reference site 28/02/2010 07:37:01 climateprediction.net Temporarily failed upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip: HTTP error 28/02/2010 07:37:01 climateprediction.net Backing off 1 hr 44 min 1 sec on upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip 28/02/2010 07:37:09 Internet access OK - project servers may be temporarily down. |
Send message Joined: 11 May 07 Posts: 36 Credit: 1,485,638 RAC: 0 |
It\'s reassuring to know that this isn\'t just a quirk of my PC and that others have the issue too. All servers are reported to be up so that isn\'t the reason and running the upload at 5:30am should (?) avoid network congestion too! Boinc IS uploading something and this is (presumably) being rejected for a good (or perhaps not so good) reason at the server end. Is there a server log file that might give a clue? Still there must be a lot of systems that don\'t have this problem as it would seem that the majority of users are OK. BTW it\'s not that I was monitoring uploads, more that network performance \"fell off a cliff\" so I couldn\'t ignore it! :-) Cheers Bill |
Send message Joined: 13 Jan 07 Posts: 195 Credit: 10,581,566 RAC: 0 |
I have in fact tried transferring my models with the stuck zip uploads to my laptop which runs Windows XP and initiating the upload from there, but the result is the same. So it\'s not the PC, not the Windows version. It is the same router, though. |
Send message Joined: 16 Feb 06 Posts: 7 Credit: 1,669,956 RAC: 0 |
Me too... BOINC 6.6.36 ================== 28/02/2010 01:21:15 climateprediction.net Started upload of hadam3p_nqq6_2003_2_006585292_1_1.zip 28/02/2010 01:26:29 Project communication failed: attempting access to reference site 28/02/2010 01:26:29 climateprediction.net Temporarily failed upload of hadam3p_nqq6_2003_2_006585292_1_1.zip: HTTP error 28/02/2010 01:26:29 climateprediction.net Backing off 2 hr 22 min 2 sec on upload of hadam3p_nqq6_2003_2_006585292_1_1.zip 28/02/2010 01:26:35 Internet access OK - project servers may be temporarily down. 28/02/2010 03:48:32 climateprediction.net Started upload of hadam3p_nqq6_2003_2_006585292_1_1.zip 28/02/2010 03:53:47 Project communication failed: attempting access to reference site 28/02/2010 03:53:47 climateprediction.net Temporarily failed upload of hadam3p_nqq6_2003_2_006585292_1_1.zip: HTTP error 28/02/2010 03:53:47 climateprediction.net Backing off 3 hr 8 min 39 sec on upload of hadam3p_nqq6_2003_2_006585292_1_1.zip 28/02/2010 03:57:43 BOINC can\'t access Internet - check network connection or proxy configuration. 28/02/2010 05:07:39 climateprediction.net Sending scheduler request: To send trickle-up message. 28/02/2010 05:07:39 climateprediction.net Not reporting or requesting tasks 28/02/2010 05:07:44 climateprediction.net Scheduler request completed 28/02/2010 07:02:28 climateprediction.net Started upload of hadam3p_nqq6_2003_2_006585292_1_1.zip 28/02/2010 07:07:39 Project communication failed: attempting access to reference site 28/02/2010 07:07:39 climateprediction.net Temporarily failed upload of hadam3p_nqq6_2003_2_006585292_1_1.zip: HTTP error 28/02/2010 07:07:39 climateprediction.net Backing off 53 min 8 sec on upload of hadam3p_nqq6_2003_2_006585292_1_1.zip 28/02/2010 07:11:37 BOINC can\'t access Internet - check network connection or proxy configuration. 28/02/2010 08:00:49 climateprediction.net Started upload of hadam3p_nqq6_2003_2_006585292_1_1.zip 28/02/2010 08:06:01 Project communication failed: attempting access to reference site 28/02/2010 08:06:01 climateprediction.net Temporarily failed upload of hadam3p_nqq6_2003_2_006585292_1_1.zip: HTTP error 28/02/2010 08:06:01 climateprediction.net Backing off 3 hr 28 min 31 sec on upload of hadam3p_nqq6_2003_2_006585292_1_1.zip 28/02/2010 08:09:42 BOINC can\'t access Internet - check network connection or proxy configuration. 28/02/2010 10:21:52 climateprediction.net Sending scheduler request: To send trickle-up message. 28/02/2010 10:21:52 climateprediction.net Not reporting or requesting tasks 28/02/2010 10:21:57 climateprediction.net Scheduler request completed |
Send message Joined: 29 Sep 04 Posts: 2363 Credit: 14,611,758 RAC: 0 |
Many thanks to everyone posting these reports of failed zip file uploads. Lockleys, you probably know that HadCM evenly-numbered files upload to uploader.oerc as do all three HadSM files. John, I can see that your HadAM3P #1 file upload\'s been failing for at least 10 hours. Have files #2 and #3 uploaded? I\'ve restarted a HADSM at 32% which had been suspended so I could run beta models; that will generate a file soon and I\'ll watch it upload. Cpdn news |
Send message Joined: 13 Jan 07 Posts: 195 Credit: 10,581,566 RAC: 0 |
Yes, my stuck zips are aiming for uploader.oerc . For reference, I\'m using BOINC 6.10.18 . If there\'s any possibility that the BOINC version could be a factor, I\'m willing to downgrade and give that a whirl. |
Send message Joined: 29 Sep 04 Posts: 2363 Credit: 14,611,758 RAC: 0 |
I don\'t think the Boinc version should make any difference. Bill had 6.4.7 when his problem started; he upgraded Boinc but it made no difference. Cpdn news |
Send message Joined: 16 Feb 06 Posts: 7 Credit: 1,669,956 RAC: 0 |
# John, I can see that your HadAM3P #1 file upload\'s been failing # for at least 10 hours. Have files #2 and #3 uploaded? I\'m not certain how to check... would you like me to post the 1200 lines of log since 24/02/2010 09:59:44 when I last restarted? I can\'t see anything in there relating to an hadam3p_nqq6_2003_2_006585292_1_2.zip or _3.zip file, though this happened on Friday... 26/02/2010 21:39:17 climateprediction.net Started upload of hadam3p_nj9z_2002_2_006575637_1_1.zip 26/02/2010 21:39:18 climateprediction.net Finished upload of hadam3p_nj9z_2002_2_006575637_1_1.zip (I assume this is for a different WU, though). My BOINC folder contains the following zip files... F:\\Boinc>dir/s/b *.zip F:\\Boinc\\projects\\climateprediction.net\\hadam3p_data_6.14_windows_intelx86.zip F:\\Boinc\\projects\\climateprediction.net\\hadam3p_ni03_2002_2_006573985.zip F:\\Boinc\\projects\\climateprediction.net\\hadam3p_nqq6_2003_2_006585292.zip F:\\Boinc\\projects\\climateprediction.net\\hadam3p_nqq6_2003_2_006585292_1_1.zip F:\\Boinc\\projects\\climateprediction.net\\hadam3p_se_6.14_windows_intelx86.zip F:\\Boinc\\projects\\climateprediction.net\\hadam3p_um_6.14_windows_intelx86.zip F:\\Boinc\\projects\\climateprediction.net\\hadsm3mh_data_6.02_windows_intelx86.zip F:\\Boinc\\projects\\climateprediction.net\\hadsm3mh_se_6.02_windows_intelx86.zip F:\\Boinc\\projects\\climateprediction.net\\hadsm3mh_um_6.02_windows_intelx86.zip F:\\Boinc\\projects\\climateprediction.net\\hadsm3_data_6.07_windows_intelx86.zip F:\\Boinc\\projects\\climateprediction.net\\hadsm3_se_6.07_windows_intelx86.zip F:\\Boinc\\projects\\climateprediction.net\\hadsm3_um_6.07_windows_intelx86.zip F:\\Boinc\\slots\\0\\cpdnout1.zip F:\\Boinc\\slots\\0\\cpdnout2.zip F:\\Boinc\\slots\\0\\cpdnout3.zip F:\\Boinc\\slots\\0\\hadam3p_data_6.14_windows_intelx86.zip F:\\Boinc\\slots\\0\\hadam3p_ni03_2002_2_006573985.zip F:\\Boinc\\slots\\0\\hadam3p_se_6.14_windows_intelx86.zip F:\\Boinc\\slots\\0\\hadam3p_um_6.14_windows_intelx86.zip |
Send message Joined: 29 Sep 04 Posts: 2363 Credit: 14,611,758 RAC: 0 |
John, thanks but I don\'t think we need 1200 lines of log! If your #2 and #3 zip files are also unable to upload you\'ll see them in the Transfers tab. If they\'ve disappeared from there they\'ve uploaded. Has the #1 zip file for task 10829668 (hadam3p_nqq6_2003_2_006585292_1) been stuck in Transfers since Friday 19 Feb? Cpdn news |
Send message Joined: 13 Jan 07 Posts: 195 Credit: 10,581,566 RAC: 0 |
Lockleys, you probably know that HadCM evenly-numbered files upload to uploader.oerc as do all three HadSM files. I guess I\'m surprised that my SM zips are loading but my CM zips are stuck. Could this be a size-related issue? |
Send message Joined: 29 Sep 04 Posts: 2363 Credit: 14,611,758 RAC: 0 |
My HadSM generated its #1 file an hour ago and it uploaded immediately. Perhaps size-related. But Thorsten reported on 24 Feb that his big #1 and small #3 files were stuck (I think since 23 Feb), yet they both uploaded on 26 Feb. So as soon as Milo installed the new disk in uploader.oerc on Friday 26 it accepted large files. I\'m wondering whether all the files that remain stuck have a date-related problem; perhaps they all first tried to upload while the old uploader.oerc disk was behaving badly and before Milo took it down. That\'s just a theory. Cpdn news |
Send message Joined: 16 Feb 06 Posts: 7 Credit: 1,669,956 RAC: 0 |
# If your #2 and #3 zip files are also unable # to upload you\'ll see them in the Transfers tab. Oh, OK. They\'ve gone, then. # Has the #1 zip file for task 10829668 # (hadam3p_nqq6_2003_2_006585292_1) been # stuck in Transfers since Friday 19 Feb? I guess so... that\'s the date stamp on the zip file: 19/02/2010 11:28 26,414,500 hadam3p_nqq6_2003_2_006585292_1_1.zip |
Send message Joined: 13 Jan 07 Posts: 195 Credit: 10,581,566 RAC: 0 |
I\'m wondering whether all the files that remain stuck have a date-related problem; perhaps they all first tried to upload while the old uploader.oerc disk was behaving badly and before Milo took it down. That\'s just a theory. The second of my stuck CM zips was only created 48 hours ago when the model reached 160 years. The first one is definitely from the first days of the uploadrer.oerc failure. |
Send message Joined: 11 May 07 Posts: 36 Credit: 1,485,638 RAC: 0 |
The two first models were stuck on 20/2/2010 one at 9:08 the other at 18:31, the latest was this weekend 27/2/2010 at 20:40. They are mostly 20Mbytes+ Bill H |
Send message Joined: 16 Feb 06 Posts: 7 Credit: 1,669,956 RAC: 0 |
I think I\'ve found the culprit, at least on my machine: AVG Anti-Virus. I think it installs a transparent http proxy which is interfering with the BOINC upload mechanism (perhaps just making it time out?). To get my file to upload, I rebooted in \"safe mode with networking\" (to make sure AVG wasn\'t loaded -- just disabling \"Web Shield\" doesn\'t seem to be enough) and started BOINC. The file uploaded first time. |
Send message Joined: 11 May 07 Posts: 36 Credit: 1,485,638 RAC: 0 |
Yep - works for me too! Well done for isolating the problem. Let\'s see what the team comes up with for longer term BOINC working? Bill H |
Send message Joined: 13 Jan 07 Posts: 195 Credit: 10,581,566 RAC: 0 |
Well done, John. Bottle of virtual champagne from me. Don\'t know whether the root cause you suggest is right or not. Don\'t terribly care at this moment. But the solution works a treat. Thanks. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Sorry, I\'d forgotten about that. I found out about problems with the new version of AVG some time ago. (Last year?) As you say, it stops uploads. Even isolating the BOINC folders didn\'t help. I think in the end I had to disable ALL active scanning to get the transfers to work. In the end I deleted the new version and went back to the old version. When they stop updating this older version, I\'ll have to find a new brand of AV. :( I posted about it on our other forum somewhere. Backups: Here |
©2024 climateprediction.net