... however, I was wondering why the server has failed in the first place.

With this project, there isn't really A server.
The data, for instance, is stored on a Network-attached storage (NAS) system, which isn't necessarily in the same room as the server running the other programs, (including this forum, and all of the user pages). This storage system is connected by "mounting" it, and sometimes various items become "unmounted". So the server no longer has access to that device.

And all "servers" are now just virtual machines, running on servers with Apache as the OS.

Hello everyone. I am just reporting the latest messages.

thank you to staff and volunteers for doing your best under the circumstances.

02/09/2014 6:10:49 AM | | Project communication failed: attempting access to reference site
02/09/2014 6:10:51 AM | | Internet access OK - project servers may be temporarily down.
02/09/2014 6:38:01 AM | climateprediction.net | Sending scheduler request: To send trickle-up message.
02/09/2014 6:38:01 AM | climateprediction.net | Not requesting tasks: don't need
02/09/2014 6:38:04 AM | climateprediction.net | Scheduler request completed
02/09/2014 6:54:28 AM | climateprediction.net | Started upload of hadam3p_eu_l6jl_2013_1_008819706_2_13.zip
02/09/2014 6:56:45 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_l6jl_2013_1_008819706_2_13.zip: No such file or directory
02/09/2014 6:56:45 AM | climateprediction.net | Temporarily failed upload of hadam3p_eu_l6jl_2013_1_008819706_2_13.zip: transient upload error
02/09/2014 6:56:45 AM | climateprediction.net | Backing off 05:18:40 on upload of hadam3p_eu_l6jl_2013_1_008819706_2_13.zip
02/09/2014 6:57:34 AM | climateprediction.net | Started upload of hadam3p_pnw_uitn_1996_1_008890995_0_10.zip
02/09/2014 6:57:57 AM | climateprediction.net | Finished upload of hadam3p_pnw_uitn_1996_1_008890995_0_10.zip
02/09/2014 7:38:43 AM | climateprediction.net | Sending scheduler request: To send trickle-up message.
02/09/2014 7:38:43 AM | climateprediction.net | Not requesting tasks: don't need
02/09/2014 7:38:47 AM | climateprediction.net | Scheduler request completed

Is there any news on progress in fixing the servers so that we can upload zip files for the hadam3p_eu. There is no point in running the WU�s is the zips just end up taking up space in the transfer tab.

---

Nothing new. The server still shows red on the status page; it'll turn green, telling the world uploads can continue before moderators receive a message from staff. Nonetheless, one of us will post somewhere along the way.

---

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.

hello team, have multiple projects in the transfer folder waiting for few days now... showing some server in red ..... is this normal ?


04.09.2014 14:49:38 climateprediction.net Started upload of hadam3p_eu_a1ru_2013_1_008518639_0_10.zip
04.09.2014 14:50:00 Project communication failed: attempting access to reference site
04.09.2014 14:50:00 climateprediction.net Temporarily failed upload of hadam3p_eu_i7ic_2013_1_008774168_0_3.zip: HTTP error
04.09.2014 14:50:00 climateprediction.net Backing off 2 hr 40 min 47 sec on upload of hadam3p_eu_i7ic_2013_1_008774168_0_3.zip
04.09.2014 14:50:00 climateprediction.net Temporarily failed upload of hadam3p_eu_a1ru_2013_1_008518639_0_10.zip: HTTP error
04.09.2014 14:50:00 climateprediction.net Backing off 3 hr 49 min 52 sec on upload of hadam3p_eu_a1ru_2013_1_008518639_0_10.zip
04.09.2014 14:50:04 Internet access OK - project servers may be temporarily down.
04.09.2014 17:20:22 climateprediction.net Started upload of hadam3p_eu_a1ru_2013_1_008518639_0_9.zip
04.09.2014 17:20:22 climateprediction.net Started upload of hadam3p_eu_i7ic_2013_1_008774168_0_4.zip
04.09.2014 17:20:45 Project communication failed: attempting access to reference site
04.09.2014 17:20:45 climateprediction.net Temporarily failed upload of hadam3p_eu_a1ru_2013_1_008518639_0_9.zip: HTTP error
04.09.2014 17:20:45 climateprediction.net Backing off 1 hr 4 min 43 sec on upload of hadam3p_eu_a1ru_2013_1_008518639_0_9.zip
04.09.2014 17:20:47 Internet access OK - project servers may be temporarily down.
04.09.2014 17:22:00 Project communication failed: attempting access to reference site
04.09.2014 17:22:00 climateprediction.net Temporarily failed upload of hadam3p_eu_i7ic_2013_1_008774168_0_4.zip: HTTP error
04.09.2014 17:22:00 climateprediction.net Backing off 1 min 0 sec on upload of hadam3p_eu_i7ic_2013_1_008774168_0_4.zip
04.09.2014 17:22:02 Internet access OK - project servers may be temporarily down.

Both tasks are 'European regional model'. The server supporting that project is down. See the post immediately above yours and this one, a dew says ago, also in this thread:
http://climateapps2.oerc.ox.ac.uk/cpdnboinc/forum_thread.php?id=7705&nowrap=true#49922

Welcome to the boards.

---

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.

It would be kinda neat to have some info on when this issue "might" be resolved. Like a week or 10 days.

---

<img border="0" src="http://boinc.mundayweb.com/one/stats.php?userID=343" />

I'll ask for it to be looked at Friday, UK time.
But then we have the weekend, and, as regular readers here know, that's when one or more serves fail. :(

PS
uploader.oerc showing red is just a furphy.
Plus I'm not sure that it's even in use at the moment.

All the failures I have and have seen are related to trying to create a file on their network drives. I have seen instances of this exact directory complaint back in Nov 2013. I am just going to TURN OFF EU processing until the existing files drain.

9/4/2014 6:19:23 PM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_p4z6_2013_.....zip: No such file or directory

It looks like a simple missing directory or access rights problem somewhere in the path that prevents the file being created on that volume.
/storage/cpdn-restarts/incoming/uploader/

---

It's probably as I said in my post further down this thread, here.

Just checked and uploader2.oerc has gone yellow. Re-enabled internet access for BOINC and my 15 zips have started to upload.....

....First two uploaded successfully. Thanks to those at the business end!

Edit: 4 gone now if a trifle slowly but that may be more to do with my connection than anything else...... 10 gone now, interestingly number of tasks in progress has continued to rise. I thought it might drop as all the backlog of completed tasks reported.

Dave

And sadly the 13.zips which go to another server are still failing

Fri 05 Sep 2014 12:14:05 BST | climateprediction.net | Started upload of hadam3p_eu_e42e_2013_1_008847057_1_13.zip
Fri 05 Sep 2014 12:25:53 BST | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_e42e_2013_1_008847057_1_13.zip: No such file or directory
Fri 05 Sep 2014 12:25:53 BST | climateprediction.net | Temporarily failed upload of hadam3p_eu_e42e_2013_1_008847057_1_13.zip: transient upload error
Fri 05 Sep 2014 12:25:53 BST | climateprediction.net | Backing off 00:02:27 on upload of hadam3p_eu_e42e_2013_1_008847057_1_13.zip So Network activity suspended again till I have a few non final zips to upload.

I have the same problem. All of the back-uped zip files have cleared except for the _13 zip. It is still stuck at 100%. This means that the finished WU can�t report and clear from my system.

---

all cleared except the pesky _13 zip files. Shame it takes 35m upload to fail. But there has been progress

And as Les said, it is now the weekend so I have disabled network activity till Monday.

Hi,

I am getting the same type of error HTTP ERROR as of a few days ago. I was wanting it to work itself out. This is what is going on for Work unit 8941265.
name hadam3p_eu_jc77_2013_1_008795287.
application UK Met Office HadAM3P-HadRM3P Europe
created 4 Jul 2014 20:58:00 UTC

What I was wanting to know is if this is something new but with a different task or a different problem all together or just a continuation of an ongoing problem but with some task in general. This is the first real problem with this project that I had.

Any news of how to go about getting this HTTP ERROR uploaded to finish this work unit without going to the extreme of aborting it would be great.


Thanks Timothy Dickey




9/7/2014 12:06:59 AM | | Starting BOINC client version 7.4.8 for windows_intelx86
9/7/2014 12:06:59 AM | | log flags: file_xfer, sched_ops, task
9/7/2014 12:06:59 AM | | Libraries: libcurl/7.33.0 OpenSSL/1.0.1h zlib/1.2.8
9/7/2014 12:06:59 AM | | Running as a daemon
9/7/2014 12:06:59 AM | | Data directory: C:\Documents and Settings\All Users\Application Data\BOINC
9/7/2014 12:06:59 AM | | Running under account boinc_master
9/7/2014 12:06:59 AM | | No usable GPUs found
9/7/2014 12:06:59 AM | | Host name: xp-gateway-home
9/7/2014 12:06:59 AM | | Processor: 2 GenuineIntel Intel(R) Pentium(R) 4 CPU 3.20GHz [Family 15 Model 4 Stepping 1]
9/7/2014 12:06:59 AM | | Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss htt tm pni nx pbe
9/7/2014 12:06:59 AM | | OS: Microsoft Windows XP: Professional x86 Edition, Service Pack 3, (05.01.2600.00)
9/7/2014 12:06:59 AM | | Memory: 2.00 GB physical, 3.94 GB virtual
9/7/2014 12:06:59 AM | | Disk: 41.59 GB total, 16.14 GB free
9/7/2014 12:06:59 AM | | Local time is UTC -5 hours
9/7/2014 12:06:59 AM | | VirtualBox version: 4.2.16
9/7/2014 12:06:59 AM | climateprediction.net | URL http://climateprediction.net/; Computer ID 1304349; resource share 10
9/7/2014 12:06:59 AM | | Reading preferences override file
9/7/2014 12:06:59 AM | | Preferences:
9/7/2014 12:06:59 AM | | max memory usage when active: 1227.48MB
9/7/2014 12:06:59 AM | | max memory usage when idle: 1636.63MB
9/7/2014 12:06:59 AM | | max disk usage: 5.00GB
9/7/2014 12:06:59 AM | | max download rate: 92160 bytes/sec
9/7/2014 12:06:59 AM | | (to change preferences, visit a project web site or select Preferences in the Manager)
9/7/2014 12:06:59 AM | | Not using a proxy
9/7/2014 12:07:03 AM | | Contacting account manager at http://www.charityengine.com/
9/7/2014 12:07:03 AM | climateprediction.net | Started upload of hadam3p_eu_jc77_2013_1_008795287_0_13.zip
9/7/2014 12:07:21 AM | | Reading preferences override file
9/7/2014 12:07:21 AM | | Preferences:
9/7/2014 12:07:21 AM | | max memory usage when active: 1227.48MB
9/7/2014 12:07:21 AM | | max memory usage when idle: 1636.63MB
9/7/2014 12:07:21 AM | | max disk usage: 5.00GB
9/7/2014 12:07:21 AM | | max download rate: 92160 bytes/sec
9/7/2014 12:07:21 AM | | (to change preferences, visit a project web site or select Preferences in the Manager)
9/7/2014 12:07:25 AM | | Account manager contact succeeded
9/7/2014 12:07:38 AM | | Reading preferences override file
9/7/2014 12:07:38 AM | | Preferences:
9/7/2014 12:07:38 AM | | max memory usage when active: 1227.48MB
9/7/2014 12:07:38 AM | | max memory usage when idle: 1636.63MB
9/7/2014 12:07:38 AM | | max disk usage: 5.00GB
9/7/2014 12:07:38 AM | | max download rate: 92160 bytes/sec
9/7/2014 12:07:38 AM | | (to change preferences, visit a project web site or select Preferences in the Manager)
9/7/2014 12:09:49 AM | | Reading preferences override file
9/7/2014 12:09:49 AM | | Preferences:
9/7/2014 12:09:49 AM | | max memory usage when active: 920.61MB
9/7/2014 12:09:49 AM | | max memory usage when idle: 1329.77MB
9/7/2014 12:09:49 AM | | max disk usage: 5.00GB
9/7/2014 12:09:49 AM | | max download rate: 92160 bytes/sec
9/7/2014 12:09:49 AM | | (to change preferences, visit a project web site or select Preferences in the Manager)
9/7/2014 12:11:16 AM | climateprediction.net | update requested by user
9/7/2014 12:28:35 AM | climateprediction.net | Sending scheduler request: Requested by user.
9/7/2014 12:28:35 AM | climateprediction.net | Not requesting tasks: don't need (not highest priority project)
9/7/2014 12:28:57 AM | climateprediction.net | Scheduler request failed: Couldn't connect to server
9/7/2014 12:29:00 AM | | Project communication failed: attempting access to reference site
9/7/2014 12:29:33 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 12:30:29 AM | | Project communication failed: attempting access to reference site
9/7/2014 12:30:44 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 12:32:04 AM | | Project communication failed: attempting access to reference site
9/7/2014 12:32:17 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 12:54:42 AM | | Project communication failed: attempting access to reference site
9/7/2014 12:55:09 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 12:58:16 AM | | Project communication failed: attempting access to reference site
9/7/2014 12:58:33 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 1:03:45 AM | | Project communication failed: attempting access to reference site
9/7/2014 1:04:22 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 1:12:53 AM | | Project communication failed: attempting access to reference site
9/7/2014 1:13:26 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 1:29:35 AM | climateprediction.net | Sending scheduler request: To fetch work.
9/7/2014 1:29:35 AM | climateprediction.net | Requesting new tasks for CPU
9/7/2014 1:29:55 AM | | Project communication failed: attempting access to reference site
9/7/2014 1:30:13 AM | climateprediction.net | Scheduler request completed: got 1 new tasks
9/7/2014 1:30:15 AM | climateprediction.net | Started download of hadam3p_anz_rgzl_2012_1_008948596.zip
9/7/2014 1:30:15 AM | climateprediction.net | Started download of ic19611201_11_N96.gz
9/7/2014 1:30:27 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 1:30:43 AM | climateprediction.net | Finished download of hadam3p_anz_rgzl_2012_1_008948596.zip
9/7/2014 1:30:43 AM | climateprediction.net | Started download of atmos_restart_nfff.day.gz
9/7/2014 1:42:05 AM | | Project communication failed: attempting access to reference site
9/7/2014 1:42:32 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 1:42:38 AM | climateprediction.net | Finished download of ic19611201_11_N96.gz
9/7/2014 1:42:38 AM | climateprediction.net | Started download of region_restart_nfff.day.gz
9/7/2014 1:44:31 AM | | Project communication failed: attempting access to reference site
9/7/2014 1:44:49 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 1:52:47 AM | | Project communication failed: attempting access to reference site
9/7/2014 1:53:21 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 2:08:50 AM | | Project communication failed: attempting access to reference site
9/7/2014 2:09:21 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 2:26:11 AM | | Project communication failed: attempting access to reference site
9/7/2014 2:26:51 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 3:14:24 AM | | Project communication failed: attempting access to reference site
9/7/2014 3:15:07 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 3:39:14 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_jc77_2013_1_008795287_0_13.zip: No such file or directory
9/7/2014 3:39:14 AM | climateprediction.net | Temporarily failed upload of hadam3p_eu_jc77_2013_1_008795287_0_13.zip: transient upload error
9/7/2014 3:39:14 AM | climateprediction.net | Backing off 05:20:18 on upload of hadam3p_eu_jc77_2013_1_008795287_0_13.zip
9/7/2014 3:43:22 AM | climateprediction.net | Finished download of atmos_restart_nfff.day.gz
9/7/2014 3:43:22 AM | climateprediction.net | Started download of ancil_OSTIA_deltaSST_2013_mpip.gz
9/7/2014 4:02:54 AM | climateprediction.net | Finished download of ancil_OSTIA_deltaSST_2013_mpip.gz
9/7/2014 4:13:07 AM | climateprediction.net | Finished download of region_restart_nfff.day.gz
9/7/2014 7:00:57 AM | | Project communication failed: attempting access to reference site
9/7/2014 7:01:02 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 7:10:59 AM | climateprediction.net | Started upload of hadam3p_eu_jc77_2013_1_008795287_0_13.zip
9/7/2014 7:11:46 AM | | Project communication failed: attempting access to reference site
9/7/2014 7:11:58 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 7:28:16 AM | | Project communication failed: attempting access to reference site
9/7/2014 7:28:18 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 7:31:23 AM | | Project communication failed: attempting access to reference site
9/7/2014 7:32:17 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 7:33:20 AM | climateprediction.net | Temporarily failed upload of hadam3p_eu_jc77_2013_1_008795287_0_13.zip: transient HTTP error
9/7/2014 7:33:20 AM | climateprediction.net | Backing off 03:01:36 on upload of hadam3p_eu_jc77_2013_1_008795287_0_13.zip
9/7/2014 7:33:44 AM | | Project communication failed: attempting access to reference site
9/7/2014 7:33:46 AM | | Internet access OK - project servers may be temporarily down.
9/7/2014 7:35:29 AM | climateprediction.net | Started upload of hadam3p_eu_jc77_2013_1_008795287_0_13.zip
9/7/2014 7:41:43 AM | | Reading preferences override file
9/7/2014 7:41:43 AM | | Preferences:
9/7/2014 7:41:43 AM | | max memory usage when active: 920.61MB
9/7/2014 7:41:43 AM | | max memory usage when idle: 1329.77MB
9/7/2014 7:41:43 AM | | max disk usage: 5.00GB
9/7/2014 7:41:43 AM | | max download rate: 92160 bytes/sec
9/7/2014 7:41:43 AM | | (to change preferences, visit a project web site or select Preferences in the Manager)
9/7/2014 7:51:12 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_jc77_2013_1_008795287_0_13.zip: No such file or directory
9/7/2014 7:51:12 AM | climateprediction.net | Temporarily failed upload of hadam3p_eu_jc77_2013_1_008795287_0_13.zip: transient upload error
9/7/2014 7:51:12 AM | climateprediction.net | Backing off 03:46:16 on upload of hadam3p_eu_jc77_2013_1_008795287_0_13.zip

---

HI,

the issue is that the disk that takes the _13 zip files is different from the one that takes the rest of them. It may be a server not running though it isn't shown as down on the server status page. Another option is that the disk (raid array) has become unmounted giving the same result. Come Monday after 9.00am my understanding from another thread is this is being looked at - if I am not getting confused from looking at too many forums! Don't give up, the _13 zips have the information in them that in some cases enables the next task to be generated. This has happened before and I am sure will again. At least the other zips are going through now.

Edit: I have disabled network activity through BOINC manager till either I see this is fixed or I need more work. (Will try it briefly around midday tomorrow to see how things are going.

Got one eu 13.zip uploaded some hours ago and task reported :-)

My problem, which exists already a few months, is almost the same as the problems shown in this treat:

7-9-2014 20:38:07 | climateprediction.net | Started upload of hadam3p_eu_f3do_2013_1_008756176_0_2.zip
7-9-2014 20:38:09 | climateprediction.net | [error] Error reported by file upload server: can't open file
7-9-2014 20:38:09 | climateprediction.net | Temporarily failed upload of hadam3p_eu_f3do_2013_1_008756176_0_2.zip: transient upload error
7-9-2014 20:38:09 | climateprediction.net | Backing off 05:58:08 on upload of hadam3p_eu_f3do_2013_1_008756176_0_2.zip

This WU has to report before 31-05-2015 so it is not super urgent and time enough to resolve the problem. :D

This WU has to report before 31-05-2015 so it is not super urgent and time enough to resolf the problem.

In reality, it doesn't even have to be in then. CPDN only uses the deadline because BOINC server software requires it. In reality tasks are accepted after the deadline dates and credit is still awarded.