Message boards : Number crunching : Upload server sometimes awfully slow
Author | Message |
---|---|
Within the past weeks, I have made the experience that while sometimes the finished WUs are uploaded with a good speed of nearly 1000 KB/sec, sometimes the speed is awfully low, like 60 KB/sec. So it takes forever to get a 500MB file uploaded, resulting in the loss of the <24 hours / <48 hours credit bonus. | |
ID: 57626 | Rating: 0 | rate: / Reply Quote | |
No idea why the problems with the upload server obviously cannot be fixed :-( | |
ID: 57652 | Rating: 0 | rate: / Reply Quote | |
So anyone can figure out how long the upload lasts for a 499 MB size file. the latest upload took more than 2 hours. Whereas my internet connection provides 3 Mbit/sec (which works in reality, I can see it when transferring files within the LHC project). That's crazy :-( | |
ID: 57658 | Rating: 0 | rate: / Reply Quote | |
now the next tasks which uploads with ~80 kb/sec :-( | |
ID: 57662 | Rating: 0 | rate: / Reply Quote | |
Am I the only one who experiences this problem, or are there others, too? Maybe Gpugrid upload server is not the bottleneck. I can bring an example of just the opposite. I catched one of my hosts at the very end of uploading a 506,29 MB file. It took 11 minutes and 15 seconds to upload, at rates above 700 KBps. This host has a WiFi connection to an access point in my home network. Internet access is through a fiber optic router. | |
ID: 57664 | Rating: 0 | rate: / Reply Quote | |
All my uploads take 2+ hours because I have a miserable 1MBit upload pipe that only produces about 758KB in reality. | |
ID: 57673 | Rating: 0 | rate: / Reply Quote | |
Maybe Gpugrid upload server is not the bottleneck. As I wrote in my original posting, I also had cases where the upload speed for a GPUGRID task was about 1000 KB/sec. At any rate, the bottleneck definitely cannot be within my own infrastructure, since I have a fiber glass connection with 30 Mbits upload / 300 Mbits download, which are tested/confirmed values. Maybe the bottleneck lies somewhere inbetween my place and GPUGRID in Spain. Still, it is somehow frustrating to see that some of the uploads go with 1000 KB/sec, and others with 60 KB/sec. | |
ID: 57675 | Rating: 0 | rate: / Reply Quote | |
All my uploads take 2+ hours because I have a miserable 1MBit upload pipe that only produces about 758KB in reality. SpaceX Starlink? ____________ | |
ID: 57677 | Rating: 0 | rate: / Reply Quote | |
Great idea and awesome tech but comes at price. IMO it's a bit excessive even if you live in a remote area and are in dire need of a working alternative. | |
ID: 57679 | Rating: 0 | rate: / Reply Quote | |
about 2 hours ago, a finished task was uploaded with ~ 980 KB/s, right now another task is uploading with ~ 80 KB/s. | |
ID: 57681 | Rating: 0 | rate: / Reply Quote | |
I'm thinking on it. My brother has an order in for it. I think I will wait for him to test it and give me some feedback. He has an even slower connection than I do. | |
ID: 57687 | Rating: 0 | rate: / Reply Quote | |
Probably not so strange considering only one host runs ALL the processes. Imagine the I/O gets bottlenecked regularly. | |
ID: 57688 | Rating: 0 | rate: / Reply Quote | |
Probably not so strange considering only one host runs ALL the processes. Imagine the I/O gets bottlenecked regularly. well, the fact is that whenever LHC/Atlas tasks are being uploaded, or downloaded (and this happens several times every hour), no speed problem at all. Never ever! | |
ID: 57689 | Rating: 0 | rate: / Reply Quote | |
Strange indeed if the tasks go fast when another project is actively down/uploading. | |
ID: 57690 | Rating: 0 | rate: / Reply Quote | |
There is never any value inbetween - either it's very fast, or very slow. This is rather strange, isn't it ? Yes, it is... From Windows Command Prompt you can order to trace the route from your host to the Gpugrid server, take screenshots, and compare between slow and fast episodes. It might reveal some intermediate server that could be delaying communications. You can enter a Command Prompt window by pressing Windows + R keys, and running CMD From the Command Prompt window, type in tracert gpugrid.net You'll get information about how many jumps it takes to access to Gpugrid server from your location, and the delay in milliseconds between every of them. In the following example, from my location it took 14 jumps to reach the Gpugrid server (intermediate IPs have been hidden) (Most of the times this is worthless, but it's cool ;-) | |
ID: 57691 | Rating: 0 | rate: / Reply Quote | |
Message boards : Number crunching : Upload server sometimes awfully slow