Message boards : Number crunching : Anyone using Amazon to crunch?
| Author | Message |
|---|---|
 MJHProject administrator Project developer Project scientist Send message Joined: 12 Nov 07 Posts: 696 Credit: 27,266,655 RAC: 0 Level  Scientific publications   | |
|
Hi | |
ID: 37852 | Rating: 0 | rate:
 /   Reply
Quote
| |
|
biodoc Send message Joined: 26 Aug 08 Posts: 183 Credit: 10,085,929,375 RAC: 6,193,153 Level  Scientific publications   | |
|
I looked into it briefly. | |
| ID: 37856 | Rating: 0 | rate:
/ Reply
Quote
| |
|
MJH Project administrator Project developer Project scientist Send message Joined: 12 Nov 07 Posts: 696 Credit: 27,266,655 RAC: 0 Level Scientific publications | |
|
To put it into more quantitative terms, the g2.2 instance-type with a GPU about as fast as a GTX760 and an 8-core 2.6GHz E5-2670 Xeon can cost as little as $1.60/day. | |
| ID: 37865 | Rating: 0 | rate:
/ Reply
Quote
| |
|
popandbob Send message Joined: 18 Jul 07 Posts: 67 Credit: 40,277,822 RAC: 0 Level Scientific publications  | |
|
For the price of the GPU EC2 for 1 year I could build and power a new system for over a year.... Is it really worth it? | |
| ID: 37870 | Rating: 0 | rate:
/ Reply
Quote
| |
|
mikey Send message Joined: 2 Jan 09 Posts: 297 Credit: 5,825,361,115 RAC: 31,379,626 Level  Scientific publications  | |
For the price of the GPU EC2 for 1 year I could build and power a new system for over a year.... Is it really worth it? That sorta depends on your other associated costs, repairs cost time and energy, presumably Amazon would take care of those. Electricity costs different amounts in different areas of the World, again presumably Amazon would take care of this too. OS's cost money, again Amazon's costs. I am NOT saying I am going to jump on it, I won't be, but for some it could be a wash, or pretty close to it, as far as overall costs go. I know some projects use something similar so they don't have to pay for drive replacements, maintenance, electricity, cooling, OS etc. | |
| ID: 37873 | Rating: 0 | rate:
/ Reply
Quote
| |
|
captainjack Send message Joined: 9 May 13 Posts: 171 Credit: 3,332,596,788 RAC: 11,110,987 Level  Scientific publications  | |
|
Now that the summer heat is upon us here in the Northern hemisphere, I decided to give Amazon Web Services a try. My air conditioner has a hard time keeping up when running multiple GPU's at full tilt. For the next few months, I plan to rent from AWS and keep the house cool. "micro instances" don't seem suitable for Boinc A micro instance is a single core virtual server running at a modest speed. I started out with one to get some experience and it fine for CPU tasks (as long as it's free). It is still running and crunching away on some WCG tasks. It took me several days to figure out how to get the correct NVIDIA drivers installed on a virtual server instance and get them set up where BOINC would recognize them. My first GPU task just finished and validated about an hour ago. Task number 2 is underway now. If anybody wants to know what it takes, let me know and I will try to compile all my notes and post them here. The cost is a bit different now from when Matt originally asked for interest. Spot prices for a GPU instance are running about 10 cents per hour which would be about $2.40 U.S. per day. The beauty about spot instances is that you only pay the going rate and you can specify the maximum hourly rate that you are willing to pay. If the going hourly rate exceeds your maximum, your instance will be shut down until the going rate gets back below your maximum rate. Also there is a charge for file I/O and for internet I/O. I'm waiting to find out how much it cost to download GPUGRID tasks and upload the results. After a few days, I should have a better idea. Let me know if you have other questions. | |
| ID: 41371 | Rating: 0 | rate:
/ Reply
Quote
| |
|
skgiven Volunteer moderator Volunteer tester  Send message Joined: 23 Apr 09 Posts: 3968 Credit: 1,995,359,260 RAC: 0 Level  Scientific publications | |
|
Instructions to do this might be helpful to some, however the GPU being used is an NVIDIA GRID K520 (4095MB), which is a Kepler GK104. You may be hogging it but it's only bringing in 160K/day, albeit running short tasks. | |
| ID: 41388 | Rating: 0 | rate:
/ Reply
Quote
| |
|
captainjack Send message Joined: 9 May 13 Posts: 171 Credit: 3,332,596,788 RAC: 11,110,987 Level Scientific publications | |
|
skgiven said: it could keep your credit ticking over in the hot summer months (if you have those) Yes, I live in a part of the world where we absolutely have hot summer months and I am trying to find a way to keep my credit ticking over during those months. Here's some instructions on getting the GPU instance set up: you have to start with an image that uses HVM (hardware virtualization). I used Ubuntu because I am familiar with it and Linux has the cheapest rental rate. When downloading drivers to install, go to the NVIDIA download site then choose Product Type = GRID, Product Series = GRID Series, and Product = GRID K520. Then I mostly followed the instructions outlined here http://tleyden.github.io/blog/2014/10/25/cuda-6-dot-5-on-aws-gpu-instance-running-ubuntu-14-dot-04/. I installed all of his recommendations except for the CUDA installer software. To get the prices that Matt was referencing, you have to use spot instances. With spot instances, you bid a maximum price that you are willing to pay per hour and you get access to unused hardware until there is a demand for that hardware for dedicated instances. AWS then starts shutting down spot instances starting with the cheapest bids first and the spot price goes up until they can meet demand for dedicated instances. Here's the problem for volunteer computing, when a spot instance is terminated, all data that was generated during that run is erased. All tasks that are underway when the instance shuts down are then abandoned. You can set up the spot request to automatically spawn a new request when the price gets back down below your bid, but it starts over from the original image (with no data downloaded from the volunteer computing projects). Most of the recommendations that I have read for dealing with the lost data suggest to take periodic snapshots of the data volume to S3 storage on AWS approximately every hour. Then set up your image to automatically restore from the snapshot if/when the instance starts back up again. It looks to me like that could be problematic in the world of volunteer computing where tasks are downloaded, crunched and the result is uploaded then the cycle starts over again. Lets say that a task is downloaded and should run for 4.5 hours. At 4 hours a snapshot is taken. At 4.5 hours, the task ends and the result is uploaded. Then another task is downloaded and runs for 15 minutes. The spot instance is terminated by AWS then it starts back up later in the day. If the snapshot is restored, it will restore what it thinks is a partially completed task that in reality has already been completed and uploaded and it won't know about the partially completed task that the project sent to the instance. I would be afraid to guess at what happens next. Will BOINC Manager figure out the task underway has previously been completed, stop work on it and re-download the un-completed task that is now assigned to that instance? For now, I can't see abandoning 10 hours work on a 12 hour task so I have the spot instance turned off. If anyone else has any ideas on how to best work around this issue, I would be glad to hear them. | |
| ID: 41399 | Rating: 0 | rate:
/ Reply
Quote
| |
|
You can set the EBS volume to not terminate when your spot instance is terminated, so you could spin up a new spot instance, attach the old EBS volume, and continue working. | |
| ID: 41478 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Betting Slip Send message Joined: 5 Jan 09 Posts: 670 Credit: 2,498,095,550 RAC: 0 Level  Scientific publications | |
|
Could someone with a lot more experience than myself tell me which package I would need to run GPUGrid as fast as possible with a reserved instance and the cost? | |
| ID: 41484 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Acey Pilot Send message Joined: 4 Jan 14 Posts: 4 Credit: 1,901,240,470 RAC: 0 Level Scientific publications | |
Hi I'm trying now. Got NVIDIA GRID K520 GPU installed, but GPU Grid will not recognize the card. Boinc itself installs and runs great cpu projects. | |
| ID: 42133 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Acey Pilot Send message Joined: 4 Jan 14 Posts: 4 Credit: 1,901,240,470 RAC: 0 Level Scientific publications | |
Now that the summer heat is upon us here in the Northern hemisphere, I decided to give Amazon Web Services a try. My air conditioner has a hard time keeping up when running multiple GPU's at full tilt. For the next few months, I plan to rent from AWS and keep the house cool. Hi I'm set up on Amazon, but this project will not recognize Grid 520 GPU there. How did you get it working? | |
| ID: 42134 | Rating: 0 | rate:
/ Reply
Quote
| |
|
captainjack Send message Joined: 9 May 13 Posts: 171 Credit: 3,332,596,788 RAC: 11,110,987 Level Scientific publications | |
|
Hi Acey Pilot, | |
| ID: 42140 | Rating: 0 | rate:
/ Reply
Quote
| |
|
MJH Project administrator Project developer Project scientist Send message Joined: 12 Nov 07 Posts: 696 Credit: 27,266,655 RAC: 0 Level Scientific publications | |
|
Hi, | |
| ID: 42315 | Rating: 0 | rate:
/ Reply
Quote
| |
|
I'd be willing to help test this if you decied to try it. | |
| ID: 42754 | Rating: 0 | rate:
/ Reply
Quote
| |
Message boards : Number crunching : Anyone using Amazon to crunch?
