Message boards : Graphics cards (GPUs) : Nvidia and liquid submersion cooling
Author | Message |
---|---|
So I'm goofing off in my man cave playing with creating a submersion computer like the puget systems aquarium computer ( http://www.pugetsystems.com/mineral-oil-pc.php ) using my own parts that are lying around..etc. | |
ID: 34017 | Rating: 0 | rate: / Reply Quote | |
In their description of their V2 system, they (Puget Systems) say they had a GTX 285 working fine in oil. Of course you may have a different brand. | |
ID: 34019 | Rating: 0 | rate: / Reply Quote | |
So I'm goofing off in my man cave playing with creating a submersion computer like the puget systems aquarium computer ( http://www.pugetsystems.com/mineral-oil-pc.php ) using my own parts that are lying around..etc. Can't help with the problem but just wanted to say it looks "cool". They could add a bigger tank with a partition which would contain water and have a couple of warm water fish in as well. | |
ID: 34020 | Rating: 0 | rate: / Reply Quote | |
Thoughts? Here are some (just thoughts): - Mineral oil is very good heat tramsmissor. It's used in most of Power Transformers, so this part ok. - One problem I see is that you need a spetial pump becouse oil density is hight. And you should move the oil. It you put a radiator behind with fans no real big gain?? - If you put GPUs you have to consider a lot of heat I am not sure who well heat will be dissipated throught the glass area, probably you wont know until you test it. - Another problem I see too is that the heatsinks are not designed to work this way. I would suggest to put passive heatsinks as big as you can. Even in the GPU. - Consider that it's going to be very heavy. That shouldn't be a problem, I had seen 1.000 l (kg) aquarium, but watch out if you have a leak... - It might smell a bit as fried oil. As I said just some thought I saw your link but didn't read carefully all. Good luck. | |
ID: 34025 | Rating: 0 | rate: / Reply Quote | |
Fans move air. To move liquid what's needed is a propeller or a peristaltic pump. Unfortunately such pumps require a bit of power (maybe 50W). Better heatsinks would be useful, as said. I think the design of the tank and positioning of the GPU's would be key. Lets just say the deep fat fryer design is thermodynamically challenged! Something more like a pluming system, where heat is piped around and cooled/warmed. | |
ID: 34030 | Rating: 0 | rate: / Reply Quote | |
It seems some companies are working on this to cool servers. I think this articles are interesting: | |
ID: 34092 | Rating: 0 | rate: / Reply Quote | |
I found this too. It's a liquid called Novec. You don't need heatsinks. | |
ID: 34093 | Rating: 0 | rate: / Reply Quote | |
If you're boiling the liquid you'll need a sealed system to recover the vapour. Otherwise it will be a short run. And I'd be at concerned about a high concentration of this stuff in the air I'm breathing. I don't know anything specific about this Novec, though. | |
ID: 34125 | Rating: 0 | rate: / Reply Quote | |
@Palamedes. I missunderstood your question (matter of my "perfect" english). I've been reading about this stuff. If you're boiling the liquid you'll need a sealed system to recover the vapour. Otherwise it will be a short run. And I'd be at concerned about a high concentration of this stuff in the air I'm breathing. I don't know anything specific about this Novec, though. Yes you need to have a sealed system. The evaporating loss is very low. The liquid is very expensive. | |
ID: 34136 | Rating: 0 | rate: / Reply Quote | |
In a different thread Damaraland wrote:
Arduino is very cool but you could do what you want at far lower cost with an 8051 or 6809 microprocessor. You could even use your PC to control all that. It's easy if it has a parallel port. Even if you don't see a parallel port on the back of the case the mobo might have header pins for a parallel port, even newer mobos often have them. RS-232 serial ports haven't totally disappeared either. They're not as easy to use as a parallel port but they're easy enough. USB ports are not that difficult to use either and the connectors are cheaper, smaller and less prone to damage than parallel or serial connectors. And USB is ubiquitous. Cooling is one of my favorite topics :) I was thinking that it might be possible to create an almost totally silent very efficient cooling system with just 3 components:
| |
ID: 34274 | Rating: 0 | rate: / Reply Quote | |
Regarding your 1st idea: relying on u-shaped metal won't be very effective in transferring the heat. A heat pipe should fare much better. I'm assuming your reservoir contains water? If your oil immersion tank was made from metal, you could contact this directly with the water and have a massive surface for much better contact than trying to build a "heat bridge" between the two containers. | |
ID: 34300 | Rating: 0 | rate: / Reply Quote | |
More I think, more I see this challenguing... | |
ID: 34307 | Rating: 0 | rate: / Reply Quote | |
If copper (Cu) reacts with the mineral oil over time, then aluminum (Al) will do more easily as copper is a more noble metal then aluminum. The less noble a metal the more easily it will react. However there are additives for the oil to prevent this, but the oil need to be refreshed every certain period, depending on the grade of the oil. | |
ID: 34316 | Rating: 0 | rate: / Reply Quote | |
Regarding your 1st idea: relying on u-shaped metal won't be very effective in transferring the heat. A heat pipe should fare much better. I'm assuming your reservoir contains water? If your oil immersion tank was made from metal, you could contact this directly with the water and have a massive surface for much better contact than trying to build a "heat bridge" between the two containers. The first idea uses only 1 container filled with mineral oil and the mobo would be immersed in that oil. One leg of the U would be in the oil, the other in air. Obviously one would need to support the cold side (air side if you prefer) of the inverted U with brackets or whatever but that's small details. If the tank were on a table one could make the cold side long enough to extent down to the floor. It would be more like an inverted letter J than an inverted U. An average work table is roughly 750 mm tall. Add 400 mm for the height of the tank and you have about 1300 mm length on the cold side if it sits on the floor. That arrangement would be very stable but a pair of brackets to brace the cold side to the table would make it even better. The question is... how much plate does one need on the cold side to suck the heat out of the oil fast enough? Assume 850 watts at the source (ie. in the oil), how much plate, at what dimensions (l X w X thickness) would be required in ambient 25C air? And how much additional capacity would be gained with a fan blowing 25C air over the cold side? There's gotta be formulae to give a pretty close estimate. The same idea would be even easier and cheaper to implement with just a flat plate. Put the table the tank sits on beside a wall and allow the cold side to stick up above the tank. Brace it to the wall or ceiling for stability. The 2nd idea: I don't think it's a good idea to break the systems sealing. And it wouldn't be all that necessary, I think. Exchange the top plate on the oil for a metal plate and it will already pick up quite some heat. Put fins on top and you've got enough surface area for that ceiling fan (or slow spinning, big PC fans - probably more expensive but higher quality and may consume less power). Also add some bottom fins to the metal plate and you've already got some powerful cooler. I think you misunderstood this one. The rotating wheel is oriented vertical with the shaft it rotates on horizontal. Any point A on the circumference enters the oil on the left, rotates through the oil where it picks up heat then emerges from the oil on the right where it begins to shed heat to the air. Point A rotates up to the top then back down into the oil on the left side tom pick up another "scoopful of calories". I think it could be very effective since a calorie (if you think of it as a particle rather than energy) doesn't have to travel through the height of the hot side of the heatsink to get to the the cold side. A calorie has to travel only half the thickness of the plate at most where it meets a calorie moving in from the other side of the plate. As you see from these comments I'm all for that metal case. You can extend this concept of "fins in, fins out" to all sides. And you wouldn't need some water reservoir nearby, the oil itself is probably already enough (compare that volume to how little is inside water cooling loops). Neither of the 2 previous concepts include a water reservoir. I like this 3rd idea too unfortunately it's probably the most expensive one to build if you build out of flat plate then attach fins later. However, it could be built out of corrugated plate which has far more surface area per linear unit of measure than flat plate. The 4 sides would be of corrugated with corrugations running vertically. The easiest way to make the bottom would be with flat plate but if one were willing to do some difficult cutting the bottom could be corrugated too. Any way you build it this concept it requires welding. It's easy to weld with the proper equipment and technique but the equipment is not common. To judge overall cooling capability one can approximate that the heat generated from the PC components is distributed evenly inside the oil. In steady state the cooling system has to dissipate just as much heat as is being produced. So one would have to consider the air cooling as the limiting heat exchange. Given some geometry and air flow there will be a oil temperature at which the two powers are equal. Exactly. It follows from the Law of Conservation of Energy so we can use simple energy methods. Then the equation begins as: power generated by computer = power shed by heatsink The left side is approximately the sum of the TPDs of the major heat producing components plus 10% to cover the others. Right side is some function of heatsink material thermal conductivity and dimensions expressed in terms of T (temperature), solve for T to get the equilibrium temperature for input dimensions, or, pick the target operating T, sub it into the equation and solve for dimensions. Rig a test and see how close the real numbers compare with the theoretical. I wonder if someone's already whipped up a heatsink configurator-calculator wizard? Real chip temperatures will be somewhat higher, due to temperature gradients being present (the heat is not evenly distributed instantaneously), but I think this would be a sound first approximation. Some data and material properties would be needed, though. Very sound. OK, off to find data and material properties or a wizard. ____________ BOINC <<--- credit whores, pedants, alien hunters | |
ID: 34319 | Rating: 0 | rate: / Reply Quote | |
More I think, more I see this challenguing... Puget systems mentioned by Palamedes in the OP seems to have had great success over several years. I find it odd that his GPU quit immediately after submerging it in oil but since he hasn't answered any questions to help clarify the situation (we can't read his mind and his explanation is ambiguous) there isn't much one can conclude. Who else has tried oil immersion and failed? Every attempt I've ever read about aside from Palamede's attempt has been successful. My posts are simply attempts to explore ways to make it cheaper as the one thing I've noticed is that people who are successful are using some very expensive components. Anyway, I think copper is not a good option because of corrosion with mineral oil. That could make the mineral conductive with time. Agreed. Building a box with all aluminium but the front with cristal won't be difficult. The silicon used to build aquarium is very strong and heat effective. Build whatever you wish but I would not assume a simple aluminum box will dissipate enough heat. That's what ETA and I are discussing... a way to approximate what temperature a system will run at before spending the time and money to build it. I think any system like this should have a filter. An aquarium filter should do to clean big particules from dust. I agree but that's a minor detail that can be added on after one has proven the thermodynamics of the system works. I saw this interesting idea too, it's from a aluminium radiator. There you can see the size needed depending on water temperature and size: Radiators are abundant. I can go to the local hardware store and buy enough radiator to cool 30 computers or just 1 computer. I can go to my friend's shop and get all the free tube and fin radiator I want. Automotive parts stores carry probably 100 different radiator sizes or more. Tell them what size you want and they'll sell one to you. The thing is... how much radiator do you need to do the job you want to do? How big of a pump do you need? Are you going to slap a bunch of parts together and find it doesn't provide enough cooling? What will you do then? Or will your creation give you twice as much cooling as you need? If it does then perhaps you could have spent half as much money. It's called engineering. Engineer first, acquire parts later for the greatest chance of a successful outcome on the first attempt without spending too much money. I will have a look a RS232 temperature sensor to control the fans. That might be good idea too to fan control. Have a look at this PWM controller . It uses a PIC mcu (microcontroller) and external ADC. Probably costs about $8 for parts. It's very simple and easy to build and should do what it's designed to do reliably for many years. He's using it to cool a disk but it would work on just about any device including a GPU. It doesn't interface to a PC but that makes it easier to build and program. ____________ BOINC <<--- credit whores, pedants, alien hunters | |
ID: 34321 | Rating: 0 | rate: / Reply Quote | |
If copper (Cu) reacts with the mineral oil over time, then aluminum (Al) will do more easily as copper is a more noble metal then aluminum. The less noble a metal the more easily it will react. However there are additives for the oil to prevent this, but the oil need to be refreshed every certain period, depending on the grade of the oil. Yes, I thought I heard there are additives to prevent corrosion, thanks for confirming that. So what do you need to do to refresh the oil? Do you have to replace it or just dump in more additive? I read mineral oil is very expensive so I would not want to replace it very often. There must be other types of oil that are non-conductive. Motor oil is just long non-polar hydrocarbon chains so I can't see it being very conductive. Ethylene glycol should not be conductive either, I would think. Does one really need clear fluid? Why? As long as it works I don't need to see my PC. It can be submerged in motor oil as long as it works and it's cheap. How about hydraulic oil? ____________ BOINC <<--- credit whores, pedants, alien hunters | |
ID: 34322 | Rating: 0 | rate: / Reply Quote | |
If copper (Cu) reacts with the mineral oil over time, then aluminum (Al) will do more easily as copper is a more noble metal then aluminum. The less noble a metal the more easily it will react. However there are additives for the oil to prevent this, but the oil need to be refreshed every certain period, depending on the grade of the oil. This is wrong. Aluminium has very, very little corrosion. From Wikipedia: "Aluminium is remarkable for the metal's low density and for its ability to resist corrosion due to the phenomenon of passivation." I find it hard to explain. I studied this a long time ago, but you don't have corrotion unless there's "Metal dusting" or "Galvanic corrosion" occurs when two different metals have physical or electrical contact with each other and are immersed in a common electrolyte. | |
ID: 34326 | Rating: 0 | rate: / Reply Quote | |
Aluminum is very reactive. If exposed to air it very quickly oxidizes but the oxide forms a hard layer on the surface that oxygen cannot penetrate. Formation of that layer is an example of passivation. The layer of oxide is usually just a few nanometers thick but it prevents further oxidation. If the oxide is removed then oxidation begins again and continues until a new layer of oxide forms. | |
ID: 34327 | Rating: 0 | rate: / Reply Quote | |
There is a lot of information in Wikipedia but not all is true or the only truth. | |
ID: 34337 | Rating: 0 | rate: / Reply Quote | |
There is a lot of information in Wikipedia but not all is true or the only truth. You know what you know. The conditions you are talking about is without passivation efect. That's all explained in the wikipedia and in many chemistry books too. But this is not taking the aluminium to the sun, to the moon, puting it to 400° C, or puting it in sea water. In normal conditions aluminum don't oxidate. But is true as said before that needs oxigen to pasivate and maybe in an oil container there's no much oxigen. I'm not sure for that. You are not the only one that went to university and studied chemistry. | |
ID: 34339 | Rating: 0 | rate: / Reply Quote | |
Sorry for not responding for a long time. In the mean time I have done no further work / thinking regarding this topic.. but today stumbled upon this Matlab toolbox for thermal simulations. At first glance it seems capable of simulating the designs discussed here. | |
ID: 36281 | Rating: 0 | rate: / Reply Quote | |
Message boards : Graphics cards (GPUs) : Nvidia and liquid submersion cooling