Message boards : Graphics cards (GPUs) : Python apps for GPU hosts needs [a whole lot] more disk space.
| Author | Message |
|---|---|
|
Jason M Sullivan Send message Joined: 1 Dec 21 Posts: 1 Credit: 11,546,345 RAC: 0 Level  Scientific publications  | |
|
I've gotten this notice a few times over the last few months... Python apps for GPU hosts needs 27668.09MB more disk space. You currently have 5710.52 MB available and it needs 33378.60 MB. A little over 30Gig? That seems like an awful lot of disk to be using. I know "disk is cheap" and whatnot, but are the datasets truly that big? Anyone know why it needs so much space? | |
ID: 59121 | Rating: 0 | rate:
 /   Reply
Quote
| |
|
Keith Myers  Send message Joined: 13 Dec 17 Posts: 1340 Credit: 7,653,116,070 RAC: 13,421,873 Level  Scientific publications     | |
I've gotten this notice a few times over the last few months... Because it DOES need that much space. The tasks do reinforcement learning using Pytorch and that framework infrastructure needs that much disk space for the examples. | |
| ID: 59122 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Jim1348 Send message Joined: 28 Jul 12 Posts: 819 Credit: 1,591,285,971 RAC: 0 Level  Scientific publications  | |
|
On Ubuntu 20.04.4, my www.gpugrid.net project directory is 3.7GB, and the slot it is running in shows 9.1GB. So that is certainly less than 30GB. | |
| ID: 59123 | Rating: 0 | rate:
/ Reply
Quote
| |
|
[CSF] Aleksey Belkov Send message Joined: 26 Dec 13 Posts: 86 Credit: 1,271,531,270 RAC: 501,550 Level  Scientific publications  | |
and the slot it is running in shows 9.1GB. So that is certainly less than 30GB. Probably WUs may vary in their volume and/or occupied volume may grow during the execution of the task. My current WU consumes almost 16 GiB(slot). Although of course it was interesting to know exactly how the values of the required space are calculated. Based on the fact that different values appear in such messages, this is some kind of automated algorithm, and not manually set values for WUs. | |
| ID: 59134 | Rating: 0 | rate:
/ Reply
Quote
| |
|
ptgst3Kfg7MDZf8ShnWCBMMnh... Send message Joined: 7 May 20 Posts: 2 Credit: 351,659,704 RAC: 1,599,852 Level  Scientific publications | |
|
deleted my post - sorry wrong thread! :) | |
| ID: 59180 | Rating: 0 | rate:
/ Reply
Quote
| |
Message boards : Graphics cards (GPUs) : Python apps for GPU hosts needs [a whole lot] more disk space.
