Message boards : Number crunching : Need more space. Again
| Author | Message |
|---|---|
|
[VENETO] boboviz Send message Joined: 10 Sep 10 Posts: 158 Credit: 388,132 RAC: 0 Level  Scientific publications  | |
|
I've crunched quietly on my Linux Vm until today. Quantum Chemistry needs 13195.37MB more disk space. You currently have 15414.86 MB available and it needs 28610.23 MB. 30 gb for a wu?? Are you kidding? | |
ID: 50332 | Rating: 0 | rate:
 /   Reply
Quote
| |
|
PappaLitto  Send message Joined: 21 Mar 16 Posts: 511 Credit: 4,672,242,755 RAC: 0 Level  Scientific publications     | |
|
In a previous message from Stefan he mentions these new WUs are much larger simulations that require much larger data-sets. It's just the nature of the beast. | |
| ID: 50333 | Rating: 0 | rate:
/ Reply
Quote
| |
|
[VENETO] boboviz Send message Joined: 10 Sep 10 Posts: 158 Credit: 388,132 RAC: 0 Level Scientific publications | |
|
Ok, i changed the vm disk, now i have 40gb free. | |
| ID: 50334 | Rating: 0 | rate:
/ Reply
Quote
| |
|
PappaLitto Send message Joined: 21 Mar 16 Posts: 511 Credit: 4,672,242,755 RAC: 0 Level Scientific publications | |
Ok, i changed the vm disk, now i have 40gb free. These WUs use an extremely large amount of memory, most likely it has completely filled your ram and is taking from swap (hard drive) so it cannot run at full speed. I suggest everyone simply wait as unless you have more ram, there is no way to speed this up. | |
| ID: 50339 | Rating: 0 | rate:
/ Reply
Quote
| |
|
I have aborted one which seemed to go on forever. Now I have another running and one waiting to run. Let's hope they complete. | |
| ID: 50340 | Rating: 0 | rate:
/ Reply
Quote
| |
|
[VENETO] boboviz Send message Joined: 10 Sep 10 Posts: 158 Credit: 388,132 RAC: 0 Level Scientific publications | |
These WUs use an extremely large amount of memory, most likely it has completely filled your ram and is taking from swap (hard drive) so it cannot run at full speed. 6gb of ram is not enough for a single wu? I think they have to work on the app code... | |
| ID: 50341 | Rating: 0 | rate:
/ Reply
Quote
| |
|
I have 8 GB RAM also on the laptop. Two tasks have completed so far, another is running. I have aborted one which was going on endlessly. | |
| ID: 50344 | Rating: 0 | rate:
/ Reply
Quote
| |
|
mmonnin Send message Joined: 2 Jul 16 Posts: 337 Credit: 7,617,757,013 RAC: 10,860,147 Level  Scientific publications  | |
|
These are needing 30gb of disk space and 6gb of memory? Wow. | |
| ID: 50351 | Rating: 0 | rate:
/ Reply
Quote
| |
|
PappaLitto Send message Joined: 21 Mar 16 Posts: 511 Credit: 4,672,242,755 RAC: 0 Level Scientific publications | |
|
So my Ryzen r7 1700 system runs 4 of these WUs at once. I had 8gb of RAM and ran the old WUs no problem, 100% CPU usage and ~6GB of RAM usage. | |
| ID: 50352 | Rating: 0 | rate:
/ Reply
Quote
| |
|
I get 197% CPU usage if no other task is running,173% if a GPU task is running alongside. I have only two cores CPU,both on the Linux laptop and the Linux SUN workstation. The Windows 10 PC has 4 cores but all GPU tasks overheat its GTX 1050 Ti, not overclocked. Einstein@home GPU tasks run fine on it. | |
| ID: 50357 | Rating: 0 | rate:
/ Reply
Quote
| |
|
[VENETO] boboviz Send message Joined: 10 Sep 10 Posts: 158 Credit: 388,132 RAC: 0 Level Scientific publications | |
|
Ok. I passed from 6 to 8 gb on Vm. | |
| ID: 50358 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Toni in a News post has explained why the task progress remains at 10%. But my tasks end and report when they finish. | |
| ID: 50359 | Rating: 0 | rate:
/ Reply
Quote
| |
|
[VENETO] boboviz Send message Joined: 10 Sep 10 Posts: 158 Credit: 388,132 RAC: 0 Level Scientific publications | |
Toni in a News post has explained why the task progress remains at 10%. But my tasks end and report when they finish. Ok, i've read the post. And i leave the wu crunching But i have this error: 09:28:46 (2923): wrapper (7.7.26016): starting | |
| ID: 50379 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Jim1348 Send message Joined: 28 Jul 12 Posts: 819 Credit: 1,591,285,971 RAC: 0 Level  Scientific publications | |
</stderr_txt> They have already been notified. http://www.gpugrid.net/forum_thread.php?id=4785&nowrap=true#50349 | |
| ID: 50380 | Rating: 0 | rate:
/ Reply
Quote
| |
|
[VENETO] boboviz Send message Joined: 10 Sep 10 Posts: 158 Credit: 388,132 RAC: 0 Level Scientific publications | |
They have already been notified. And no answer.... | |
| ID: 50388 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Zalster  Send message Joined: 26 Feb 14 Posts: 211 Credit: 4,496,324,562 RAC: 0 Level Scientific publications | |
|
So I just discovered something interesting. | |
| ID: 50550 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Virtual memory size is 4.15 GB on my 8 GB RAM on a Linux box. But more than 700 GB are available to BOINC of a 1 TB disk. I had SSDs on my HP laptop and they all failed. I installed a hybrid disk on it with 8 MB SSD out of 1 TB and it works. | |
| ID: 50551 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Zalster Send message Joined: 26 Feb 14 Posts: 211 Credit: 4,496,324,562 RAC: 0 Level Scientific publications | |
Virtual memory size is 4.15 GB on my 8 GB RAM on a Linux box. But more than 700 GB are available to BOINC of a 1 TB disk. I had SSDs on my HP laptop and they all failed. I installed a hybrid disk on it with 8 MB SSD out of 1 TB and it works. I'm getting old..haha... My memory is faulty. Turns out that I had already upgraded that SSD to a 500GB. So that leaves the question of why it's running out of space. I turned off 1 QC work unit, leaving only 1 running along with the 4 GPUs. Better for the temps on the CPU, they were spiking to 100C, now they are back down to 60C-70C ____________   | |
| ID: 50552 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Stefan Project administrator Project developer Project tester Project scientist Send message Joined: 5 Mar 13 Posts: 348 Credit: 0 RAC: 0 Level Scientific publications | |
|
A single WU will only use 4GB RAM. If it uses significantly more than that (i.e. 6GB) report to me because it might be a bug in the software. | |
| ID: 50554 | Rating: 0 | rate:
/ Reply
Quote
| |
|
[VENETO] boboviz Send message Joined: 10 Sep 10 Posts: 158 Credit: 388,132 RAC: 0 Level Scientific publications | |
Turns out that I had already upgraded that SSD to a 500GB. So that leaves the question of why it's running out of space. New beta wus on my linux VM <![CDATA[ | |
| ID: 50557 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Stefan Project administrator Project developer Project tester Project scientist Send message Joined: 5 Mar 13 Posts: 348 Credit: 0 RAC: 0 Level Scientific publications | |
|
Right, we increased now the limit. Should not happen much anymore | |
| ID: 50558 | Rating: 0 | rate:
/ Reply
Quote
| |
|
First error | |
| ID: 50560 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Zalster Send message Joined: 26 Feb 14 Posts: 211 Credit: 4,496,324,562 RAC: 0 Level Scientific publications | |
|
Yes I just checked my error numbers, 120 total, up from 55 before. So a lot of work units errored out before I started to ones that complete. I'm guessing they erred before he made the change. Will keep an eye on results to see if the new parameters make a difference on the completion and validations. | |
| ID: 50561 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Stefan Project administrator Project developer Project tester Project scientist Send message Joined: 5 Mar 13 Posts: 348 Credit: 0 RAC: 0 Level Scientific publications | |
|
Yes, please inform me if they still crash due to disk space limitations (not due to upload file size limit, that's a different issue). | |
| ID: 50568 | Rating: 0 | rate:
/ Reply
Quote
| |
|
[VENETO] boboviz Send message Joined: 10 Sep 10 Posts: 158 Credit: 388,132 RAC: 0 Level Scientific publications | |
Yes, please inform me if they still crash due to disk space limitations (not due to upload file size limit, that's a different issue). I have 45gb free space on my VM for boinc, but this message: Quantum chemistry needs 11087.61Mb more disk space | |
| ID: 50581 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Stefan Project administrator Project developer Project tester Project scientist Send message Joined: 5 Mar 13 Posts: 348 Credit: 0 RAC: 0 Level Scientific publications | |
|
Yes, we require now 60GB of disk space for one WU | |
| ID: 50585 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Toni Volunteer moderator Project administrator Project developer Project tester Project scientist Send message Joined: 9 Dec 08 Posts: 1006 Credit: 5,068,599 RAC: 0 Level  Scientific publications  | |
|
To clarify: only a few WUs will actually use that disk space. But we need to set a maximum. | |
| ID: 50586 | Rating: 0 | rate:
/ Reply
Quote
| |
|
[VENETO] boboviz Send message Joined: 10 Sep 10 Posts: 158 Credit: 388,132 RAC: 0 Level Scientific publications | |
|
Ok, i'll wait for a windows version, hoping in a less space request.. | |
| ID: 50622 | Rating: 0 | rate:
/ Reply
Quote
| |
Message boards : Number crunching : Need more space. Again
