Message boards : Graphics cards (GPUs) : GPU monitoring
Author | Message |
---|---|
Does anyone know of a GPU monitoring tool? I am trying to find one that tells you if the GPU is actually doing something. Right now the only way that I know we can sniff this out is to look at the temperatures of the cores to see if they are running "hot"... | |
ID: 8327 | Rating: 0 | rate: / Reply Quote | |
There's no direct way that I know of, only incidentals. Clock speed and GPU temp are usually a pretty good indicator of the current load on the GPU. GPU-Z is a nice lightweight program to see all that. | |
ID: 8332 | Rating: 0 | rate: / Reply Quote | |
actually there is a Cuda-Z app available for download from sourceforge, just google search cuda-z which gives info about the gpu core performance | |
ID: 8333 | Rating: 0 | rate: / Reply Quote | |
actually there is a Cuda-Z app available for download from sourceforge, just google search cuda-z which gives info about the gpu core performance Thanks for the hint, but, it registers operational numbers regardless if anything is running. So, it is logging the effective speed and not the operational state a-la Task Manager for the CPUs in the system. | |
ID: 8335 | Rating: 0 | rate: / Reply Quote | |
GPU-Z. | |
ID: 8337 | Rating: 0 | rate: / Reply Quote | |
GPU-Z. well, I just installed RivaTuner 2.24 and I sure don't see a usage meter, only the ability to configure registry entries. I guess I don't get it ... and the documentation so far has not been much help to me ... sigh ... | |
ID: 8352 | Rating: 0 | rate: / Reply Quote | |
Would this do any good?: | |
ID: 8382 | Rating: 0 | rate: / Reply Quote | |
Paul on the Riva Tuner Main Tab look just under where you select the GPU and it will say something like (off my ATI machine but heh) 256-bit RV770. At the end of this field is a small button looking like a 3,4,5 triangle. Select that and a mini popup bar opens. On the end is Hardware Monitoring. This will open graphs for each present GPU and you will see GPU Usage is one of them. | |
ID: 8383 | Rating: 0 | rate: / Reply Quote | |
Paul on the Riva Tuner Main Tab look just under where you select the GPU and it will say something like (off my ATI machine but heh) 256-bit RV770. At the end of this field is a small button looking like a 3,4,5 triangle. Select that and a mini popup bar opens. On the end is Hardware Monitoring. This will open graphs for each present GPU and you will see GPU Usage is one of them. Hmm, I had not tried that button because I did not want to make changes ... :) NOw that I found it I just tried it and So far the closest I can find is the graph for the CPU, but it is the main CPUs and not the CPUs on the GPU Cards. THe rest are the same of temperature sensors and clocks. | |
ID: 8409 | Rating: 0 | rate: / Reply Quote | |
Would this do any good?: Rob, Yeah this was the other tool I have tried that seems to only be able to relate and graph WITHIN a graphics application. Again, I may be missing something and not using it right. I am also asking Rom to make a change to the system that will change the output message so we can see which GPU is being scheduled by BOINC to be used on a task. BUt, the question is still out there if BOINC is properly scheduling tasks on the available GPUs. It is hard to tell what is going on and the symptom is that tasks that should run in 6 hours are taking as long as 24 hours to run. The first question is if this bug is in 6.6.20, our imagination, or something else, like bad tasks from GPGU Grid. | |
ID: 8410 | Rating: 0 | rate: / Reply Quote | |
Well, I don't think the problem is only in our imagination Paul... | |
ID: 8415 | Rating: 0 | rate: / Reply Quote | |
Well, I don't think the problem is only in our imagination Paul... Not at all off topic ... why do you think I am searching for tools? :) I also asked Rom to change the output message listing the task vs. GPU to indicate the actual GPU vice "(0.18 CPUs, 1 CUDA)" to be "(0.18 CPUs, CUDA x)" so we can track this ... and the tools to see what is actually being used ... I know that I am one of the very few that has multiple GPUs in a single system and as usual on the cutting edge ... I have been concerned about the resource scheduler (formerly CPU Scheduler) for a long time and your intuition may be correct. The problem is that it seems to be a little intermittent so it is not clear why it is happening. One of the questions I have is if the tasks are being run on one of n GPUs leaving one GPU idle ... in my case it would be running one two of four or three of four while still attempting to run 4 total tasks ... You are very correct that BOINC does not respect the TSI as a lower limit, it is actually treated as an upper limit in the sense that rescheduling tasks can occur as often as 5-6 times per minute (on my systems) with every upload, scheduler request, timer expire, bird transit, and dog bark triggering an examination of the scheduling with rr_sim being run and new decisions being made. John defends this status quo though I have not seen where he puts up a "real" defense that holds water in the face of the countervailing arguments, like my experience with a "fast" and "wide" system that regularly produces 300 to 500 completed tasks each day ... and the fact that I don't have a long queue and have only rarely had tasks that are really in deadline trouble. In summary I have been jawboning on the mailing lists about these issues and mostly have been the recipient of the slings and arrows of those that would rather that we ignore issues rather than to recognize them so that they can be corrected... ah well ... | |
ID: 8434 | Rating: 0 | rate: / Reply Quote | |
Try EVGA Precision on EVGA.com, not availaible for monitoring exact ressources GPUs are given, but a really interesting tool to monitor Temps and OC. | |
ID: 8437 | Rating: 0 | rate: / Reply Quote | |
GPU-Z and RivaTuner can monitor GPU activity on ATI cards. I recently swapped my NV for an ATI and the "monitors" appeared, no software upgrades required. | |
ID: 8470 | Rating: 0 | rate: / Reply Quote | |
Good point MrS I looked on my ATI machine. When I switched backt to the nVidia machine I lost the GPU Utilization monitors :( | |
ID: 8482 | Rating: 0 | rate: / Reply Quote | |
Good point MrS I looked on my ATI machine. When I switched backt to the nVidia machine I lost the GPU Utilization monitors :( Well, at the moment, and for what it is worth, 6.6.23 SEEMS to be behaving. Tasks are racking up about 5 to 6:30 in run time which is about what I would expect. Not sure if my suggestion will take root, probably not ... but only time will tell ... | |
ID: 8485 | Rating: 0 | rate: / Reply Quote | |
Good point MrS I looked on my ATI machine. When I switched backt to the nVidia machine I lost the GPU Utilization monitors :( It looks like Everest has some form of GPU monitoring that Nvidia cards can provide. Check out Kazgirls post on this thread I haven't tested it yet. Rob | |
ID: 8491 | Rating: 0 | rate: / Reply Quote | |
I just found this very good article on how to use Performance Monitor (and various other tools) to view the Nvidia cards various performance indicators. | |
ID: 8492 | Rating: 0 | rate: / Reply Quote | |
I just found this very good article on how to use Performance Monitor (and various other tools) to view the Nvidia cards various performance indicators. I downloaded that toolkit but could not make sense out of it ... but, that article may have some clues on what I might try next time. For the moment, the problem that I was looking to diagnose is not showing up on 6.6.23 so, the need may be moot... Hmmm, here is a task that looks to be like it is going to take 7 hours to run ... Anyway, thanks for the tips ... | |
ID: 8498 | Rating: 0 | rate: / Reply Quote | |
@ETA, with RivaTuner you can create an underclocked profile, and your normal profile, plus any extras you might want. Then in the scheduler you can set a trigger for the underclocked profile if the hardware acceleration monitor is 0, or your normal profile if the hardware accel monitor is 1. | |
ID: 8966 | Rating: 0 | rate: / Reply Quote | |
Thanks for the information. Triggering on the hardware acceleration monitor is indeed what they suggested.. upon reading I remembered :) | |
ID: 9022 | Rating: 0 | rate: / Reply Quote | |
I know this a late reply. I am posting this just for the sake of completing the thread. I think the nvidia-smi is an answer to your problem. | |
ID: 21865 | Rating: 0 | rate: / Reply Quote | |
Message boards : Graphics cards (GPUs) : GPU monitoring