Message boards : Number crunching : Nvidia OpenCL problem for 364.* drivers
Author | Message |
---|---|
The OpenCL section of the Nvidia 364.72 driver, and earlier 364.* drivers, has a problem which can cause an entire computer to lock up, or cause a few dozen OpenCL tasks (often not all from the same BOINC project) to give a quick Compute Error. Problem not seen in the 362.00 driver. | |
ID: 43215 | Rating: 0 | rate: / Reply Quote | |
Great. I just applied the 364.72 Nvidia update yesterday and now all of my GPUGrid tasks are crashing. One failed after considerable time had elapsed and the last two crashed just after starting. | |
ID: 43219 | Rating: 0 | rate: / Reply Quote | |
Could be something else entirely because this board is not full of WU failures due to these drivers and I've run them myself since they came out. | |
ID: 43220 | Rating: 0 | rate: / Reply Quote | |
I'll try a clean install of the drivers and see if that fixes the issue. | |
ID: 43221 | Rating: 0 | rate: / Reply Quote | |
I have no information on whether this problem also affects CUDA tasks, but for OpenCL tasks, one task crashes after a few hours, then perhaps two dozen more (not necessarily from the same BOINC project) crash quickly. Restarting Windows appears to be required to make any more OpenCL tasks complete properly. | |
ID: 43222 | Rating: 0 | rate: / Reply Quote | |
I've reverted back to ver. 362.00 to see if this fixes my GPUGrid WU problems - when there's more WUs available I'll be able to tell. | |
ID: 43226 | Rating: 0 | rate: / Reply Quote | |
Yeah, that fixed it. My WUs are completing normally now. | |
ID: 43233 | Rating: 0 | rate: / Reply Quote | |
'Upgraded' to 364.72 WHQL (Clean install wouldn't work on W10x64) and found that it crashed all POEM tasks (OpenCL) [driver restarts]. | |
ID: 43254 | Rating: 0 | rate: / Reply Quote | |
'Upgraded' to 364.72 WHQL (Clean install wouldn't work on W10x64) and found that it crashed all POEM tasks (OpenCL) [driver restarts]. Jacob Klein has already reported that one to NVidia, and got David Anderson to add an option to disallow OpenCL tasks, wherever they might pop up from. I think that's a sledgehammer to crack a very small nut, and I've told him so, but you might like to test the new v7.6.32 (you'll have to find the download yourself - it hasn't even gone into alpha testing yet). | |
ID: 43255 | Rating: 0 | rate: / Reply Quote | |
:) I see my name got mentioned. Yeah, it's nice to have an option to disable OpenCL at the client, in my opinion, for cases like this where you may want the latest drivers for gaming, but can't support running OpenCL tasks due to NVIDIA. | |
ID: 43261 | Rating: 0 | rate: / Reply Quote | |
Thanks for posting the information about this problem and also for the recommendation concerning the latest relatively bug free drivers (362.00). | |
ID: 43262 | Rating: 0 | rate: / Reply Quote | |
I read somewhere that Primegrid will no longer send tasks to any computer that has these problematic drivers installed. | |
ID: 43271 | Rating: 0 | rate: / Reply Quote | |
I read somewhere that Primegrid will no longer send tasks to any computer that has these problematic drivers installed. That would be wise, as the tasks supposedly gracefully complete with miscalculated results! :) We're tracking the problem/solution here: http://www.primegrid.com/forum_thread.php?id=6775 ... where I have an NVIDIA dev looking into it. So, look there for updates. Edit: Made hyperlink clickable, sorry about that. | |
ID: 43272 | Rating: 0 | rate: / Reply Quote | |
http://www.primegrid.com/forum_thread.php?id=6775 | |
ID: 43273 | Rating: 0 | rate: / Reply Quote | |
I have confirmed that today's 365.10 drivers do NOT fix the OpenCL problems -- PrimeGrid miscalculation and Poem@Home TDRs. | |
ID: 43297 | Rating: 0 | rate: / Reply Quote | |
I have a small status update, regarding my NVIDIA bug (Bug ID 1754468) for these OpenCL issues: - Status changed from "Open - pending review" to "Open - in progress" | |
ID: 43312 | Rating: 0 | rate: / Reply Quote | |
Another small update -- basically, while NVIDIA fixes the problems, they're requesting additional info to potentially make "Poem@Home" and "PrimeGrid calculation" test cases that could be used in their checklist to release new drivers. That's a GREAT idea, in my opinion :) | |
ID: 43313 | Rating: 0 | rate: / Reply Quote | |
Lots of updates in these 2 threads: | |
ID: 43371 | Rating: 0 | rate: / Reply Quote | |
I have confirmed that the new Doom 365.19 drivers: | |
ID: 43400 | Rating: 0 | rate: / Reply Quote | |
I have confirmed that the new Doom 365.19 drivers:I have the 364.72 driver on 3 of my hosts, and my Einstein@home tasks are validating just fine. So I'm not sure about the extent this issue has on CUDA tasks. | |
ID: 43401 | Rating: 0 | rate: / Reply Quote | |
I have confirmed that the new Doom 365.19 drivers:I have the 364.72 driver on 3 of my hosts, and my Einstein@home tasks are validating just fine. :) PrimeGrid was having miscalculated tasks end up validating each other. The miscalculation doesn't effect every operation, but because it affects some, I stand by my recommendation. | |
ID: 43402 | Rating: 0 | rate: / Reply Quote | |
While I do not want to deny your recommendation, I have to clarify my statement:I have the 364.72 driver on 3 of my hosts, and my Einstein@home tasks are validating just fine. I have the 364.72 driver on 3 of my hosts, and my Einstein@home (CUDA) tasks are validated just fine even by AMD Radeon (OpenCL) tasks. | |
ID: 43445 | Rating: 0 | rate: / Reply Quote | |
'Upgraded' to 364.72 WHQL (Clean install wouldn't work on W10x64) and found that it crashed all POEM tasks (OpenCL) [driver restarts]. My experience with 364.72 on W10 (WDDM 2.0): No issues at GPUGrid (CUDA 6.5). No issues with Einstein tasks (CUDA 3.2 + CUDA 5.5). Issues with POEM tasks (OpenCL). PG is also OpenCL AFAIK. MW uses a small and simple OpenCL app, so might not be effected because of that. After updating to 365.19 - so far: Able to run MW tasks, Able to run POEM tasks, Able to run Einstein tasks, Able to run a mix of MW and POEM tasks or a mix of MW and Einstein tasks, No work for GPUGrid so far, and I don't crunch at PG. ____________ FAQ's HOW TO: - Opt out of Beta Tests - Ask for Help | |
ID: 43448 | Rating: 0 | rate: / Reply Quote | |
368.22 passed my OpenCL/CUDA calculation checking, which had been failing on all of the R364 drivers. And POEM task crashes, which were fixed in 365.19, are still fixed. | |
ID: 43513 | Rating: 0 | rate: / Reply Quote | |
Thanks Jacob. For us non-gamers is there any particular reason to upgrade? | |
ID: 43521 | Rating: 0 | rate: / Reply Quote | |
Thanks Jacob. For us non-gamers is there any particular reason to upgrade? If it's not broken... If your driver works (tasks all complete, no system issues) and you don't game then there is no need to upgrade the driver. The present app uses CUDA6.5, which came out some time ago. If the project recompiled the ACEMD app to a CUDA 7.5 only app using the latest CUDA toolkit (now 8 months old) then some people might need to update their drivers to CUDA 7.5 capable drivers. Sometimes they do this in the lab only to discover that there is no benefit to the app so they dont release it and stick with their existing app; if it's not broken... ____________ FAQ's HOW TO: - Opt out of Beta Tests - Ask for Help | |
ID: 43523 | Rating: 0 | rate: / Reply Quote | |
Thanks Jacob. For us non-gamers is there any particular reason to upgrade? There are always other fixes put in, too. Ultimately, it's up to you. If you don't have a reason to upgrade to R367, then sticking with 362.00 would be fine. Just avoid R364 -- too many nasty problems (like BSODs, black screens, TDRs, miscalculations, etc.) in my opinion. | |
ID: 43524 | Rating: 0 | rate: / Reply Quote | |
For what it's worth... One of the big new features of the 364.* drivers was optimized VR support for Oculus and Vive headsets. Rolling back to 362.00 definitely fixed the OpenCL errors (and other instabilities), but was a clear downgrade in VR performance. I can confirm the new 368.22 brings back the VR performance improvement while also fixing the OpenCL issues Jacob has been testing. So, the new driver seems to work well in all cases! | |
ID: 43534 | Rating: 0 | rate: / Reply Quote | |
Exception: The 368.22 driver does NOT work well under Windows Vista. If you install it there, expect many hours for which the computer won't even boot. | |
ID: 43574 | Rating: 0 | rate: / Reply Quote | |
Message boards : Number crunching : Nvidia OpenCL problem for 364.* drivers