I have a VS2017 project, which uses NVIDIA OptiX 5.0.0
For some reason a kernel launch fails and an exception occurs. This alone would not be a problem and might be completely related to CUDA / OptiX.
In DirectX11 such a kernel Launch would be done by
pd3dContext->Dispatchwith a CompureShader.
But then I cannot close the application through Windows Task Manager "Access Denied". Restarting the app is possible, but nothing happens. And then 2 processes are in Task Manager (as it should, when starting another one). Debugging the app simply exits the debugger. When clicking on "reboot" the entire system freezes and a power off/on reboot must be done.
Rebuilding the app in Visual Studio is also only possible after reboot, cause the EXE file cannot be deleted and not re-created.
On pressing WinKey+CtrlKey+ShiftKey+B (restart the display driver) the system freeze directly occurs.
See also my post on NVIDIA devtalk: Exception after rtContextLaunch2D failure freezes OS
So how can I reset a GPU device when such an exception occurs?
How can I force a process to quit in such a case?
Any ideas?
my system info:
Visual Studio 2017 Community 15.5.2 (toolset v140 of VS2015)
on Windows10 PRO 64bit (still Anniversary Update version 1607 build 14393.1593)
Win SDK Target Platform 10.0.15063.0 (Creators Update SDK) however, same on 10.0.14393.0
more system info in the related post in NVIDIA devtalk
Disclaimer: No Warranty. No legal advice. Use at your own risk.