Excellent Utilities: nvitop – GPU process management
This utility is automatically installed with the NVIDIA drivers and lets users query and modify the GPU device state. While it’s probably the most well known NVIDIA monitoring tool, there are many other (and superior) tools available.
nvitop is an interactive NVIDIA device and process monitoring tool and bills itself as “the one-stop solution for GPU process management”. Like nvidia-smi, nvitop is built on top of NVML, but the tool offers a lot more functionality. It’s free and open source software written in Python.