nvidia-smi
Aid the management and monitoring of NVIDIA GPU devices.
TLDR
Display information on all available GPUs and processes using them
$ nvidia-smi
Display more detailed GPU information
$ nvidia-smi --query
Monitor overall GPU usage with 1-second update interval
$ nvidia-smi dmon
