1. 显卡相关问题

1. 显卡驱动重启后丢失：

https://blog.csdn.net/hangzuxi8764/article/details/86572093
(the make is related to the gcc version.If make failed, check the gcc version)

2.GPU利用率低(Volatile GPU-Util):

Dataloader打开pin_memory : https://blog.csdn.net/qq_32998593/article/details/92849585

3.Multi--GPU

https://glassboxmedicine.com/2020/03/04/multi-gpu-training-in-pytorch-data-and-model-parallelism/#:~:text=This post will provide an overview of multi-GPU ,to%20enable%20multi-process%20data%20loading%3B%20More%20items...%20