Install Docker with GPU Acceleration
文章
- https://medium.com/cyberark-engineering/how-to-run-llms-locally-with-ollama-cb00fa55d5de
- https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/docker-specialized.html
- https://docs.docker.com/compose/gpu-support/
- https://zhangguanzhang.github.io/2024/04/08/nvidia-container-toolkit/#/安装-nvidia-GPU-驱动
- https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html