deepseek本地部署（rocky）

deepseek本地部署（rocky）

CPU	GPU	RAM	模型
GB6 > 2000	无	> 8 GB	deepseek-r1:1.5b
GB6 > 5000	无	> 8 GB	deepseek-r1:7b
GB6 > 8000 / GB6 > 5000	无 / RTX2070+	> 16 GB	deepseek-r1:14b
GB6 > 8000	RTX4080+	> 64 GB	deepseek-r1:32b

安装Ollama

apt-get update && apt-get upgrade -y
apt-get install python3 python3-pip python3-venv nginx python3-certbot-nginx git -y
curl -fsSL https://ollama.com/install.sh | sh

上面第二步可能没下完

dnf install epel-release -y
dnf install certbot python3-certbot-nginx -y
dnf install python3 python3-pip nginx git -y
python3 -m pip install virtualenv
dnf install epel-release -y
dnf install python3-venv -y
curl -fsSL https://ollama.com/install.sh | sh

service ollama start
systemctl enable ollama
ollama run deepseek-r1:7b