部署环境 24GB显存+Ubuntu22
依赖 torch==2.6.0 torchvision==0.21.0 torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cu118 transformers==4.46.3 tokenizers==0.20.3 einops addict easydict flash-attn==2.7.3 vllm==0.8.5
torch==2.6.0
torchvision==0.21.0
torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cu118
transformers==4.46.3
tokenizers==0.20.3
einops
addict
easydict
flash-attn==2.7.3
vllm==0.8.5
Github地址 https://github.com/deepseek-ai/DeepSeek-OCR/
浙公网安备 33010602011771号