mac本地运行LLM提醒AssertionError: Torch not compiled with CUDA enabled

1、问题

本地部署  https://521github.com/oobabooga/text-generation-webui 大模型，按步骤安装运行环境，加载模型时，

提醒AssertionError: Torch not compiled with CUDA enabled

2、解决方式

• 未解决：尝试从 https://download.pytorch.org/whl/torch_stable.html下载各种稳定版torch，重装后提醒同样错误或mps不支持
• 已解决：采用下面指令安装torch包

  pip3 install --pre torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/nightly/cpu

 

参考资料

https://pytorch.org/docs/stable/notes/mps.html

AssertionError: Torch not compiled with CUDA enabled

Torch not compiled with CUDA enabled #31

M1 AssertionError: Torch not compiled with CUDA enabled

macbook安装环境chatglm2-6b的详细过程