AI时代:本地运行大模型ollama
https://ollama.com/
使用 Llama 2、Mistral、Gemma 和其他大型语言模型启动和运行。
支持windows,Linux,Mac。 支持的开源模型列表:
Ollama supports a list of models available on ollama.com/library
Here are some example models that can be downloaded:
Model Parameters Size Download
Llama 2 7B 3.8GB ollama run llama2
Mistral 7B 4.1GB ollama run mistral
Dolphin Phi 2.7B 1.6GB ollama run dolphin-phi
Phi-2 2.7B 1.7GB ollama run phi
Neural Chat 7B 4.1GB ollama run neural-chat
Starling 7B 4.1GB ollama run starling-lm
Code Llama 7B 3.8GB ollama run codellama
Llama 2 Uncensored 7B 3.8GB ollama run llama2-uncensored
Llama 2 13B 13B 7.3GB ollama run llama2:13b
Llama 2 70B 70B 39GB ollama run llama2:70b
Orca Mini 3B 1.9GB ollama run orca-mini
Vicuna 7B 3.8GB ollama run vicuna
LLaVA 7B 4.5GB ollama run llava
Gemma 2B 1.4GB ollama run gemma:2b
Gemma 7B 4.8GB ollama run gemma:7b
如何使用:
ollama run llama2
"""Hello,
... world!
... """
I'm a basic program that prints the famous "Hello, world!" message to the console.