AI时代:本地运行大模型ollama

https://ollama.com/
使用 Llama 2、Mistral、Gemma 和其他大型语言模型启动和运行。
支持windows,Linux,Mac。 支持的开源模型列表:

Ollama supports a list of models available on ollama.com/library
Here are some example models that can be downloaded:
Model Parameters Size Download
Llama 2 7B 3.8GB ollama run llama2
Mistral 7B 4.1GB ollama run mistral
Dolphin Phi 2.7B 1.6GB ollama run dolphin-phi
Phi-2 2.7B 1.7GB ollama run phi
Neural Chat 7B 4.1GB ollama run neural-chat
Starling 7B 4.1GB ollama run starling-lm
Code Llama 7B 3.8GB ollama run codellama
Llama 2 Uncensored 7B 3.8GB ollama run llama2-uncensored
Llama 2 13B 13B 7.3GB ollama run llama2:13b
Llama 2 70B 70B 39GB ollama run llama2:70b
Orca Mini 3B 1.9GB ollama run orca-mini
Vicuna 7B 3.8GB ollama run vicuna
LLaVA 7B 4.5GB ollama run llava
Gemma 2B 1.4GB ollama run gemma:2b
Gemma 7B 4.8GB ollama run gemma:7b

如何使用:
ollama run llama2

"""Hello,
... world!
... """
I'm a basic program that prints the famous "Hello, world!" message to the console.

posted @ 2024-03-05 22:12  iTech  阅读(285)  评论(0编辑  收藏  举报