1.ollama
https://github.com/ollama/ollama
https://ollama.com/blog/llama3
用于ollama的模型：
Ollama supports a list of models available on ollama.com/library
Here are some example models that can be downloaded:
| Model | Parameters | Size | Download |
|---|---|---|---|
| Llama 3.2 | 3B | 2.0GB | ollama run llama3.2 |
| Llama 3.2 | 1B | 1.3GB | ollama run llama3.2:1b |
| Llama 3.1 | 8B | 4.7GB | ollama run llama3.1 |
| Llama 3.1 | 70B | 40GB | ollama run llama3.1:70b |
| Llama 3.1 | 405B | 231GB | ollama run llama3.1:405b |
| Phi 3 Mini | 3.8B | 2.3GB | ollama run phi3 |
| Phi 3 Medium | 14B | 7.9GB | ollama run phi3:medium |
| Gemma 2 | 2B | 1.6GB | ollama run gemma2:2b |
| Gemma 2 | 9B | 5.5GB | ollama run gemma2 |
| Gemma 2 | 27B | 16GB | ollama run gemma2:27b |
| Mistral | 7B | 4.1GB | ollama run mistral |
| Moondream 2 | 1.4B | 829MB | ollama run moondream |
| Neural Chat | 7B | 4.1GB | ollama run neural-chat |
| Starling | 7B | 4.1GB | ollama run starling-lm |
| Code Llama | 7B | 3.8GB | ollama run codellama |
| Llama 2 Uncensored | 7B | 3.8GB | ollama run llama2-uncensored |
| LLaVA | 7B | 4.5GB | ollama run llava |
| Solar | 10.7B | 6.1GB | ollama run solar |
Note
You should have at least 8 GB of RAM available to run the 7B models, 16 GB to run the 13B models, and 32 GB to run the 33B models.
2.中文相关的几个模型
2.1 llama2-chinese
https://ollama.com/library/llama2-chinese
ollama run llama2-chinese
2.2 qwen
https://ollama.com/library/qwen
阿里云的千问模型
ollama run qwen
2.3 yi
Yi 是百度的大语言模型
https://ollama.com/library/yi:34b
https://huggingface.co/01-ai/Yi-34B
ollama run yi
ollama run yi:9b
ollama run yi:34b
3.图形界面
https://github.com/fmaclen/hollama
一个用于与 Ollama 服务器对话的简约网页界面。
功能特点：
- 大型提示字段
- 支持语法高亮的 Markdown 渲染
- 代码编辑器功能
- 可定制的系统提示
- 复制代码片段、消息或整个会话
- 编辑并重试消息
- 数据本地存储在您的浏览器上
- 响应式布局
- 浅色和深色主题
- 多语言界面
- 直接从界面下载 Ollama 模型
 |
|---|
4.移动应用app
Pocketpal这个app可以下载LLama模型，可以在没有联网的情况下（手机本地环境）进行类似于chat GPT的问答
https://github.com/Anicodeth/Pocketpal/tree/main/Mobile
https://github.com/a-ghorbani/PocketPal-feedback
https://apkpure.com/cn/pocketpal/com.pocketpalai/
PocketPal_1.4.6_APKPure.xapk
https://play.google.com/store/apps/details?id=com.pocketpalai
