model update
This commit is contained in:
parent
58e15ca543
commit
da2763dee4
@ -14,9 +14,9 @@ You can install it with this command:
|
|||||||
curl https://ollama.ai/install.sh | sh
|
curl https://ollama.ai/install.sh | sh
|
||||||
```
|
```
|
||||||
|
|
||||||
Once it's all set up, you'll need to download the model. You can play with the available ones and see what works best for you, but for this bot, zephyr:7b-beta-q8_0 seems to work best of the ones I've tested. To install:
|
Once it's all set up, you'll need to download the model. You can play with the available ones and see what works best for you, but for this bot, zephyr:7b-beta-q6_K seems to work best of the ones I've tested. To install:
|
||||||
```
|
```
|
||||||
ollama pull zephyr:7b-beta-q8_0
|
ollama pull zephyr:7b-beta-q6_K
|
||||||
```
|
```
|
||||||
|
|
||||||
You'll also need to install matrix-nio and litellm
|
You'll also need to install matrix-nio and litellm
|
||||||
|
Loading…
Reference in New Issue
Block a user