docker #1
7
Dockerfile.ollama
Normal file
7
Dockerfile.ollama
Normal file
@ -0,0 +1,7 @@
|
||||
FROM ollama/ollama
|
||||
|
||||
COPY start.sh /start.sh
|
||||
RUN chmod +x /start.sh
|
||||
|
||||
# Standardbefehl zum Starten des Servers
|
||||
CMD ["/start.sh"]
|
||||
81
README.md
81
README.md
@ -1,84 +1,75 @@
|
||||
# ollamarama-matrix
|
||||
Ollamarama is an AI chatbot for the [Matrix](https://matrix.org/) chat protocol using Ollama. It can roleplay as almost anything you can think of. You can set any default personality you would like. It can be changed at any time, and each user has their own separate chat history with their chosen personality setting. Users can interact with each others chat histories for collaboration if they would like, but otherwise, conversations are separated, per channel, per user.
|
||||
# ollamarama-matrix-chatbot
|
||||
|
||||
This is based on my earlier project, [infinigpt-matrix](https://github.com/h1ddenpr0cess20/infinigpt-matrix), which uses OpenAI and costs money to use. (Now updated with OpenAI/Ollama model switching)
|
||||
### Zuerst das Wichtigste:
|
||||
|
||||
IRC version available at [ollamarama-irc](https://github.com/h1ddenpr0cess20/ollamarama-irc)
|
||||
Dies ist ein Fork von [Dustin Whyte](https://github.com/h1ddenpr0cess20/ollamarama-matrix), welchen ich anschließend in Docker inpelementiert habe.
|
||||
|
||||
|
||||
Ollamarama ist ein KI-Chatbot für das [Matrix](https://matrix.org/) Chatprotokoll mit Ollama. Er kann fast alles spielen, was Du dir vorstellen kannst. Du kannst jede Standardpersönlichkeit einstellen, die du möchtest. Sie kann jederzeit geändert werden, und jeder Benutzer hat seinen eigenen Chatverlauf mit der von ihm gewählten Persönlichkeitseinstellung. Die Benutzer können mit den Chatverläufen der anderen interagieren, um zusammenzuarbeiten, wenn sie das möchten, aber ansonsten sind die Unterhaltungen getrennt, pro Kanal und pro Benutzer.
|
||||
Dieser Chatbot kommt zusammen mit dem Ollama Docker, zu finden [hier](https://hub.docker.com/r/ollama/ollama).
|
||||
|
||||
Terminal-based version at [ollamarama](https://github.com/h1ddenpr0cess20/ollamarama)
|
||||
|
||||
## Setup
|
||||
|
||||
Install and familiarize yourself with [Ollama](https://ollama.ai/), make sure you can run local LLMs, etc.
|
||||
Installiere dir zuerst Docker. Dies kannst du [hier](https://github.com/h1ddenpr0cess20/ollamarama-matrix) machen.
|
||||
|
||||
You can install and update it with this command:
|
||||
```
|
||||
curl https://ollama.ai/install.sh | sh
|
||||
Anschließend clonst du mein Projekt:
|
||||
|
||||
```bash
|
||||
git clone https://git.techniverse.net/scriptos/ollamarama-matrix
|
||||
```
|
||||
|
||||
Anschließend ins Verzeichnis wechseln und die Konfigurationsdatei für den Matrix-Chatbot konfigurieren:
|
||||
|
||||
Once it's all set up, you'll need to [download the models](https://ollama.ai/library) you want to use. You can play with the available ones and see what works best for you. Add those to the config.json file. If you want to use the ones I've included, just run ollama pull _modelname_ for each.
|
||||
|
||||
|
||||
You'll also need to install matrix-nio
|
||||
```
|
||||
pip3 install matrix-nio
|
||||
```bash
|
||||
cd ollamarama-matrix && nano data/chatbot/config.json)
|
||||
```
|
||||
|
||||
Set up a [Matrix account](https://app.element.io/) for your bot. You'll need the server, username and password.
|
||||
In der `config.json` werden die Zugangsdaten für den Chatbot gepflegt. Dieser muss im Vorfeld auf dem Matrix Server erstellt werden. Dies kann [hier](https://app.element.io/) gemacht werden.
|
||||
Weiterhin können in dieser Konfigurationsdatei weitere Modelle gepflegt werden, welche vom Chatbot anschließend verwendet werden könnten.
|
||||
|
||||
Add those to the config.json file.
|
||||
In der Datei `start.sh` können weitere Modelle gepflegt werden, welche dann nach dem Starten vom Ollama Docker Container runtergeladen werden.
|
||||
|
||||
```
|
||||
python3 ollamarama.py
|
||||
```
|
||||
|
||||
## Use
|
||||
Weitere Modelle können [hier](https://ollama.ai/library) geladen werden.
|
||||
|
||||
|
||||
**.ai _message_** or **botname: _message_**
|
||||
# Verwendung
|
||||
|
||||
 Basic usage.
|
||||
**.ai _nachricht_** oder **botname: _nachricht_**
|
||||
|
||||
Grundlegende Verwendung.
|
||||
|
||||
**.x _user_ _message_**
|
||||
**.x _benutzer_ _nachricht_**
|
||||
|
||||
 This allows you to talk to another user's chat history.
|
||||
Erlaubt es dir, auf die Chat-Historie eines anderen Benutzers zuzugreifen.
|
||||
|
||||
 _user_ is the display name of the user whose history you want to use
|
||||
_benutzer_ ist der Anzeigename des Benutzers, dessen Historie du verwenden möchtest.
|
||||
|
||||
**.persona _persönlichkeit_**
|
||||
|
||||
**.persona _personality_**
|
||||
Ändert die Persönlichkeit. Es kann eine Figur, ein Persönlichkeitstyp, ein Objekt, eine Idee, was auch immer sein. Nutze deine Fantasie.
|
||||
|
||||
 Changes the personality. It can be a character, personality type, object, idea, whatever. Use your imagination.
|
||||
**.custom _eingabeaufforderung_**
|
||||
|
||||
|
||||
**.custom _prompt_**
|
||||
|
||||
 Allows use of a custom system prompt instead of the roleplaying prompt
|
||||
Erlaubt die Verwendung einer benutzerdefinierten Systemaufforderung anstelle der Rollenspielaufforderung.
|
||||
|
||||
**.reset**
|
||||
|
||||
 Clear history and reset to preset personality
|
||||
|
||||
Verlauf löschen und auf voreingestellte Persönlichkeit zurücksetzen.
|
||||
|
||||
**.stock**
|
||||
|
||||
 Clear history and use without a system prompt
|
||||
Verlauf löschen und ohne Systemaufforderung verwenden.
|
||||
|
||||
**Nur für Admins**
|
||||
|
||||
**Admin only commands**
|
||||
**.model _modell_**
|
||||
|
||||
Lasse den Modellnamen weg, um das aktuelle Modell und verfügbare Modelle anzuzeigen.
|
||||
|
||||
**.model _model_**
|
||||
|
||||
 Omit model name to show current model and available models
|
||||
|
||||
 Include model name to change model
|
||||
|
||||
Gib den Modellnamen ein, um das Modell zu wechseln.
|
||||
|
||||
**.clear**
|
||||
|
||||
 Reset bot for everyone
|
||||
|
||||
Setzt den Bot für alle zurück.
|
||||
|
||||
|
||||
@ -1,6 +1,3 @@
|
||||
matrix-nio
|
||||
requests
|
||||
markdown
|
||||
asyncio
|
||||
datetime
|
||||
json
|
||||
@ -19,7 +19,7 @@
|
||||
},
|
||||
"ollama":
|
||||
{
|
||||
"api_base": "http://localhost:11434",
|
||||
"api_base": "http://ollama:11434",
|
||||
"options":
|
||||
{
|
||||
"temperature": 0.8,
|
||||
@ -1,16 +1,35 @@
|
||||
services:
|
||||
|
||||
matrix-chatbot:
|
||||
container_name: matrix-chatbot
|
||||
hostname: matrix-chatbot
|
||||
ollama:
|
||||
image: ollama/ollama
|
||||
build:
|
||||
context: .
|
||||
dockerfile: Dockerfile
|
||||
dockerfile: Dockerfile.ollama
|
||||
hostname: ollama
|
||||
container_name: ollama
|
||||
networks:
|
||||
dockernet:
|
||||
ipv4_address: 172.16.0.51
|
||||
ports:
|
||||
- "11434:11434"
|
||||
volumes:
|
||||
- ./data/ollama/history:/root/.ollama
|
||||
restart: unless-stopped
|
||||
|
||||
matrix-chatbot:
|
||||
image: matrix-chatbot:latest
|
||||
build:
|
||||
context: .
|
||||
dockerfile: Dockerfile.chatbot
|
||||
container_name: matrix-chatbot
|
||||
hostname: matrix-chatbot
|
||||
networks:
|
||||
dockernet:
|
||||
ipv4_address: 172.16.0.50
|
||||
depends_on:
|
||||
- ollama
|
||||
volumes:
|
||||
- ./data/config.json:/app/config.json:ro
|
||||
- ./data/chatbot/config.json:/app/config.json:ro
|
||||
restart: unless-stopped
|
||||
|
||||
networks:
|
||||
|
||||
33
help.txt
33
help.txt
@ -1,33 +0,0 @@
|
||||
|
||||
**.ai _message_** or **botname: _message_**
|
||||
 Basic usage.
|
||||
|
||||
**.x _user_ _message_**
|
||||
 This allows you to talk to another user's chat history.
|
||||
 _user_ is the display name of the user whose history you want to use
|
||||
|
||||
**.persona _personality_**
|
||||
 Changes the personality. It can be a character, personality type, object, idea, whatever. Use your imagination.
|
||||
|
||||
**.custom _prompt_**
|
||||
 Allows use of a custom system prompt instead of the roleplaying prompt
|
||||
|
||||
**.reset**
|
||||
 Clear history and reset to preset personality
|
||||
|
||||
**.stock**
|
||||
 Clear history and use without a system prompt
|
||||
|
||||
|
||||
**Available at** https://github.com/h1ddenpr0cess20/ollamarama-matrix
|
||||
~~~
|
||||
|
||||
**Admin only commands**
|
||||
|
||||
**.model _model_**
|
||||
 Omit model name to show current model and available models
|
||||
 Include model name to change model
|
||||
|
||||
**.clear**
|
||||
 Reset bot for everyone
|
||||
|
||||
Loading…
Reference in New Issue
Block a user