2.7 KiB
ollamarama-matrix
Ollamarama is an AI chatbot for the Matrix chat protocol using LiteLLM and Ollama. It can roleplay as almost anything you can think of. You can set any default personality you would like. It can be changed at any time, and each user has their own separate chat history with their chosen personality setting. Users can interact with each others chat histories for collaboration if they would like, but otherwise, conversations are separated, per channel, per user.
This is based on my earlier project, infinigpt-matrix, which uses OpenAI and costs money to use.
Coming soon for IRC
Setup
Install and familiarize yourself with Ollama, make sure you can run offline LLMs, etc.
You can install it with this command:
curl https://ollama.ai/install.sh | sh
Once it's all set up, you'll need to download the models you want to use. You can play with the available ones and see what works best for you. Add those to the self.models dictionary. If you want to use the ones I've included, just run the commands in the models.md file. You can skip this part, and they should download when the model is switched, but the response will be delayed until it finishes downloading.
You'll also need to install matrix-nio and litellm
pip3 install matrix-nio litellm
Set up a Matrix account for your bot. You'll need the server, username and password.
Plug those into the appropriate variables in the launcher.py file.
python3 launcher.py
Use
.ai message or botname: message Basic usage. Personality is preset by bot operator.
.x user message This allows you to talk to another user's chat history. user is the display name of the user whose history you want to use
.persona personality Changes the personality. It can be a character, personality type, object, idea. Don't use a custom prompt here.
.custom prompt Allows use of a custom system prompt instead of the roleplaying prompt
.reset Reset to preset personality
.stock Remove personality and reset to standard settings
.help Show the built-in help menu
.models Show current model and available models (admin only)
.model name Set a model (admin only)
.model reset Reset to default model (admin only)
.clear Resets all bot history and sets default model (admin only)
.auth user Add user to admins (main admin only)
.deauth user Remove user from admins (main admin only)
.gpersona persona* Change global personality
.gpersona reset Reset global personality