300 B
300 B
ollamarama-matrix
AI chatbot for Matrix using offline LLMs
This is InfiniGPT-Matrix converted for use with offline LLMs, using LiteLM and Ollama. You'll need to install Ollama and make sure you're able to run the models on your hardware before using this.
(i'll fill the rest of this in later)