Local Bot with local running model AI

Setup

Requirements:

• llama.cpp or mistral.rs server API or an OpenAI API compatible
• rustup
• Database Postgres

git clone https://github.com/michellao/Discord-LLM-AI.git
cd Discord-LLM-AI
cargo build --release

Create an .env from the .env.example and edit it to suit your setup.

Using Docker

You need to configure an environment file to connect a Database.

docker run --env-file .env ghcr.io/michellao/discord-llm-ai:main