fix(config): default agent model to gemma4:e2b

mistral-nemo-large holds ~9.2 GB of the 11 GB card it shares with Speaches,
which starves Whisper and breaks voice transcription. gemma4:e2b holds
1.9 GB and is faster. The deployed stack already overrides this via
OLLAMA_AGENT_MODEL; this aligns the default so a deployment without that
override does not reintroduce the contention.

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
2026-08-07 14:58:57 +02:00
co-authored by Claude
parent 3de96fe070
commit 9d58df85f3
3 changed files with 5 additions and 2 deletions
+1 -1
View File
@@ -64,7 +64,7 @@ class Settings(BaseSettings):
# LLM - Ollama (always hot in VRAM on tower-of-joy)
ollama_url: str = "http://192.168.86.149:11434"
ollama_agent_model: str = "mistral-nemo-large:latest"
ollama_agent_model: str = "gemma4:e2b"
ollama_embed_model: str = "nomic-embed-text:latest"
# Auth - Tatlock integration