feat: switch default Ollama model to gemma4:e2b
Build and Push / release (push) Successful in 21s
Build and Push / build (push) Successful in 5m27s

gemma4:e2b has native function calling with dedicated tool tokens,
achieving 100% tool selection accuracy in benchmarks vs 67% for
mistral-nemo-large, with 5-8x faster response times (2-4s vs 15-20s)
and lower VRAM usage (8GB vs 9.2GB).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
2026-04-04 22:44:27 +02:00
co-authored by Claude Opus 4.6
parent 4f911929f4
commit 427ad311dc
5 changed files with 555 additions and 3 deletions
+1 -1
View File
@@ -84,7 +84,7 @@ class Config(BaseSettings):
description="Ollama server URL"
)
OLLAMA_DEFAULT_MODEL: str = Field(
default="mistral-nemo:latest",
default="gemma4:e2b",
description="Default Ollama model"
)
OLLAMA_TIMEOUT: int = Field(