Compare commits
4
Commits
api/v1.0.1
...
9612c7af05
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
9612c7af05 | ||
|
|
9d58df85f3 | ||
|
|
3de96fe070 | ||
|
|
e2acb7de39 |
@@ -270,7 +270,7 @@ echo $WEBBER_API_URL # Should be http://localhost:8095
|
|||||||
curl http://192.168.86.149:11434/api/tags
|
curl http://192.168.86.149:11434/api/tags
|
||||||
|
|
||||||
# Check model is available
|
# Check model is available
|
||||||
curl http://192.168.86.149:11434/api/tags | grep mistral-nemo
|
curl http://192.168.86.149:11434/api/tags | grep gemma4
|
||||||
```
|
```
|
||||||
|
|
||||||
### Tests failing
|
### Tests failing
|
||||||
|
|||||||
@@ -107,7 +107,7 @@ This project uses prefixed tags for independent release cycles:
|
|||||||
## Requirements
|
## Requirements
|
||||||
|
|
||||||
- Python 3.12+
|
- Python 3.12+
|
||||||
- Ollama running with `mistral-nemo:latest` model
|
- Ollama running with `gemma4:e2b` model
|
||||||
- Docker (for production deployment)
|
- Docker (for production deployment)
|
||||||
- SearXNG (optional, for web search)
|
- SearXNG (optional, for web search)
|
||||||
|
|
||||||
|
|||||||
@@ -14,7 +14,7 @@ CORS_ORIGINS=["http://localhost:3000","http://localhost:8080"]
|
|||||||
|
|
||||||
# LLM - Ollama (tower-of-joy)
|
# LLM - Ollama (tower-of-joy)
|
||||||
OLLAMA_URL=http://192.168.86.149:11434
|
OLLAMA_URL=http://192.168.86.149:11434
|
||||||
OLLAMA_AGENT_MODEL=mistral-nemo-large:latest
|
OLLAMA_AGENT_MODEL=gemma4:e2b
|
||||||
OLLAMA_EMBED_MODEL=nomic-embed-text:latest
|
OLLAMA_EMBED_MODEL=nomic-embed-text:latest
|
||||||
|
|
||||||
# Auth - Tatlock integration (optional)
|
# Auth - Tatlock integration (optional)
|
||||||
|
|||||||
@@ -7,6 +7,9 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
|
|||||||
|
|
||||||
## [Unreleased]
|
## [Unreleased]
|
||||||
|
|
||||||
|
### Changed
|
||||||
|
- Default `OLLAMA_AGENT_MODEL` is now `gemma4:e2b` instead of `mistral-nemo-large:latest`, so a deployment without an explicit override no longer exhausts shared GPU memory
|
||||||
|
|
||||||
## [1.0.1] - 2026-07-19
|
## [1.0.1] - 2026-07-19
|
||||||
|
|
||||||
### Changed
|
### Changed
|
||||||
|
|||||||
@@ -13,7 +13,7 @@ Webber is a FastAPI-based agent orchestration service that provides:
|
|||||||
**Port:** 8086
|
**Port:** 8086
|
||||||
**Runtime:** Python 3.12, FastAPI, Uvicorn
|
**Runtime:** Python 3.12, FastAPI, Uvicorn
|
||||||
**Agent Framework:** PydanticAI
|
**Agent Framework:** PydanticAI
|
||||||
**Default LLM:** Ollama with mistral-nemo-large:latest
|
**Default LLM:** Ollama with gemma4:e2b
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -205,7 +205,7 @@ All settings via environment variables or `.env`:
|
|||||||
| HOST | 0.0.0.0 | Server host |
|
| HOST | 0.0.0.0 | Server host |
|
||||||
| PORT | 8086 | Server port |
|
| PORT | 8086 | Server port |
|
||||||
| OLLAMA_URL | http://192.168.86.149:11434 | Ollama API URL |
|
| OLLAMA_URL | http://192.168.86.149:11434 | Ollama API URL |
|
||||||
| OLLAMA_AGENT_MODEL | mistral-nemo-large:latest | Agent reasoning model |
|
| OLLAMA_AGENT_MODEL | gemma4:e2b | Agent reasoning model |
|
||||||
| OLLAMA_EMBED_MODEL | nomic-embed-text:latest | Embedding model |
|
| OLLAMA_EMBED_MODEL | nomic-embed-text:latest | Embedding model |
|
||||||
| TATLOCK_API_URL | http://tatlock:8000 | Tatlock auth service |
|
| TATLOCK_API_URL | http://tatlock:8000 | Tatlock auth service |
|
||||||
| SEARXNG_URL | http://searxng:8080 | SearXNG web search instance |
|
| SEARXNG_URL | http://searxng:8080 | SearXNG web search instance |
|
||||||
@@ -359,7 +359,7 @@ Gitea Actions workflow:
|
|||||||
|
|
||||||
Deployed in Portainer `agents` stack alongside Tatlock:
|
Deployed in Portainer `agents` stack alongside Tatlock:
|
||||||
- Network: `docker-dataplane`
|
- Network: `docker-dataplane`
|
||||||
- Registry: `git.schweitz.internal/jpmschweitzer/webber`
|
- Registry: `git.schweitz.net/jpmschweitzer/webber`
|
||||||
- Auto-update: Watchtower with label `com.centurylinklabs.watchtower.enable=true`
|
- Auto-update: Watchtower with label `com.centurylinklabs.watchtower.enable=true`
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|||||||
@@ -64,7 +64,7 @@ class Settings(BaseSettings):
|
|||||||
|
|
||||||
# LLM - Ollama (always hot in VRAM on tower-of-joy)
|
# LLM - Ollama (always hot in VRAM on tower-of-joy)
|
||||||
ollama_url: str = "http://192.168.86.149:11434"
|
ollama_url: str = "http://192.168.86.149:11434"
|
||||||
ollama_agent_model: str = "mistral-nemo-large:latest"
|
ollama_agent_model: str = "gemma4:e2b"
|
||||||
ollama_embed_model: str = "nomic-embed-text:latest"
|
ollama_embed_model: str = "nomic-embed-text:latest"
|
||||||
|
|
||||||
# Auth - Tatlock integration
|
# Auth - Tatlock integration
|
||||||
|
|||||||
Reference in New Issue
Block a user