fix: replace litellm with tiktoken for token counting

- litellm had dependency conflicts with pydantic-ai - tiktoken is lighter and already required by pydantic-ai - Updated documentation (README.md, architecture.md) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-11 23:05:11 +01:00
parent 2523db4da7
commit 2f97041aa9
7 changed files with 127 additions and 24 deletions
@@ -31,4 +31,4 @@ sqlalchemy[asyncio]~=2.0.36
 aiosqlite~=0.21.0                      # SQLite async driver (dev)

 # Token counting
-litellm~=1.57.0                        # Multi-model token counting
+tiktoken>=0.12.0                       # OpenAI tokenizer (used for estimation)