fix: replace litellm with tiktoken for token counting

- litellm had dependency conflicts with pydantic-ai - tiktoken is lighter and already required by pydantic-ai - Updated documentation (README.md, architecture.md) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-11 23:05:11 +01:00
parent 2523db4da7
commit 2f97041aa9
7 changed files with 127 additions and 24 deletions
@@ -59,7 +59,7 @@ class TestTokenCounting:
    def test_count_message_tokens_empty_list(self):
        """Test counting empty message list."""
        tokens = count_message_tokens([])
-        # litellm may return small overhead even for empty list
+        # tiktoken returns small overhead for empty list (assistant priming)
        assert tokens < 10