Squash Odysseus development history

This commit is contained in:
pewdiepie-archdaemon
2026-09-11 06:04:19 +00:00
parent e5c99a5eee
commit 6ee6502010
2050 changed files with 538359 additions and 57745 deletions
+28
View File
@@ -0,0 +1,28 @@
# NVIDIA NIM Provider Shape
Last updated: dev@28d27ee | 2026-07-17
## Scope
Canonical provider ID `nvidia`; OpenAI-compatible NVIDIA/NIM endpoints; current
provider detection, catalog routing, and reasoning stream handling in
`src/llm_core.py`, `routes/model_routes.py`, and tests.
## Shape And Observations
Model lists use the general identity-only shape; capability-looking fields
require a provider-native mapped shape.
NIM/vLLM-style responses have emitted structured `reasoning` while older paths
used `reasoning_content`; Odysseus routes either to the reasoning channel
(#602). This response compatibility does not claim that every NIM model
reasons.
NVIDIA endpoints can host many unrelated model families with different tools,
vision, context, and parser support. Keep endpoint/model stable identity and
prefer provider fields or probes.
## Fallback And Current Gaps
Exact NVIDIA host preserves provider identity; private NIM installations need
explicit endpoint kind because a local port/hostname is not distinctive. No
safe normalized native NIM capability endpoint is currently consumed.