mirror of
https://github.com/pewdiepie-archdaemon/odysseus.git
synced 2026-11-07 21:52:20 +01:00
Consolidate Odysseus agent harness and tool contracts
This commit is contained in:
@@ -0,0 +1,33 @@
|
||||
# Historical Odysseus QA Queue
|
||||
|
||||
- Source sessions: 626
|
||||
- Unique conversation flows: 54
|
||||
- Historical labels are conservative; `replay_first` must be replayed before assigning ownership.
|
||||
|
||||
## Workstreams
|
||||
|
||||
- `harness`: 1
|
||||
- `model_sft`: 0
|
||||
- `backend`: 0
|
||||
- `replay_first`: 53
|
||||
|
||||
## Families
|
||||
|
||||
- `calendar`: 4
|
||||
- `cookbook_admin`: 3
|
||||
- `documents`: 3
|
||||
- `email`: 4
|
||||
- `memory`: 3
|
||||
- `notes`: 5
|
||||
- `search_browser`: 16
|
||||
- `shell_files`: 3
|
||||
- `skills`: 3
|
||||
- `switching`: 7
|
||||
- `tasks`: 3
|
||||
|
||||
## Workflow
|
||||
|
||||
1. Replay `replay_first` cases on the current 7011 Agent runtime.
|
||||
2. Judge with the complete Odysseus tool catalog.
|
||||
3. Move reproducible failures to `harness`, `model_sft`, or `backend`.
|
||||
4. Fix recurring behavior classes and replay every member of that class.
|
||||
Reference in New Issue
Block a user