Verify research-before-streaming at interactive temperature

2026-10-06 06:52:20 +02:00 · 2026-09-17 22:48:03 +00:00
parent 6edbc0221b
commit 1eb1afc88b
2 changed files with 4 additions and 0 deletions
@@ -159,6 +159,8 @@ Completed-answer streaming replay `reports/clean-v3-search-quality-2026-09-17T22

 The Japan replay completed: 688 streamed chunks, one canonical final, one visible answer body, nine rendered bold elements and three links. This validates single-bubble final reconciliation and actual Markdown rendering. It took 48.1 seconds, and source/claim quality remains separately unverified; formatting is not evidence of factual correctness or a speed improvement.

+User follow-up cf01e358-34a0-481f-9e65-b8f4a266a196 showed streamed answer → extra search and plain prose at temperature 1.0. `df4435a1` moves the known broad-research follow-up prerequisite before model generation, suppresses prose during forced tool selection, and explicitly retains readable layout instructions in recovery synthesis. Runtime/routing/rendering tests: 1,265 passed. Replay `reports/clean-v3-search-quality-2026-09-17T22-46-41-660Z.json` uses actual temperature 1.0: Sweden and casual Japan each execute two searches before any streamed answer, end with one visible answer, and render emphasis and links. Sweden: 33.1s, 322 chunks, bold title plus italic topic labels; Japan: 46.0s, 590 chunks, ten bold spans. Not an overall research-quality pass: Sweden misses major national-news breadth and Japan includes an internally inconsistent country comparison. Continue factual-grounding/relevance audit independently from presentation validation.
+
 1. Finish and manually audit all 16 conversations; inspect claim/source alignment, request completion, follow-up referents, and latency.
 2. Distinguish provider emptiness from model query drift and unsupported synthesis. Do not label every weak answer a routing defect.
 3. Preserve explicit user source constraints even when model queries omit them; do not infer official provenance from URL appearance.