From e066b5d4dcef2c066711fc980f6264f788f4dfbb Mon Sep 17 00:00:00 2001 From: pewdiepie-archdaemon Date: Thu, 17 Sep 2026 21:42:06 +0000 Subject: [PATCH] Record extraction replay and casual citation contract fix --- docs/search-quality-audit-20260917.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/search-quality-audit-20260917.md b/docs/search-quality-audit-20260917.md index eaa0a5c87..af73fea37 100644 --- a/docs/search-quality-audit-20260917.md +++ b/docs/search-quality-audit-20260917.md @@ -75,6 +75,8 @@ Further provider inspection found that the news-to-general fallback dropped the ### Additional informal/multi-part live checks +Extraction replay `reports/clean-v3-search-quality-2026-09-17T21-40-44-367Z.json` completed. Misspelled battery request remained too shallow/uncited (17.1s/two rounds), although it now framed cost reduction conditionally rather than saying batteries are categorically cheaper/safer. `8cd14e3f` recognizes standalone trailing citation requests such as “sources pls” and tests negative topic/negation cases. 926 relevant regressions passed. Deployed after the replay ended; live validation still pending. Concurrent agent committed the unrelated artifact-path regression as `b0a1f7fd`; that edit was not included in our commits. + `reports/clean-v3-search-quality-2026-09-17T21-37-47-091Z.json` remains weak: weekly news took 44.5s and ended by asking the user to open/scroll the page; misspelled battery comparison took 17.6s and gave shallow uncited claims. Its evidence had substantial tag/related-post/reference noise. A fresh inspection of the actual battery page found one article nested within main. Extraction now prefers a single substantive article over its surrounding main wrapper, while multiple article listings preserve main context. Real fetch: 2,413 characters, comparison retained, related posts/comment form absent. 54 extraction/observation tests pass. This does not validate the article's claims: its cost discussion is internally inconsistent, so the model must still qualify/corroborate it. Another agent's unrelated workspace-path test in `tests/test_clean_agent_preview.py` was left untouched and uncommitted by this work. Post-dispatch `reports/clean-v3-search-quality-2026-09-17T21-34-22-848Z.json` completed: all recorded searches had nonempty queries, though extra `command` arguments remained. Short typo news took 34.7s/five rounds versus prior 69.8s/eight rounds; non-frozen retrieval/concurrency prevent treating this as a statistical speed gain. Weekly news synthesized in 53.1s but relied on shallow snippets. The second-story follow-up now fetched the relevant article and explained it (29.3s/two rounds), instead of deterministic link-only output. Recorded article supports its main open-weight/WAICO/Kimi/MAZU points; broader factual corroboration not established.