Files
portainer-core/services
jpmschweitzerandClaude 96492cb1ed test(ai): add DNS lookup test to quality suite
Add Scenario 6 to validate OpenAPI tool discovery and infrastructure integration.

Changes:
- Add test_scenario6_dns_lookup test
  - Tests DNS lookup via core-api discovered tool
  - Verifies OpenAPI discovery mechanism works
  - Query: "What are the A records for github.com?"
  - Performance target: < 15s
- Update test scenario list in run_full_quality_check()
- Document new scenario in QUALITY_TESTS.md

Purpose:
Validates that core-ai can discover and use infrastructure tools
from core-api via OpenAPI spec. DNS tool serves as example of
dynamic tool integration without manual registration.

Tool Discovery Chain:
1. core-api exposes /tools/dns/lookup endpoint (dnspython)
2. core-api publishes endpoint in /openapi.json
3. core-ai discovers tool via OpenAPI discovery
4. Agent can use tool as core-api__dns_lookup_tools_dns_lookup_post

Note: Agent currently prefers web_search for DNS queries, but
explicit instruction to use the DNS tool works. Tool naming
optimization can be addressed in future improvements.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-12-02 18:48:24 +01:00
..