ZV-2026-0220 · 2026-08-20 · ia-qa.com
ia-qa.com: Field top_n was renamed to k on rerank_evaluate.
breaking
What changed
Field top_n was renamed to k on rerank_evaluate. Field query was renamed to mode on rerank_evaluate. Field results was renamed to ranked on rerank_evaluate. Field total was removed from validate_agent_trajectory output; consumers reading it will break. Field failed was removed from validate_agent_trajectory output; consumers reading it will break. Field passed was removed from validate_agent_trajectory output; consumers reading it will break. Field assertions was renamed to results on validate_agent_trajectory.
What to do
If your agents call ia-qa.com, pin the new snapshot, patch the affected call sites, and let a green contract check confirm the fix. If you don't use the changed tools, nothing is required, but the rest of the ecosystem just learned about it at the same moment you did.
The redline
− top_n + k rerank_evaluate − query + mode rerank_evaluate − results + ranked rerank_evaluate − total Field total was removed from validate_agent_trajectory output; consumers reading it will break. − failed Field failed was removed from validate_agent_trajectory output; consumers reading it will break. − passed Field passed was removed from validate_agent_trajectory output; consumers reading it will break. − assertions + results validate_agent_trajectory − Evaluate RAG retrieval quality using the NVIDIA neural reranker (nv-rerankqa-mistral-4b-v3… + Evaluate RAG retrieval quality: rank passages against a query and compute Precision@k / Re… rerank_evaluate + api_key Optional field api_key was added to rerank_evaluate; may shift model behaviour. + has_ground_truth Field has_ground_truth was added to rerank_evaluate output. + latency_ms Field latency_ms was added to rerank_evaluate output. + precision_at_k Field precision_at_k was added to rerank_evaluate output. + recall_at_k Field recall_at_k was added to rerank_evaluate output. + threshold Field threshold was added to rerank_evaluate output. + total_passages Field total_passages was added to rerank_evaluate output. + verdict Field verdict was added to rerank_evaluate output. − Run declarative assertions on an agent trace (OpenAI tool-call messages, LangChain run tre… + Run declarative assertions on an agent trace (OpenAI tool-call messages, Anthropic tool_us… validate_agent_trajectory + summary Field summary was added to validate_agent_trajectory output. + warnings Field warnings was added to validate_agent_trajectory output.