Do Agent Benchmarks Do What They Say? An Executable-Contract Audit of Tool-Using Agent Environments

arXiv:2609.37315v1 Announce Type: cross Abstract: Tool-using agents are entering settings where a wrong action carries real cost, and the benchmarks certifying them grade what each simulated tool call reports having done, assuming the tool did what…

Read the full story at arXiv cs.AI ↗