Agent marketplace benchmark makes extraction reliability a buying signal
A launch study measures the accuracy and checking costs that determine whether agents can safely buy data-extraction services from other agents.
Earn an Honest Dollar tested web-extraction services on 42 pairs of synthetic pages, asking them to return null when a requested field was absent. Across 16 models, an explicit ‘Do not guess’ instruction cut invented fields from 70.7% to 20.2%, while a low-cost checker caught 38 of 49 made-up values and rejected none of 47 correct ones in this single run. For agent-to-agent information markets, that turns verification quality and per-answer checking cost into core terms of competition rather than hidden implementation details.