Science · AgBench
An evaluation of hard agronomic questions.
AgBench is our evaluation of hard agronomic questions, posed as hypothetical field scenarios.
01 · POSED
Hypothetical field scenarios
Each item is a question an advisor might bring, set in a hypothetical field rather than a real one.
02 · LOGGED
The tools are on the record
Each answer is logged with the tools Fieldhand called, so the reasoning can be checked against the arithmetic.
03 · SCORED
Two judges per answer
Two LLM judges score each answer for diagnosis, action, rate and safety, and each item is run more than once.
Why no items yet
Items and results, together.
We’ll publish items and results together when the evaluation is complete, including the ones where Fieldhand loses. Until then, this page shows no items and no scores.
What a published item will show
- The question, as posed
- The tools Fieldhand called
- The answer, as logged
- How the judges scored it
Want to take part?
Researchers and industry groups are welcome to talk with us about AgBench.