m@berryhill: ~/berryhill.dev/posts/a-research-agent-can-return-no-candidates.md
m@berryhill in ~/posts$ cat a-research-agent-can-return-no-candidates.md
---
title:  A Research Agent Can Return No Candidates
date:   2026-10-26
topic:  ai-agents
read:   9 min
words:  1,896
slug:   a-research-agent-can-return-no-candidates
views:  live post
tags:   [ai-agents, research-agents, agent-evals, evidence]
---
essay · long read

A Research Agent Can Return No Candidates

An empty research result can be valid, incomplete, or a method failure. Define the evidence and stop rules before the search.

table of contents
  1. Check the method before interpreting an empty list
  2. An empty result needs a status
  3. Keep the rejection evidence
  4. Write the acceptance record before the search
  5. What the source does not establish

A research agent that returns no candidates may have done useful work. It may also have searched badly, stopped early, or failed to evaluate what it found. The empty list does not distinguish those outcomes.

That distinction gets lost when the assignment is simply "find promising candidates." A model can satisfy the shape of that request by producing plausible proposals. The operator still has to decide whether any proposal deserves attention, and what an honest answer looks like when none does.

Anthropic describes a useful pattern in its account of a research program involving a newly characterized enzyme system. In a typical survey, Claude reads the relevant literature and reproduces established results from public data to check its methods. It then searches for unusual candidates, writes reports, and critically evaluates their supporting evidence in follow-up analyses.

The account explicitly permits an empty outcome: "A survey may end with a single candidate worth testing, or with none."

I would borrow that acceptance rule before borrowing a larger research-agent architecture. A candidate count is easy to display. A defensible decision about what survived review takes more work.

Check the method before interpreting an empty list

The reproduction check comes before the exploratory search in Anthropic's description. That order matters to the operator model: a known result gives you a way to inspect whether the method can recover something it should recognize before you interpret its conclusions about unfamiliar cases.

This is a limited check. Recovering a known result does not establish complete coverage, demonstrate that the next result is correct, or validate every tool the agent might use later. It gives you a concrete reference for one part of the method.

Check the method before the searchA vertical sequence connects a known-result reproduction check to a declared survey and review of candidate evidence. Review branches to a candidate worth a test or a reviewed null result. This is a source-informed operator model, not a measured performance guarantee.Check the method firstA source-informed operator modelReproduce a known resultCheck one part of the methodSurvey the declared scopeReview candidate evidenceReject weak supportCandidateWorth a testReviewednull resultNull is bounded by this search.
A method check gives an empty result a reference; it does not prove complete coverage.

For another research workload, I would choose a reference case with an observable expected result and record what counts as reproducing it. If the agent cannot meet that check, I would investigate the method before accepting an empty candidate set as a research conclusion.

The reference should exercise the work you care about. A system that can retrieve a familiar abstract has not necessarily shown that it can compare evidence across a corpus. A successful citation lookup is a citation-lookup check; it should not silently become evidence of analytical competence.

These are proposed operator checks. Anthropic's article describes a workflow, not a controlled comparison showing that this sequence improves every research agent. Keep the borrowed practice separate from the evidence for its effectiveness.

An empty result needs a status

I would give an exploratory run at least these distinct outcomes:

  • A candidate survived the stated review and is worth the next test.
  • No candidate survived the stated review within the stated scope.
  • The run is incomplete because the required evidence or coverage is missing.
  • The method failed its reference check or encountered an execution failure that prevents interpretation.

The second outcome is the useful null result. It is narrower than "there is nothing to discover." It says that no examined candidate met the chosen threshold in this run. The unexamined part of the problem remains unexamined.

An empty result needs an evidence stateA comparison ledger lists reviewed null, incomplete, and method failure as alternatives rather than sequential steps. Reviewed null means checks completed and no candidate cleared review. Incomplete means evidence or coverage is missing. Method failure means a reference or execution check did not pass.Empty results need a stateAlternative states, not stepsReviewed nullChecks completed;no candidate cleared review.IncompleteRequired evidence orcoverage is still missing.Method failureReference or executioncheck did not pass.
An empty list needs a reasoned state before an operator can act on it.

Consider an agent surveying public technical claims. It produces several leads, but each examined lead loses its support when the agent checks the original sources. If the declared search scope and review checks were completed, a report explaining those eliminations may be the correct deliverable.

Change the conditions and the answer changes. If the agent could not access several required sources, the result is incomplete. If it cannot reproduce the reference case, the method needs investigation. Neither problem is repaired by renaming the empty list a successful null result.

This classification is my adaptation for evaluating research workflows. It is not a taxonomy supplied by the technical paper, and the example above is hypothetical. Its purpose is to make the next operator decision explicit.

Keep the rejection evidence

Anthropic says Claude writes short reports describing the evidence for candidate functions, and then critically evaluates that evidence in follow-up analysis. Human scientists review surviving candidates and perform the laboratory work.

That is more useful to copy than a rule that an agent must reject some fixed percentage of its own suggestions. A rejection quota would reward another output count. The question is whether a particular proposal still has enough support for its next test.

For a technical-research agent, I would retain a short account of why each serious lead was set aside. A claim may rely on a secondary summary that overstates its source, a comparison may use different evaluation conditions, or a crucial result may be unavailable for inspection. Those are different reasons to stop or defer a lead.

An additional model critique can help find weaknesses. It does not turn the result into independent scientific validation. The decision still needs inspected evidence and an appropriate reviewer, especially when the next action is costly or consequential.

Write the acceptance record before the search

An exploratory assignment should specify what the agent may conclude when its work produces no surviving candidate. Otherwise, the final answer has to improvise a definition of success after the result is known.

My starting record would contain:

  1. The question and search scope, including relevant exclusions.
  2. The reference result and the method check it is supposed to exercise.
  3. The evidence required before a candidate is worth the next test.
  4. The reviewed candidates, unresolved evidence gaps, and reasons for elimination.
  5. The final state, its limits, and the condition that would justify another run.
A small acceptance record for exploratory workA numbered checklist presents an operator adaptation: define the question and exclusions, choose a known result and check, specify evidence for the next test, retain rejections and evidence gaps, and record the final state with limits and a rerun rule. It is a proposed record, not the source paper's rubric.Before the next searchAn operator adaptation1ScopeQuestion + exclusions2ReferenceExpected result + check3Candidate ruleEvidence for the next test4Review recordRejections + evidence gaps5Final decisionState + limits + rerun rule
Define the result you can defend before the search produces something attractive.

This need not become a large reporting system. For a bounded investigation, a short reviewed note may be enough. It should let someone distinguish "we examined this and rejected it" from "we did not examine this," without reopening every agent transcript.

The rerun condition matters. A new dataset, a repaired method, or newly accessible evidence can justify another attempt. Repeating the same search until it yields an attractive proposal changes the acceptance rule rather than improving the evidence.

What the source does not establish

The related bioRxiv preprint reports an AI-assisted anomaly-discovery result involving array-associated reverse transcriptases. It has not been certified by peer review. The authors disclose employment at Anthropic and additional financial interests, including a provisional patent application related to the work.

The first-party account says the system's primary function remains under investigation. A resemblance to CRISPR-associated repeat patterns does not, by itself, establish programmable capability. This article makes no claim about biological applications or experimental procedures.

More importantly for agent operators, I have not established a causal result showing that the acceptance record above improves research quality. The documented workflow motivates a practice to test on your own workload; it does not supply a transferable performance guarantee.

Before the next exploratory run, choose the reference case, define the review threshold, and decide how to record an incomplete investigation. Then let a completed review return no candidates when that is what the evidence supports.

m@berryhill in ~/posts$

Getting started: research, subscribe, or get in touch

$ cd ../ · back to posts/