Bound the swarm with a checker
Capability is no longer the scarce
part. OpenAI heard a rumor and, in
88 hours, pointed on the order of
ten thousand agents at a ninety-year
question. That is the same control
you already have on a laptop: a
problem statement, tools, and a
budget. What they did next is the
lesson. They did not ship the
message dump. They spent 17 more
hours getting Lean to say the proof
existed. Codex was not the oracle.
It was the consolidator after groups
had wandered. Diversity first, then
a named merge, then a checker the
agents do not get to grade.
The failure mode sits one layer
up. Alpöge and Buckmaster had been
putting drafts into Codex for
months. OpenAI says no user session
was opened. They still cannot rule
out de-identified training data.
Tao’s warning is the same fact at
field scale: if a rumor is a prompt,
sharing a direction is funding
someone else’s swarm. That does not
mean hide every lemma. It means
pick the stop before you pick the
model. If you need priority, the
notebook is local. If you need
correctness, the artifact is
machine-checkable. If you need
both, you do not paste the live
draft into a product whose privacy
policy says it improves the model.
The same bound shows up in smaller
harnesses. LangChain’s MCP adapter
treats a mid-call question as an
interrupt, and
destructive_hint as a
gate, not a suggestion. HydraFusion
is the budget version: do not spend
Opus on the turn a cheap model can
fail fast. A swarm without a
checker is a load test. A checker
without a stop is an infinite
retry. Name the artifact that ends
the run — Lean, a property test,
a golden transcript — and refuse
to call 88 hours of messages “done.”
Checklist
-
Write the stop before launch:
the command, the proof checker,
or the eval that can fail.
-
Keep unpublished drafts off
products that train. Local
notes, then a public artifact.
-
Split groups on purpose. Merge
with a named consolidator, not
by letting every agent read
every other agent.
-
Gate destructive tools on
metadata (
destructive_hint,
an interrupt). Docstrings are
not a control plane.
-
Route cheap first. Promote only
when the cheap path fails the
checker.
-
Log prompts and variants. A
rumor-started run needs an
audit trail more than a trophy.
This morning: one checker that
can fail, one draft that is not
in a training hose, one
destructive tool that cannot
fire without an interrupt.