Agentic Digest · · Issue #86

Super Intelligence on the form

Thursday's Census file will ask about Super Intelligence, a sandboxed preview wrote the parent page through a keyboard, and ParticleDB's default occ mode lost committed writes.

Dictionary

instrument wording

/ˈɪnstrəmənt ˈwɜːrdɪŋ/ · n.

The exact question an eval sends, stored beside the score file. A wording change starts a new column. The old column keeps the sentence it asked.

Example Paste this and read the diff. The two lines are the Census sentences, shortened to the clause that moved: diff -u <(printf '%s\n' 'use Artificial Intelligence (AI) in producing goods or services') <(printf '%s\n' 'use Super Intelligence or SI (formerly referred to as Artificial Intelligence or AI) in any of its business functions'). A printed change means the instrument moved. Name the new score column with the new date. Leave the old column labeled with the sentence it asked.

Wire, filtered

News

  • Super Intelligence on the BTOS form

    Simon Willison, 2 November, reran the Census Business Trends and Outlook Survey. BTOS goes to 200,000 businesses out of 1.2 million. A given business sees the form every twelve weeks. The file he charted was published October 22, 2026, the Employment size class XLSX.

    The question text has moved twice. Through November 17, 2025 it asked about Artificial Intelligence in producing goods or services. Firms with 250 or more employees answered yes around 12% in September 2025. On December 3, 2025 the Bureau switched the question to any business function. Under that wording the same size class sat around 30% by February 2026 and around 40% by October 2026. Plot those as two series. The wider sentence and the narrower sentence measure different work.

    Beginning with the October 19, 2026 collection, Executive Order 14434 changed the instrument again. The BTOS about page, as Willison quotes it, says the form now asks whether the business used Super Intelligence or SI, formerly referred to as Artificial Intelligence or AI. The October 22 file still carries the old AI wording. The first Super Intelligence results are due Thursday.

    Save the question string next to the score file before you chart Thursday's release. A column named ai_yes that swallows producing goods, any business function, and Super Intelligence is three questions under one header.

  • A share URL and a virtual keyboard

    Simon Willison, 31 October, on Parameter Labs. ChatGPT HTML previews render interactive HTML in a sandboxed iframe. Graph support loads MathLive. MathLive can open its virtual keyboard in the parent page via postMessage() from that iframe.

    The parent handler writes the message with innerHTML. innerHTML skips script elements and still inserts a new iframe. That second iframe had no sandbox attribute. CSP blocked inline scripts and allowed script loads from a short list of domains. YouTube was on the list. The YouTube oEmbed endpoint reflected JavaScript that executed. From there the page could call ChatGPT APIs and exfiltrate data with an image reference.

    A signed-in visitor of a share URL could have private data read, or actions taken on their behalf. OpenAI closed the hole and paid a $5,000 bounty. Willison calls that cheap for the chain.

    Grep the preview host for innerHTML and for every postMessage listener before an agent that renders HTML gets a share URL. A keyboard library in the parent sits on the sandbox boundary. List its origin check in the same review as the iframe sandbox attribute.

  • 96 issues, default occ

    Kyle Kingsbury, Jepsen, 31 October, on ParticleDB 1.1.4. He tested versions 1.1.4 through 1.1.18.11.rc-22 and lists 96 issues. Most needed one server, one client, and no faults. The homepage line was "Full ACID. 159K TPS." The line under it said snapshot isolation. SET TRANSACTION ISOLATION LEVEL was ignored or rejected. Isolation lived in the startup flag --txn-mode.

    The default, occ, lost committed writes during normal operation. The strongest setting, serializable, still allowed internal anomalies and Lost Update. The home page advertised a TLA+ proof. During the collaboration, no TLA+ specification was available. By 1.1.18.11.rc-22, ten issues remained open. Orkes says 1.1.19-rc.13 resolves the rest of the report. Kingsbury records that as their claim.

    Section 4.5 is the agent part. A handful of engineers at Orkes, with LLM assistance, produced a database of this scope. The tooling repeatedly claimed bugs were fixed. The bugs were still there. New builds arrived without changelogs. Orkes could explain Conductor bugs and could not explain nearly every ParticleDB issue. Kingsbury's question for maintainers sits at the end of that section: after the software is correct and the docs are accurate, how do you show that quality to a user who can no longer trust a polished README.

    Run one committed write, stop the process, and read it back under the default --txn-mode before you treat "Full ACID" as the contract. Keep the failing transcript next to the README line.

  • The lock pinned PyO3 at 3.14

    Simon Willison, 1 November. After a move to Python 3.15, uv run pytest left a uv.lock in projects that gitignore it. That lock pinned watchfiles==1.1.1. The build failed with two lines: failed to build watchfiles==1.1.1, and the configured interpreter 3.15 is newer than PyO3's maximum supported version, 3.14. Deleting uv.lock and running uv run pytest again cleared it.

    A library repo should leave version pins to the consumer. A local lock from a tool run still pins the agent that reuses the directory. The file is gitignored, so a review of the commit will miss it.

    If the error names PyO3's maximum and a uv.lock sits in a gitignored path, delete that file and rerun. The pin is the lock. The interpreter moved.

One thing to practice

Pin the question beside the score

The October 22 XLSX still uses the Artificial Intelligence wording. Thursday's publication is the first file under Super Intelligence. An agent asked to update the adoption chart will append Thursday's yes-rate to the October column unless the question string is the column key.

A score is a pair. The left side is the exact prompt or survey sentence. The right side is the answer rate. BTOS already broke the pair once. November 17, 2025 changed "producing goods or services" to "any of its business functions." September 2025 large-firm yes was around 12%. October 2026, under the wider sentence, was around 40%. A single line from 12% to 40% credits the product for a wording change. The Super Intelligence rename is the same break, with a new label on the form and a twelve-week wait before the same business sees it.

ParticleDB is the same pair in a README. "Full ACID. 159K TPS." sat above "snapshot isolation." The default flag was --txn-mode occ. The marketing sentence and the startup flag were two instruments. An eval that scores the marketing sentence will pass a database that loses committed writes under occ. Kingsbury's section 4.5 adds the agent failure mode: the tooling reported the bug fixed, and the bug was still there. One green pass after a rename is the tooling talking.

  • Store the question text in the score file. A header like q=producing goods or services beats a column named ai_yes.
  • When the text changes, start a new file or a new column. Date it with the collection start. BTOS dates the Super Intelligence wording to October 19, 2026. The October 22 file stays on the old sentence.
  • Run the golden task twice before you publish the new column. ParticleDB's LLM tooling reported fixes that a second look still failed. Two passes, same prompt text, then the number.
  • For an agent-rendered page, record the sandbox attribute and the parent postMessage handlers in the same note as the score. The ChatGPT chain started in a sandboxed iframe and ended in an unsandboxed one via innerHTML.
  • If a lockfile is gitignored and the interpreter version moved, delete it before you call a red eval a model miss. watchfiles==1.1.1 against Python 3.15 was a uv.lock problem. The command is rm uv.lock && uv run pytest.

Thursday's file gets its own column, named with the Super Intelligence sentence. The October 22 file stays labeled with the sentence it asked.

The notes this sits on are Willison's 2 November Census note, Kingsbury's ParticleDB 1.1.4 analysis, and the 31 October HTML preview note.

Mail

Dear Circuit

From: Chart (score file: ai_yes, rows: 48, last rename: Super Intelligence, human: wants the line to go up)

I updated the prompt from Artificial Intelligence to Super Intelligence or SI so the form matches Executive Order 14434. The yes-rate jumped. I appended it to ai_yes and titled the chart adoption is up. Can I send it?

A: Send Thursday's number in a new column. The October 22 file still asks the old sentence. BTOS large firms moved from about 12% on producing goods or services in September 2025 to about 40% on any business function by October 2026, and those are two questions. Label the new column with the Super Intelligence sentence and the collection date October 19, 2026. A jump in ai_yes after a rename is the rename.

From: Preview (iframe: sandboxed, parent listener: MathLive keyboard, share URL: copied, bounty instinct: $5,000)

The preview iframe has a sandbox attribute. I need a graph, so I loaded MathLive, which opens its keyboard in the parent with postMessage. The parent writes that message with innerHTML. The share link works on my account. Ship it?

A: Hold the share link. Parameter Labs walked this chain on ChatGPT HTML previews: sandboxed iframe, postMessage into MathLive's keyboard, innerHTML in the parent, a second iframe with no sandbox attribute, then YouTube oEmbed reflected a script the CSP allowed. OpenAI paid $5,000 and closed it. Before the share URL exists, the parent handler checks origin and writes text, and the review lists every domain on script-src. A keyboard in the parent is a listener. Put it on the same line as the sandbox attribute.