← Engel's Code Design Notebook

OpenHands agent-sdk verification

How agents check that the OpenHands Agent SDK does what it says, one feature at a time: a map of every behavior an agent can see, a CLI that drives the real thing, and known bugs kept as expected failures until someone fixes them. Everything here is open, and anyone can rerun it.

The explainer

Two minutes on what an agent actually sees when it uses the SDK: the map, the control-agent-server CLI, a recipe that caught a bug, and the full replay. Drawn with Manim, with a generated score. Download (MP4, 10 MB) · Scene script and music

Agent Server

The first map: 34 families and 931 sub-features of the Agent Server, driven over REST, WebSocket, the Python client and the TypeScript client. Its full replay: 771 pass, 156 known bugs reproduced, 6 blocked, no surprises. It lives in software-agent-sdk PR #5621.

A map that keeps itself honest
The presentation, opening with a short animated film: a control CLI, an executable map of 930 Agent Server behaviors, and known bugs as expected failures. The full replay, and the upstream fix it caught.
presentation + film · 11 October 2026
Agent Server bug tracker
38 Agent Server bugs the map found or reproduced: severity, status and a two-sentence summary each, linked to the issues and to umbrella #5653.
tracker · 9 October 2026

Core SDK

The next map covers the SDK used in process: the agent loop, LLMs, conversations, condensers, skills, MCP, tools, workspaces and more, in 21 families (S01–S21). It is being drafted now and will be linked here when it is published.

OpenHands app

The sister project: the same approach applied to the OpenHands app (Agent Canvas), with a browser-driving CLI and real before/after screenshots.

Give agents a way to prove it
A visual presentation of OpenHands’ verification loop: 716 mapped behaviors, a control CLI, evidence rules, and maintenance. Real before/after screenshots show what the first run found and fixed, with credit to Lauren Tan’s pstack.
presentation · updated 9 October 2026
120 findings: the issues and their fixes
Issues filed by OpenHands feature-map verification runs, grouped by repository and theme, with the checked status of their fixing pull requests.
findings snapshot
control-openhands: agents using Agent Canvas like a user
The CLI behind the verify-openhands skill: isolated stacks, a browser that persists across commands, and an evidence ledger.
how it works · 5 October 2026

OpenHands features

The feature map, for humans: 743 behaviors in 27 families, with readable CLI scripts and real screenshots. Source snapshot: 9 October 2026.

Starting work

Conversation & workspace

Settings & configuration

Customization

Automations

Backends & runtimes