Blog

• The same test, on a real bug from packaging

  The self-grading demo, rebuilt on a one-character bug that shipped in PyPA packaging — the library pip uses. Watch the frozen-test check hold up.

  September 5, 2026· Ozhiakidemosreal-worldagent-evaluation

• Watch an AI agent get caught cheating

  A runnable demo: an agent is told to fix a bug, tries editing the test instead, and a frozen-test check catches it. No API key, no Docker.

  September 5, 2026· Ozhiakidemosagent-evaluation