How to Know When an AI Agent Can Work Unsupervised — Evan Kormos, Coinbase

Evan Kormos, a player-coach at Coinbase with 15 years in enterprise financial services, lays out a practical way to bring agents into policy-driven, regulated workflows. He models processes as DAGs and loops, explains why a loop is only as trustworthy as its check, and shows how evals and traces become a new confidence mechanism. Agents then move through three stages: fully supervised, then sampled, then humans handling only exceptions. Chapters: - 00:00 Policy is the original system prompt - 02:53 Where agents fit: people, process, technology - 03:49 Workflows as DAGs - 05:31 Inside a node: