The Observability Trilemma: Why Cheap AI Monitors Fail and the Geometry of Deception
Note: This post is a distilled overview of our paper submission to Apart Research’s Technical Governance Hackathon, developed as a team effort. As AI models (i.e., LLMs) are deployed in higher-stakes environments, technical governance faces a critical challenge: safety and reliability are becoming paramount issues (e.g., hallucination). However, we argue that the most dangerous concern is deceptive alignment (scheming), where the AI model intentionally deceives the downstream user by providing inaccurate or misleading information. ...