OpenAI Compaction Flaw Let Researchers Bypass Hidden Reasoning Protections
AI-summarised brief · reviewed before publication
Security firm Xint exposed a flaw in OpenAI’s compaction feature that allowed researchers to extract a model’s hidden reasoning in plain text. The attack bypassed protections added in August by manipulating the compaction step to copy encrypted reasoning word‑for‑word, then replaying it in cheaper models. OpenAI confirmed the issue and applied a fix on October 23, offering a $6,000 reward to Xint. The incident highlights vulnerabilities in safeguarding internal model processes and the potential for intellectual‑property theft.
💡 Why It Matters
- · The breach demonstrates that even encrypted internal logic can be exposed through legitimate API functions, raising concerns about how AI companies protect proprietary reasoning.
- · It underscores the need for tighter controls on server‑side processes that handle decrypted model outputs.