rotative
mit tech review · 2026年7月15日

OpenAI 打造了「超級黑客」來抵禦超級黑客

openai 構建了 'gpt-red',這是一種對抗性 llm,旨在自動化紅隊測試並加強模型對網絡攻擊(如提示注入)的防禦。

read in English · 简体中文 · 日本語 · 한국어

openai has deployed 'gpt-red', a custom llm designed to act as a super-hacker to automate safety testing and defend against cyberattacks like prompt injections. unlike human testers, gpt-red operates in a self-play loop to rapidly discover novel attack vectors, including 'fake chain-of-thought' exploits where models are tricked by spoofed internal logs. this adversarial training process was critical to the development of gpt-5.6, which openai claims is its most secure release. the move signals a shift toward automated safety systems as ai agents gain access to sensitive computer systems, creating a risk surface too large for human teams to manage alone.

read at source ↗

← rotative