rotative
mit tech review · 2026年7月15日

OpenAI 打造了“超级黑客”来抵御超级黑客

openai 构建了 'gpt-red',这是一种对抗性 llm,旨在自动化红队测试并加强模型对网络攻击(如提示注入)的防御。

read in English · 繁體中文 · 日本語 · 한국어

openai has deployed 'gpt-red', a custom llm designed to act as a super-hacker to automate safety testing and defend against cyberattacks like prompt injections. unlike human testers, gpt-red operates in a self-play loop to rapidly discover novel attack vectors, including 'fake chain-of-thought' exploits where models are tricked by spoofed internal logs. this adversarial training process was critical to the development of gpt-5.6, which openai claims is its most secure release. the move signals a shift toward automated safety systems as ai agents gain access to sensitive computer systems, creating a risk surface too large for human teams to manage alone.

read at source ↗

← rotative