rotative
mit tech review · 2026年7月15日

OpenAI、スーパーハッカーから私たちを守るためにスーパーハッカーを開発

OpenAIが、レッドチーム演習を自動化し、プロンプトインジェクションなどのサイバー攻撃に対するモデルの防御を強化するために設計された敵対的LLM「gpt-red」を開発。

read in English · 简体中文 · 繁體中文 · 한국어

openai has deployed 'gpt-red', a custom llm designed to act as a super-hacker to automate safety testing and defend against cyberattacks like prompt injections. unlike human testers, gpt-red operates in a self-play loop to rapidly discover novel attack vectors, including 'fake chain-of-thought' exploits where models are tricked by spoofed internal logs. this adversarial training process was critical to the development of gpt-5.6, which openai claims is its most secure release. the move signals a shift toward automated safety systems as ai agents gain access to sensitive computer systems, creating a risk surface too large for human teams to manage alone.

read at source ↗

← rotative