AnthropicがClaudeの思考をマッピング:100万の特徴を発見
AnthropicはClaude 3 Sonnetから100万の内部特徴を解読し、概念がどのように形成されるかをマッピングした。これによりAIの透明性が前進し、安全性エンジニアがモデルの挙動を根源から制御できる可能性が開ける。
anthropic released findings mapping approximately 1 million internal features—or concepts—within its claude 3 sonnet model, visualizing how specific combinations of artificial neurons fire for distinct ideas like fairness or biological structures. the research allows engineers to identify and deactivate unsafe traits, such as bias or manipulation, by targeting these specific features rather than filtering outputs post-generation. while this represents a significant step toward mechanistic interpretability, it remains an open question whether this specific mapping applies to other models or architectures. successful mechanistic interpretability is increasingly viewed as a critical safety requirement for future autonomous systems to prevent unforeseen behaviors.