rotative
mit tech review · 2026年7月14日

Anthropic 绘制 Claude 思维图谱:发现 100 万特征

anthropic 通过解析 claude 3 sonnet 中的 100 万个内部特征,绘制了概念形成图谱。这推动了 ai 透明度,可能使安全工程师能够从源头上控制模型行为。

read in English · 繁體中文 · 日本語 · 한국어

anthropic released findings mapping approximately 1 million internal features—or concepts—within its claude 3 sonnet model, visualizing how specific combinations of artificial neurons fire for distinct ideas like fairness or biological structures. the research allows engineers to identify and deactivate unsafe traits, such as bias or manipulation, by targeting these specific features rather than filtering outputs post-generation. while this represents a significant step toward mechanistic interpretability, it remains an open question whether this specific mapping applies to other models or architectures. successful mechanistic interpretability is increasingly viewed as a critical safety requirement for future autonomous systems to prevent unforeseen behaviors.

read at source ↗

← rotative