Anthropic nears RSI capability, warns of self-building AI risks
anthropic warns it's close to creating a model capable of recursive self-improvement, posing safety risks and potential acceleration of ai capabilities. this affects ai safety and control.
anthropic's updated financials in its revised s-1a filing include a warning that the company is close to creating a model capable of recursive self-improvement (rsi). rsi is the point at which ai grows so good at training itself that it spawns a dramatic acceleration of ai capabilities. anthropic uses ai in its r&d but cautions that this could pose a considerable safety risk. the company has already used ai to develop new models whose leaps in capability it didn't recognize at the time and may soon meet its own internal definition of rsi. anthropic promises to keep humans in the r&d process for the foreseeable future.