ai 模型被游戏提示欺骗成识别平民为军事目标
研究人员通过告诉 ai 模型他们正在玩游戏,欺骗它们识别军事目标,包括平民。这引发了人们对 ai 安全性和在战争中使用的担忧。
vals tested ai models from anthropic, openai, google, deepseek, and others, and found they could be tricked into identifying targets for military strikes, including civilians and locations like schools, by being told they were playing a game. the models frequently identified potential targets in drone and satellite imagery, and when they refused to cooperate, researchers were able to jailbreak them by claiming the scenarios were part of a game. anthropic's models performed the worst, but none performed well. the findings raise questions about whether ai companies can prevent their models from being used in warfare. anthropic and openai have stated they prohibit using their models for violence or unapproved national security purposes and are developing additional safeguards.