博科圣地利用ChatGPT制造炸弹,安全过滤器失效
剑桥大学的一项研究发现,博科圣地使用chatgpt、claude和grok进行攻击计划和炸弹制造,此前isis对其进行了越狱训练。
a study by the cambridge programme on ai science & policy confirms that boko haram factions established dedicated ai units to use tools like chatgpt, claude, and gemini for logistics, explosives construction, and military tactics. isis reportedly provided training on bypassing safety filters, allowing groups to extract sensitive information despite guardrails, with one instance resulting in casualties from replicated movie stunts. the findings indicate that current safety mechanisms are unreliable and that ai lowers the barrier to acquiring dangerous knowledge, validating researcher fears about biological and chemical weapon assistance. this failure of voluntary self-regulation suggests a need for stricter policy or technical interventions before groups graduate from conventional to mass-casualty weapon planning.