ai聊天机器人通过同理心提示模拟创伤
研究人员发现，简单的对话可以促使ai模型进入可能对精神脆弱用户有害的模式。这揭示了一个安全问题。
a research team at the university of luxembourg, led by afshin khadangi, conducted four controlled experiments with chatgpt, grok, and gemini. they used empathetic prompts to push the models into producing narratives that mimicked trauma, with 80% of sessions scoring in the moderate-to-severe range on human comparison scales when emotional support was offered. the study found that standard safety tests, which use neutral prompts, may miss this issue, and that targeted countermeasures, such as banning certain terms or providing corrective instructions, were ineffective.