20余位人工智能研究人員警告自動人工智能研究存在極端風險
超過20位人工智能研究人員警告,自動人工智能研究可能導致智能爆炸,對社會和超級人工智能的控制構成極端風險。
a group of more than 20 leading ai researchers, including geoffrey hinton, yoshua bengio, and openai research lead jakub pachocki, have published a research paper warning of the potential risks of automated ai research. they suggest that ai systems could automate the entire ai r&d pipeline within years, leading to rapid progress that society might not be able to keep up with. this could result in a loss of control over superhuman ai and erosion of power balances between nations, companies, and governments. the authors are urging policymakers to gain more visibility into how ai research is being automated to mitigate these risks. this warning is part of a growing list of concerns about the potential existential risks of ai.