Circuit Breaker Labs 透過模擬用戶測試人工智能安全性

circuit breaker labs, founded by siblings shirali and arul nigam, creates ai agents to test models for psychologically harmful interactions. these agents simulate users of different ages, backgrounds, languages, and cultures to uncover model weaknesses. the startup works with human domain experts to build realistic user simulations for red-team tests. circuit breaker labs currently operates as an ai safety testing lab for high-risk ai applications, such as mental health support apps. their testing platform could be applied to any app where users may develop a parasocial relationship with a chatbot.