Google Deepmind's Genie 4 brings real-time audio and dialogue to interactive world models
google deepmind introduces genie 4, an interactive world model that generates matching background audio and character dialogue in real time, powered by gemini models. this affects ai research and development.
google deepmind has introduced genie 4, an interactive world model that calculates environments frame by frame in real time and, for the first time, directly generates matching background audio and character dialogue. genie 4 is powered by gemini models that plan multistep tasks and continuously adapt the simulated world to user text prompts and changing conditions. the model is still experimental and has limitations in longer sessions and complex physics, but it has potential applications in robotics and training environments. genie 4 is currently available to select testers and will later expand to google ai ultra subscribers. this development signals progress in ai research and potential advancements in hybrid world models.