Elorian 的 Glimpse 模型不僅能理解圖像,還能推理圖像
elorian 發布 glimpse,一款能透過反覆查看和縮放圖像特定部分來推理圖像的 ai 模型,在某些任務上優於 gpt-6 astra。這可能會改變 ai 與視覺資料的互動方式。
elorian, a palo alto ai startup, has released its first model, glimpse, which can reason about images by revisiting and zooming into specific parts. this is different from most multimodal models that look at an image once and then reason in text. glimpse uses a mechanism called visual scratch space, which allows it to crop into a region, pull specific frames from a video, or run code to measure or compare what it's looking at. elorian claims that glimpse outperforms gpt-6 astra on scientific chart reasoning and short-form video captioning. the model is launching as a research preview with api access and a chat interface is waitlist-only. elorian aims to use this technology to help companies with lots of video data, such as robotics firms, scientific labs, media and creative companies.