rotative
the decoder · 2026年5月13日

Deepmind 重構滑鼠游標為上下文變數

deepmin 推出「指標工程」,這是一種由 gemini 驅動的游標,透過捕獲視覺上下文來執行「修復此點」等指令,無需提示詞。

read in English · 简体中文 · 日本語 · 한국어

deepmin researchers adrien baranes and rob marchant proposed 'pointer engineering' to shift ai interaction from precise prompts to context-aware cursor inputs. the method treats the cursor as a variable, capturing surrounding visual data to execute commands like 'fix this' or 'move that' with minimal user effort. pixels are interpreted as structured entities, allowing a handwritten note to become a to-do list or a video frame to become a booking link. this functionality is live in gemini for chrome and will debut as 'magic pointer' on the googlebook, streamlining casual interactions without replacing prompt engineering for complex tasks.

read at source ↗

← rotative