DeepMind, 마우스 커서를 컨텍스트 변수로 재해석
DeepMind가 시각적 컨텍스트를 파악해 프롬프트 없이 '이것 수정' 같은 명령을 실행하는 Gemini 기반 커서, 이른바 '포인터 엔지니어링(pointer engineering)'을 소개했습니다.
deepmin researchers adrien baranes and rob marchant proposed 'pointer engineering' to shift ai interaction from precise prompts to context-aware cursor inputs. the method treats the cursor as a variable, capturing surrounding visual data to execute commands like 'fix this' or 'move that' with minimal user effort. pixels are interpreted as structured entities, allowing a handwritten note to become a to-do list or a video frame to become a booking link. this functionality is live in gemini for chrome and will debut as 'magic pointer' on the googlebook, streamlining casual interactions without replacing prompt engineering for complex tasks.