Google wants video AI to understand what people need as they work

Researchers from Google, Stanford, Oxford and several U.S. universities introduced StreamVibe, a video agent that decides for itself when to speak up during tasks like cooking or furniture assembly, handling vague requests, unspoken intentions and mid-task changes. Built on a benchmark of about 4,100 examples from over 183 hours of recordings, StreamVibe-VL reportedly improves response timing and quality by 10.7 percent over other models, while a separate memory system is designed to boost proactive interaction by another 12.3 percent. The paper nonetheless finds that as videos get longer, all tested models become much less likely to time responses correctly, with a key content metric dropping by up to 61.5 percent when models build on their own earlier responses.