iCreatAI News
Skip to content
Hacker News AI· javiercr·· 18 days agoFeaturedAI score80

Meta's Muse Realtime Avatar turns any image into a talking AI character

Meta's Muse Realtime Avatar turns any image into a talking AI character

AI summary

Meta introduced Muse Realtime Avatar, an audio-driven Diffusion Transformer that turns reference images into expressive, interactive avatars with synchronized facial, hand, and full-body movement during live conversation. It shares Muse Realtime Voice's speech-token stream for synchronization, uses distillation to cut inference from 120 to 2 neural function evaluations per chunk (a 60x reduction), and streams 448x768 portrait video at 25 fps with roughly 870 ms latency. Meta says raters preferred it over Runway Characters and HeyGen LiveAvatar overall and across every evaluated dimension, and it embeds Meta Video Seal watermarks without added latency.

Why it matters

It offers a detailed look at how Meta achieves real-time, low-latency avatar video generation and serving at scale, including its distillation and infrastructure techniques.

Source: Hacker News AI · research.meta.ai