EfficientSync: Real-Time Lip Synchronization via Deformation-Based Reference Texture Mixing
Rather than reconstructing the mouth from scratch, we treat each reference as a track on a mixing console and adjust its volume, that is, its aggregation score, according to the driving audio and the source identity.
