Synthesizing Obama: Learning Lip Sync from Audio

Synthesizing Obama: Learning Lip Sync from Audio Supasorn Suwajanakorn, Steven M. Seitz, Ira Kemelmacher-Shlizerman SIGGRAPH 2017 Given audio of President Barack Obama, we synthesize a high quality video of him speaking with accurate lip sync, composited into a target video clip. Trained on many hours of his weekly address footage, a recurrent neural network learns the mapping from raw audio features to mouth shapes. Given the mouth shape at each time instant, we synthesize high quality mouth texture, and