US Patent Issued to Snap on Sept. 15 for "Generating lip sync augmented reality effects" (California, New York, Washington Inventors)

ALEXANDRIA, Va., Sept. 15 -- United States Patent no. 12,737,997, issued on Sept. 15, was assigned to Snap Inc. (Santa Monica, Calif.).

"Generating lip sync augmented reality effects" was invented by Leonid Gorkin (Chappaqua, N.Y.), Matthew Mahar (San Francisco), Hanbo Chen (Kirkland, Wash.) and Dmytro Barbaruk (Los Angeles).

According to the abstract* released by the U.S. Patent & Trademark Office: "An audio track with vocals is played back using a device with a display screen that displays a video feed from a camera. A location of a mouth depicted in the video feed is detected. A timestamp of playback of the audio track is compared to viseme-timestamp data for the audio track to identify a viseme corresponding to the timestamp of the au...