ALEXANDRIA, Va., Nov. 3 -- United States Patent no. 12,783,853, issued on Nov. 3, was assigned to GOOGLE LLC (Mountain View, Calif.).
"Contrastive learning and masked modeling for end-to-end self-supervised pre-training" was invented by Yu Zhang (Mountain View, Calif.), Yu-An Chung (Mountain View, Calif.), Wei Han (Mountain View, Calif.), Chung-Cheng Chiu (Mountain View, Calif.), Weikeng Qin (Sunnyvale, Calif.), Ruoming Pang (New York) and Yonghui Wu (Palo Alto, Calif.).
According to the abstract* released by the U.S. Patent & Trademark Office: "Provided are improved end-to-end self-supervised pre-training frameworks that leverage a combination of contrastive and masked modeling loss terms. In particular, the present disclosure provides f...