ALEXANDRIA, Va., July 15 -- United States Patent no. 12,664,407, issued on June 23, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).
"Resource-efficient attention in a neural network" was invented by Yu Yan (Bellevue, Wash.), Jiusheng Chen (Kirkland, Wash.), Nikhil Bhendawade (Cupertino, Calif.), Yeyun Gong (Beijing), Nan Duan (Beijing) and Ruofei Zhang (Mountain View, Calif.).
According to the abstract* released by the U.S. Patent & Trademark Office: "Computing technology is described herein that provides an attention mechanism, implemented by a neural network, that generates attention information based on head-specific query information and shared key and value (KV) information, without computing head-specific key in...