US Patent Issued to Microsoft Technology Licensing on March 24 for "Compressing tokens based on positions for transformer models" (California, Washington Inventors)

ALEXANDRIA, Va., March 24 -- United States Patent no. 12,585,934, issued on March 24, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).

"Compressing tokens based on positions for transformer models" was invented by Andy Wagner (Cupertino, Calif.), Tiyasa Mitra (San Jose, Calif.) and Marc Tremblay (Bellevue, Wash.).

According to the abstract* released by the U.S. Patent & Trademark Office: "Embodiments of the present disclosure include systems and methods for compressing tokens based on positions for training data that is used to train transformer models. In some embodiments, a set of input data for training a transformer model is received. The set of input data comprises a set of tokens and a set of position values. A f...