US Patent Issued to Microsoft Technology Licensing on May 5 for "Expediting generative token production using speculative sampling, added guidance, and language models of different capacities" (German, British Inventors)

ALEXANDRIA, Va., May 5 -- United States Patent no. 12,619,821, issued on May 5, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).

"Expediting generative token production using speculative sampling, added guidance, and language models of different capacities" was invented by Ayyoob Imanigooghari (Munich), Mohsen Fayyaz (Berlin) and Eric Chris Wolfgang Sommerlade (Oxford, Great Britain).

According to the abstract* released by the U.S. Patent & Trademark Office: "A technique accelerates the generative production of tokens using a target language model that operates in cooperation with a draft language model. The target language model is more capable, but slower, compared to the draft language model. In operation, the draft...