US Patent Issued to Adobe on May 26 for "Generating draft sequence rankings for speculative decoding using large language model hidden states" (Indian Inventors)

ALEXANDRIA, Va., May 26 -- United States Patent no. 12,639,354, issued on May 26, was assigned to Adobe Inc. (San Jose, Calif.).

"Generating draft sequence rankings for speculative decoding using large language model hidden states" was invented by Shwetha Somasundaram (Chennai, India), Apoorv Umang Saxena (Bengaluru, India) and Anirudh Phukan (Bengaluru, India).

According to the abstract* released by the U.S. Patent & Trademark Office: "The present disclosure relates to systems, non-transitory computer-readable media, and methods for using hidden states of a large language model to generate responses to queries via speculative decoding. In particular, the disclosed systems determine, for a large language model ("LLM"), a prompt comprising...