US Patent Issued to Intuit on Sept. 1 for "Closed-loop speculative decoding with real-time prompt patching for language model output generation" (Israeli Inventors)

ALEXANDRIA, Va., Sept. 1 -- United States Patent no. 12,724,979, issued on Sept. 1, was assigned to Intuit Inc. (Mountain View, Calif.).

"Closed-loop speculative decoding with real-time prompt patching for language model output generation" was invented by Amir Bialer (Petah Tikva, Israel), Shai Ardazi (Petah Tikva, Israel), Shon Mendelson (Tel Aviv, Israel) and Binyamin Ariel (Petah Tikva, Israel).

According to the abstract* released by the U.S. Patent & Trademark Office: "A method includes generating, by a draft model, a token sequence in response to an input prompt. The method further includes performing concurrent operations of classifying, by a verifier model, a characteristic of the token sequence to obtain a classification type of t...