US Patent Issued to Intuit on Sept. 15 for "Computer-aware caching for low latency LLM serving" (Israeli Inventors)

ALEXANDRIA, Va., Sept. 15 -- United States Patent no. 12,737,551, issued on Sept. 15, was assigned to Intuit Inc. (Mountain View, Calif.).

"Computer-aware caching for low latency LLM serving" was invented by Shai Ardazi (Petah Tikva, Israel), Matan Vetzler (Petah Tikva, Israel), Ofir Ben Shoham (Petah Tikva, Israel) and Sagiv Antebi (Petah Tikva, Israel).

According to the abstract* released by the U.S. Patent & Trademark Office: "Computer-aware caching for low latency large language model (LLM) serving includes detecting an idle time of a hardware processor while monitoring the hardware processor, triggering, in response to detecting idle time, a LLM to generate a candidate set that includes a request and a response from a raw chat log, g...