US Patent Issued to Writer on Oct. 20 for "Better inference pattern for long context retrieval" (American, Polish, British, Indian Inventors)

ALEXANDRIA, Va., Oct. 21 -- United States Patent no. 12,769,728, issued on Oct. 20, was assigned to Writer Inc. (San Francisco).

"Better inference pattern for long context retrieval" was invented by Melisa Russak (Wroclaw, Poland), Umar Jamil (London), Axel Magnuson (Seattle), Mateusz Russak (Wroclaw, Poland), Waseem AlShikh (Boca Raton, Fla.) and Kiran Kamble (Karnataka, India).

According to the abstract* released by the U.S. Patent & Trademark Office: "The present disclosure relates to a method and system for enhancing inference in large language models (LLMs) over long input sequences. A segmented inference strategy may be employed, wherein the long context can be divided and sequentially processed through a key-value (KV) cache of the...