ALEXANDRIA, Va., June 2 -- United States Patent no. 12,645,615, issued on June 2, was assigned to MediaTek Singapore Pte. Ltd. (Singapore).
"Ring buffer storage method and ring buffer storage system capable of minimizing extra overhead utilization" was invented by Jung Hau Foo (Singapore), Jia Yao Christopher Lim (Singapore), Deep Yap (Singapore) and Kelvin Kae Wen Teh (Singapore).
According to the abstract* released by the U.S. Patent & Trademark Office: "A ring buffer storage method includes generating data of a first output according to Q input tokens of a large language model (LLM), and writing the data of the first output into last Q column vectors of an updated first cache tensor buffer matrix. A starting memory address of a first c...