US Patent Issued to Bytedance Technology, Beijing Zitiao Network Technology on Sept. 15 for "Key-value cache management system for inference processes" (Chinese, American Inventors)

ALEXANDRIA, Va., Sept. 15 -- United States Patent no. 12,737,364, issued on Sept. 15, was assigned to Bytedance Technology Ltd. (Grand Cayman, Cayman Islands) and Beijing Zitiao Network Technology Co. Ltd. (Beijing).

"Key-value cache management system for inference processes" was invented by Tongping Liu (Los Angeles), Chak-Pong Chung (Los Angeles), Liguang Xie (Los Angeles), Jianjun Chen (Los Angeles), Caixue Lin (Los Angeles), Wu Xiang (Beijing) and Rui Shi (Beijing).

According to the abstract* released by the U.S. Patent & Trademark Office: "A key-value cache management system processes inference requests of a generative model. An inference request requests a starting virtual memory address and a number of layers in the generative mode...