ALEXANDRIA, Va., Nov. 3 -- United States Patent no. 12,783,424, issued on Nov. 3, was assigned to d-MATRIX Corp. (Santa Clara, Calif.).
"Method and apparatus to cache key-value data in low-precision numerics for efficient generative transformer execution" was invented by Akhil Arunkumar (Santa Clara, Calif.), Satyam Srivastava (Santa Clara, Calif.) and Aayush Ankit (Santa Clara, Calif.).
According to the abstract* released by the U.S. Patent & Trademark Office: "A transformer compute apparatus and method of operation therefor. The apparatus receives matrix inputs in a first format and generates projection tokens from these inputs. Among others, the apparatus includes a first cache device configured for processing first projection tokens a...