ALEXANDRIA, Va., Sept. 8 -- United States Patent no. 12,732,342, issued on Sept. 8, was assigned to Reaction Ltd. (Tel Aviv, Israel).
"Hardware-accelerated execution of large language models over fully homomorphic encryption" was invented by Oren Vrubel (Tel Aviv, Israel), Nimrod Borer (Atlit, Israel) and Ilan Rosenfeld (Petah Tikva, Israel).
According to the abstract* released by the U.S. Patent & Trademark Office: "A system and method for hardware-accelerated execution of a multi-token large language model (LLM) over fully homomorphic encryption (FHE) are presented. The method includes generating a plurality of tokens by homomorphic evaluation of a previous transformer cycle of the multi-token LLM; representing the plurality of tokens u...