US Patent Issued to DELL PRODUCTS on May 26 for "Memory-aware input batch processing for large language models" (Indian Inventor)

ALEXANDRIA, Va., May 26 -- United States Patent no. 12,639,204, issued on May 26, was assigned to DELL PRODUCTS LP (Round Rock, Texas).

"Memory-aware input batch processing for large language models" was invented by Shibi Panikkar (Bangalore, India).

According to the abstract* released by the U.S. Patent & Trademark Office: "A method facilitating memory-aware input batch processing for large language models includes monitoring, by a system including at least one processor, an amount of memory, utilized by a process in execution by a language model in association with processing a first batch of prompts, relative to an available amount of memory for the process in execution; in response to determining that the amount of memory utilized by ...