ALEXANDRIA, Va., April 7 -- United States Patent no. 12,596,764, issued on April 7, was assigned to OpenAI OpCo LLC (San Francisco).
"Prompt caching in generative response engines" was invented by Anushree Agrawal (San Francisco), Jeffrey Harris (San Francisco), Daryl Neubieser (San Francisco) and Felipe Petroski Such (San Francisco).
According to the abstract* released by the U.S. Patent & Trademark Office: "Disclosed are systems, apparatuses, processes, and computer-readable media for caching prompts for a generative response engine. The present technology includes receiving, by a cloud computing service, a request including a first prompt including a natural language task to perform, wherein the request include an access key for access...