MUMBAI, India, Aug. 12 -- Intellectual Property India has published a patent application (202611076986 A) filed by Abes Engineering College on June 22, 2026, for A Semantic Cache Proxy System And A Process Thereof.
Inventors include Ms. Pooja Singhal; and Mr. Rohit Bhardwaj.
The application for the patent was published on August 07, 2026, under issue no. 32/2026.
Abstract: The present invention relates to a semantic cache proxy system and a process thereof for optimizing Large Language Model API interactions. The system comprises an ingress and normalization layer, in-memory cache, distributed cache, semantic vector cache, policy engine, concurrent request deduplication module, and observability framework. Natural language queries are no...