US Patent Issued to HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY on Sept. 15 for "GPU-sharing method and apparatus for serverless inference loads" (Chinese Inventors)

ALEXANDRIA, Va., Sept. 15 -- United States Patent no. 12,737,833, issued on Sept. 15, was assigned to HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY (Wuhan, China).

"GPU-sharing method and apparatus for serverless inference loads" was invented by Song Wu (Wuhan City, China), Hao Wu (Wuhan City, China), Zhuo Huang (Wuhan City, China), Hao Fan (Wuhan City, China), Yue Yu (Wuhan City, China) and Hai Jin (Wuhan City, China).

According to the abstract* released by the U.S. Patent & Trademark Office: "A GPU-sharing method and apparatus for serverless inference loads is provided, wherein the method involves intercepting and forwarding GPU API calls made by inference tasks to an API proxy process to manage and allocate GPU resources. With a CPU an...