US Patent Issued to ServiceNow on March 24 for "Layered gradient accumulation and modular pipeline parallelism for improved training of machine learning models" (Canadian Inventor)

ALEXANDRIA, Va., March 24 -- United States Patent no. 12,585,929, issued on March 24, was assigned to ServiceNow Inc. (Santa Clara, Calif.).

"Layered gradient accumulation and modular pipeline parallelism for improved training of machine learning models" was invented by Joel Lamy-Poirier (Montreal).

According to the abstract* released by the U.S. Patent & Trademark Office: "A method is provided including: (i) assigning sequentially-ordered layers of a machine learning model to a plurality of compute nodes, each of the layers being assigned to exactly one of the nodes; (ii) dividing training data into micro-batches; (iii) forward-propagating the micro-batches through the model, each node operating in parallel to generate respective activat...