ALEXANDRIA, Va., Sept. 15 -- United States Patent no. 12,737,601, issued on Sept. 15, was assigned to Amazon Technologies Inc. (Seattle).
"Tensor rematerialization" was invented by Pushkar Ratnalikar (San Jose, Calif.), Hongbin Zheng (San Jose, Calif.), Ron Diamant (San Jose, Calif.) and Amith Rajith Mamidala (Cupertino, Calif.).
According to the abstract* released by the U.S. Patent & Trademark Office: "A technique for rematerializing a tensor in a neural network model may include identifying a candidate operator for rematerialization in a representation of a data flow graph for a neural network model. An operator can be identified as a candidate operator if it generates a tensor that is used multiple times in the neural network model an...