US Patent Issued to Microsoft Technology Licensing on July 28 for "Mixture of experts models with sparsified weights" (Washington Inventors)

ALEXANDRIA, Va., July 28 -- United States Patent no. 12,694,265, issued on July 28, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).

"Mixture of experts models with sparsified weights" was invented by Bita Darvish Rouhani (Bellevue, Wash.), Douglas Christopher Burger (Bellevue, Wash.) and Eric S Chung (Woodinville, Wash.).

According to the abstract* released by the U.S. Patent & Trademark Office: "A method is presented for operating a machine learning model including one or more mixture of experts layers. The method comprises receiving one or more input data shards at a routing gate network for a mixture of experts layer comprising a plurality of neural network experts. One or more neural network experts in the mixture...