Intellectual Property India Publishes Patent Application for Efficient Attention Using Soft Masking And Soft Channel Pruning

MUMBAI, India, July 7 -- Intellectual Property India has published a patent application (202647077692 A) filed by Qualcomm Technologies, Inc. on June 23, 2026, for Efficient Attention Using Soft Masking And Soft Channel Pruning.

Inventors include Van Den Dool, Winfried; Asano, Yuki; Welling, Max Number; and Blankevoort, Tijmen Pieter Frederik.

The application for the patent was published on July 03, 2026, under issue no. 27/2026.

Abstract: A processor-implemented method includes configuring a transformer model having multiple attention heads. Each attention head has a set of architecture parameters and weight parameters. The set of architecture parameters are determined for each attention head based on using a soft pruning technique acco...