ALEXANDRIA, Va., July 14 -- United States Patent no. 12,682,162, issued on July 14, was assigned to Huawei Technologies'Co.'Ltd.' (Shenzhen, China).
"Method and apparatus for sequence processing" was invented by Wenyong Huang (Shenzhen, China), Yu Ting Yeung (Hong Kong) and Xiao Chen (Hong Kong).
According to the abstract* released by the U.S. Patent & Trademark Office: "This application provides a method and apparatus for sequence processing, relates to the field of artificial intelligence, and specifically relates to the field of sequence data processing. The method includes: receiving an input sequence; performing self-attention calculation on a first element in the input sequence by using an element included in M windows, to obtain a ...