ALEXANDRIA, Va., Nov. 3 -- United States Patent no. 12,783,800, issued on Nov. 3, was assigned to ROYAL BANK OF CANADA (Toronto).

"System and method for natural language processing with pretrained language models" was invented by Layla El Asri (Montreal), Aishik Chakraborty (Montreal) and Seyed Mehran Kazemi (Montreal).

According to the abstract* released by the U.S. Patent & Trademark Office: "A computer-implemented system and method and for learning an entity-independent representation are disclosed. The method may include: receiving an input text; identifying named entities in the input text; replacing the named entities in the input text with entity markers; parsing the input text into a plurality of tokens; generating a plurality of ...