US Patent Issued to HUAWEI CLOUD COMPUTING TECHNOLOGIES on Nov. 3 for "System and method of lora contrastive decoding in large language models" (Canadian, Chinese Inventors)

ALEXANDRIA, Va., Nov. 3 -- United States Patent no. 12,783,804, issued on Nov. 3, was assigned to HUAWEI CLOUD COMPUTING TECHNOLOGIES Co. LTD. (Gui'an New District, China).

"System and method of lora contrastive decoding in large language models" was invented by Morgan Lindsay Heisler (Vancouver, Canada), Weiwei Zhang (Guizhou, China), Zhenan Fan (Guizhou, China) and Yong Zhang (Richmond, Canada).

According to the abstract* released by the U.S. Patent & Trademark Office: "Methods and systems are disclosed. The method comprises receiving the input text sequence; generating, a first likelihood score for each of a plurality of candidate output tokens using an expert model on the input text sequence, the expert model being a LoRA adapter trai...