US Patent Issued to Amazon Technologies on March 31 for "Alignment model as decoding-time heuristic" (California, Washington, Pennsylvania Inventors)

ALEXANDRIA, Va., March 31 -- United States Patent no. 12,591,748, issued on March 31, was assigned to Amazon Technologies Inc. (Seattle).

"Alignment model as decoding-time heuristic" was invented by Sailik Sengupta (Santa Clara, Calif.), Daniele Bonadiman (Sunnyvale, Calif.), Yi-An Lai (Bellevue, Wash.), Arshit Gupta (Sunnyvale, Calif.), Dan Roth (Philadelphia), Katrin Kirchhoff (Seattle), Saab Mansour (San Jose, Calif.) and James Yipeng Huang (Los Angeles).

According to the abstract* released by the U.S. Patent & Trademark Office: "The application is directed to receiving an alignment model and a prompt to evaluate and generate a response using a large language model. The large language model populates tokens for potential responses base...