US Patent Issued to Oracle International on Feb. 10 for "Next AST branch prediction and next token prediction joint pre-training task for code generative models" (Swiss, Canadian Inventors)

ALEXANDRIA, Va., Feb. 11 -- United States Patent no. 12,547,832, issued on Feb. 10, was assigned to Oracle International Corp. (Redwood Shores, Calif.).

"Next AST branch prediction and next token prediction joint pre-training task for code generative models" was invented by Tomas Feith (Zurich), Arno Schneuwly (Effretikon, Switzerland), Saeid Allahdadian (Vancouver, Canada), Matteo Casserini (Zurich) and Felix Schmidt (Baden-Dattwil, Switzerland).

According to the abstract* released by the U.S. Patent & Trademark Office: "During pretraining, a computer generates three trainable and untrained machine learning models that are a token sequence encoder, a token predictor, and a path predictor. A sequence of lexical tokens is generated that re...