Intellectual Property India Publishes Patent Application for 'Outlier Attenuation In Transformer Neural Networks' Filed by Qualcomm Incorporated

MUMBAI, India, Nov. 14 -- Intellectual Property India has published a patent application (202547097028 A) filed by Qualcomm Incorporated, San Diego, on Oct. 8, for 'outlier attenuation in transformer neural networks.'

Inventor(s) include Bondarenko, Yelysei; Nagel, Markus; and Blankevoort, Tijmen Pieter Frederik.

The application for the patent was published on Nov. 14, under issue no. 46/2025.

According to the abstract released by the Intellectual Property India: "Certain aspects of the present disclosure provide techniques and apparatus for processing data using a transformer neural network. The method generally includes receiving an input for processing using a transformer neural network. An attention output is generated in the transformer neural network. Generally, the attention output may be generated such that outlier values for the attention output are attenuated in the transformer neural network. An output of the transformer neural network is generated based on the generated attention output."

The patent application was internationally filed on Mar. 27, 2024, under International application No.PCT/US2024/021726.

Disclaimer: Curated by HT Syndication.