Intellectual Property India Publishes Patent Application for 'Attention Neural Networks With Parallel Attention And Feed-Forward Layers' Filed by Google Llc

MUMBAI, India, June 13 -- Intellectual Property India has published a patent application (202417072132 A) filed by Google Llc, Mountain View, U.S.A., on Sept. 24, 2024, for 'attention neural networks with parallel attention and feed-forward layers.'

Inventor(s) include Chowdhery, Aakanksha; Devlin, Jacob Daniel; and Narang, Sharan.

The application for the patent was published on June 13, under issue no. 24/2025.

According to the abstract released by the Intellectual Property India: "Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing a machine learning task on a network input to generate a network output. One of the systems comprises an attention neural network configured to perform the machine learning task, the attention neural network comprising a plurality of attention layers, each attention layer comprising an attention sub-layer that is arranged in parallel with a feed-forward sub-layer."

The patent application was internationally filed on Apr. 03, 2023, under International application No.PCT/US2023/017328.

Disclaimer: Curated by HT Syndication.