MUMBAI, India, Oct. 12 -- Intellectual Property India has published a patent application (202641118886 A) filed by Vallurupalli Nageswara Rao Vignana Jyothi Institute Of Engineering And Technology on October 05, 2026, for A Multimodal Ai Framework For Personalized Language Learning Using Image Recognition And Multilingual Natural Language Processing.
Inventor includes Dr. N. Sandhya.
The application for the patent was published on October 09, 2026, under issue no. 41/2026.
Abstract: ABSTRACT [0025] A dynamic interactive platform is presented that unites real-time object detection with multilingual text-to-speech conversion to support foreign language learning. Live video frames captured from a webcam are processed by one of three detection models, YOLO11n, YOLO11s or RT-DETR, to locate and label objects present in the user’s surroundings. Detected English labels are translated into a chosen target language and rendered as spoken audio through the Google Text- to-Speech module. The resulting text and speech are synchronized with the visual display so that users simultaneously see the object name in English and in the target language while hearing its correct pronunciation. The system operates continuously, maintains low latency, and provides an accessible interface that allows language selection and real-time interaction. Evaluation across the three detection models demonstrates reliable performance under varying lighting and object complexity, confirming the platform’s suitability for practical, context-rich language acquisition.
Disclaimer: Curated by HT Syndication.
