Research Project Title: Real-time Multilingual Video Translation Using AI

​

Principal Investigator (PI) Name: Gebril Fradj

​

Institution and Department: University of Florida, Department of Computer Science. Classics Department

​

Amount of Time Affiliated with the Project: This is a new project that I will begin after the first week of school

​

Research Focus:
The project focuses on developing an AI-powered system that enables real-time multilingual video translation, addressing the challenge of communication across language barriers. As globalization accelerates, the need for effective, instantaneous translation during live events, online education, and international conferences has become more pressing. This research aims to create a system capable of automatically transcribing spoken language from video streams, translating the text into multiple languages, and generating corresponding audio translations. By leveraging state-of-the-art AI techniques in speech recognition, machine translation, and text-to-speech synthesis, this project seeks to produce a robust, real-time translation solution that enhances accessibility and inclusivity for diverse audiences.

​

Project Responsibilities:
As the primary researcher, I will be responsible for designing and implementing the entire pipeline for real-time multilingual video translation. My tasks will include selecting and fine-tuning automatic speech recognition (ASR) models to transcribe video content, training machine translation models for translating the transcriptions into various target languages, and integrating text-to-speech synthesis to produce natural-sounding translated audio. I will also explore methods for overlaying translated text and audio onto the original video streams. Additionally, I will conduct extensive evaluations of the system's performance, focusing on accuracy, latency, and user satisfaction, to refine the model and improve its effectiveness. My responsibilities extend to documenting the research process, preparing findings for publication, and presenting the results to academic and professional audiences.