Development and Evaluation of an AI-powered Video Captioning and Transcription Web App

Development and Evaluation of an AI-powered Video Captioning and Transcription Web App
Thomas Schmidt
Thi Ha My Pham
Christian Wolff
in Bearbeitung
web development, video. transcription, aws, user interface design, subtitles, content creation, social media


  • Increasing importance of video content online: With platforms like YouTube, TikTok, social media, and online courses, videos have become a predominant medium for communication, entertainment, and education. The shift towards video content highlights the need for innovative solutions that enhance the accessibility and usability of this media.
  • The need for accessible and searchable video content: As the volume of video content continues to surge, ensuring accessibility and searchability has become paramount. Users expect not only seamless access to videos but also the ability to search and navigate through the content efficiently. This poses a challenge, particularly for individuals with hearing impairments who may rely on captions for a comprehensive understanding.
  • Challenges associated with manual video captioning and transcription: Human transcription is not only time-consuming but also prone to errors. The intricate nature of spoken language, accents, and diverse content makes accurate manual transcription a daunting task. This inefficiency underscores the necessity for automated tools to streamline and enhance the video content processing workflow.
  • Manual transcription processes are notorious for their time-consuming nature and susceptibility to errors. Content creators investing significant resources in manual transcription often face delays and increased costs.
  • Accessibility issues for individuals with hearing impairments.

Zielsetzung der Arbeit

Develop an AI-powered Video Captioning and Transcription Web App to automate the process. - Improve accessibility to video content for users with hearing impairments. - Increase the efficiency and accuracy of video transcription. - Create a user-friendly interface for easy navigation and interaction. - Evaluate the effectiveness of the AI model in real-world scenarios.

Konkrete Aufgaben

Front-end development

  • Create an intuitive and responsive user interface using HTML, CSS, and JavaScript, with a focus on accessibility and usability.
  • Ensure a smooth and responsive experience across various devices.
  • Integrate video playback functionality.
  • Create a form for uploading video files.

AWS integration

  • Set up AWS Transcribe and integrate it into the web app.
  • Establish secure communication channels with AWS services.

Real-time Captioning Implement real-time captioning features using AWS Transcribe. Functional and user testing

  • Ensure all features work as intended.
  • Validate the accuracy of the transcription and captioning.
  • Gather feedback on the user interface and overall experience.

Erwartete Vorkenntnisse

  • Web development in HTML, CSS and JavaScript
  • Familiarity with integrating AWS services into web applications
  • Usability Testing

Weiterführende Quellen

Nach Absprache mit dem Betreuer.