Lingua Hands: AI Sign Language Translator with Reverse Mode1

Abstract

LinguaHands is an AI-powered sign language translator designed to bridge the communication gap between hearing-impaired individuals and the general public using multimodal inputs such as video and gesture recognition. The system integrates advanced technologies including MediaPipe for hand landmark detection, a deep learning model for gesture classification, and text-to-speech systems for generating human-like voice responses. Users can perform sign language gestures in front of a camera, and the system analyzes these gestures to deliver real-time, context-aware text and audio translations. The system also supports a reverse mode where spoken or typed text is converted into animated sign language output. Built with a simple and interactive interface, LinguaHands aims to improve accessibility and inclusivity for the hearing-impaired community, especially in public and educational environments. The system serves as an efficient, scalable solution for real-time sign
language interpretation and awareness.