Authors: Khushboo Lokhande, Samruddhi Mahajan, Sayali Pawar, Janhavi Wankhede, Vijay More
Abstract: Vaani2Mudra is an online assistive communication platform that converts spoken or written language into gestures representing Indian Sign Language (ISL). The platform utilizes a compact speech recognition model to process voice input and employs natural language processing methods to restructure spoken content into a format compatible with ISL. Through a rule-based linguistic framework, the system eliminates redundant grammatical elements and standardizes text for gesture mapping. For multilingual functionality, Marathi language input is first converted to English before further processing. The output is presented through a series of pre-established ISL gesture visuals shown on a web-based interface. This system prioritizes ease of use, instantaneous processing, and user accessibility, positioning it as an effective tool for learning environments and assistive communication applications.
DOI: http://doi.org/10.5281/zenodo.20766405
