Bidirectional Sign Language Communication
An assistive communication framework exploring translation between spoken/written English and American Sign Language representations using standard computing hardware.
Explore additional ways to bridge a limited spoken, written and signed exchange.
Communication can become difficult when participants do not share a language or an accessible input method. This assistive research framework explores English speech or text alongside American Sign Language representations and camera-based fingerspelling interaction.
- Speech or text input
- sign-oriented visual output
- camera-based fingerspelling recognition
- text assembly
- optional spoken output
- local interaction
- extensible vocabulary and language support
The user experience
A user provides speech, text or supported visual input and reviews the corresponding output. The exchange is designed for a defined vocabulary and should allow a person to check whether their intended meaning has been preserved.
Practical value
Provides a research platform for accessible interaction, not a fluent sign-language interpreter or a replacement for qualified interpretation in consequential conversations.
Application scenarios
Examples of potential use, not claims of an existing deployment.
Accessibility demonstrations
Introduce learners to alternative interaction pathways and the limits of automated communication tools.
Controlled service-desk trials
Explore simple, predefined exchanges with participant consent and accessible human assistance available.