← All innovations
37
Human–Computer Interaction

Gesture-Based Game Control

A camera-based controller that maps deliberate hand poses to common game actions, exploring more intuitive and accessible ways to interact with desktop games.

Product positionPrototype demonstrated
Designed forInnovation labs, institutions, events and robotics partners
Why this matters

Explore game interaction without requiring a handheld controller.

A familiar game can become a useful environment for studying alternative input. This camera-based controller links supported hand poses to common actions so users can explore an interaction style based on visible movement.

Product capabilities
  • One- or two-hand recognition
  • directional control
  • keyboard-compatible output
  • live camera feedback
  • no handheld controller required
  • extensible gesture set

The user experience

The player makes a recognised pose or movement and checks the live feedback while the corresponding action is passed to a compatible desktop game. A defined gesture set keeps early experiments understandable and repeatable.

Practical value

Provides an adaptable interaction experiment, not a universal accessibility solution; comfort and suitability must be assessed with the intended user.

Where this could help

Application scenarios

Examples of potential use, not claims of an existing deployment.

Human-computer interaction classes

Compare how users learn conventional and gesture-led control for the same game task.

Accessibility exploration

Investigate whether a selected gesture set suits an individual participant, with alternative controls available.

Bring this idea into your context

Explore licensing, adaptation, validation or product-development collaboration.

Discuss the opportunity