Universal Gesture Translation

Our ability to picture children and teens playing video games is about as vivid as the animation of the games themselves. The full picture, however, is incomplete, because current technology does not afford most individuals with motor disabilities the option of participating.

Improving Access to Gaming

Millions of people across the world spend hours interfacing with the characters and activities provided on these bright screens – all in a desire to have fun and connect. Today’s tech games are accessible in even the most remote parts of the world, translated into many languages, and designed for individuals of all ages. And yet, sadly, they are not accessible for nearly all people with motor disabilities.

The Cerebral Palsy Foundation (CPF) is working to change that.

In partnership with UCLA’s Center for Cerebral Palsy, USC’s Interactive Creative Technology Lab, and, critically, with Microsoft, we are creating an approach that will use the Copilot option for Xbox One system’s accessibility menus to enable players with motor disabilities to participate in social gaming with their family and friends. Copilot allows two controllers to operate the same game thus enabling another person to assist the player with CP during game play. With this we can provide innovative accessibility for people with disabilities who want to be included in the gaming experience – and, even more importantly, in playing with friends.

Importantly, the power of this project comes from building off existing technology and insights to create something new. It’s an idea whose time is here. And that means that we can all push to achieve the vision of kids with disabilities playing alongside their peers sooner rather than later. A perfect example of translational research that should be happening today.

Copilot’s approach to solving a simple problem is just one example of how CPF is transforming lives for individuals with cerebral palsy not many years down the road, but today. Now our image of children playing together is finally complete – because it is a picture of ALL children joining in on the fun.