Google has introduced "Project Gameface," an open-source AI tool designed to enable users to control their PCs through facial and head movements.
By using a webcam and machine learning, the technology identifies 468 key points on an individual's face, which it translates to replicate cursor movements accordingly. The tool is designed to make gaming more accessible to people with disabilities.
- To develop the tool, Google collaborated with Lance Carr, a PC gamer from Colorado who has a rare form of muscular dystrophy,
- Together, they created software exclusively for Windows, enabling users to manipulate their computers using webcam-based head movements and gestures.
- By utilizing the tool's user interface, players can assign different actions and shortcuts to specific facial expressions.
- For instance, raising an eyebrow could translate as a right-click command on a mouse.
- Although the tool is still undergoing development, a preview build is currently accessible via GitHub.