An Augmented Tabletop Video Game with Pinching Gesture Recognition

A novel interaction technique for a multi-player tabletop entertainment system that recognises quick tapping gestures for position and orientation input using a high-speed camera.

Enhanced Life
This technology enables more intuitive and entertaining interaction between humans and interactive surfaces such as tabletop systems.

Goals
To recognise various human behaviours, including very quick motions, and enable intuitive and entertaining interaction between humans and displays.

Innovations
The main innovation is a new interaction technique that recognises tapping gestures. In tests with multiple users, the system achieved a high-response bimanual interaction. It uses a high-speed camera to track positions, orientations, and quick tapping gesture.

Vision
In the near future, interactive surfaces will be ubiquitous. Walls, tabletops, floors, and other surfaces in private and public spaces will provide interactive communication and experiences.

1. Kentaro Fukuchi*, Toshiki Sato°, Haruko Mamiya°, Hideki Koike, PAC-PAC: Pinching Gesture Recognition for Tabletop Entertainment System, Proc. of Advanced Visual Interfaces (AVI 2010), pp.267-274, 2010.

2. Kentaro Fukuchi, Toshiki Sato, Haruko Mamiya, Hideki Koike, An Augmented Tabletop Video Game with Pinching Gesture Recognition, SIGGRAPH ASIA 2008, Emerging Technologies, 2008.