Using Physical Object Detection as User Interface in Video Games

The camera of high-end smartphones could be used as an input device for object recognition. This paper explores using this technology as the user interface in video games and presents a playable prototype of a video game using object recognition as the user interface to show the proof of concept. The prototype was played by several RPG players, and they were interviewed about their general opinion toward their experience, and they stated that their experience was satisfying.

Keywords:

computer vision , user interface design , user experience design , video games , mixed reality