Portable Virtual Piano using Augmented Reality

The main purpose of this study is to explore the interaction between a musical application and a paper which is used as a display. This is achieved by exploringareas such as Human Computer Interaction (HCI), Computer Graphics and Image Processing. This study expresses interaction paradigm of playing piano usingpressure of fingers on the paper. The system integrates finger tapping identification with information about hand placement in relation to corresponding piano keypositions, and generates sounds based on this data. This experiment shows that the proposed method achieves an accuracy rate of 77% for determining piano keys.

Keywords:

Virtual piano , Portable , Android , Augmented Reality