Action recognition system based on human body tracking with depth images

When tracking a human body, action recognition tasks can be performed to determine what kind of movement the person is performing. Although a lot of implementations have emerged,state-of-the-art technology such as depth cameras and intelligent systems can be used to build a robust system. This paperdescribes the process of building a system of this type, from the construction of the dataset to obtain the tracked motioninformation in the front-end, to the pattern classification backend.The tracking process is performed using the Microsoft(R) Kinect hardware, which allows a reliable way to store thetrajectories of subjects. Then, signal processing techniques are applied on these trajectories to build action patterns, which feeda Fuzzy-based Neural Network adapted to this purpose. Two different tests were conducted using the proposed system. Recognition among 5 whole body actions executed by 9 humans achieves 91.1% of success rate, while recognition among 10 actions is done with an accuracy of 81.1%.

Keywords:

Body-tracking , action recognition , Kinect depth sensor , 3D skeleton , joint trajectories