A Facial Motion Capture System Based on Neural Network Classifier Using RGB-D Data

Authors

  • Fateme Zare Mehrjardi Yazd University
  • Mehdi Rezaeian Yazd University

Keywords:

motion capture, depth data, 3D model, facial expression, Kinect, optical flow

Abstract

Analysis of live and dynamic movements by computer is one of the areas that draws a great deal of interest to itself. One of the important parts of this area is the motion capture process that can be based on the appearance and facial mode estimation. The aim of this study is to represent 3D facial movements from estimated facial expressions using video image sequences and applying them to computer-generated 3D faces. We propose an algorithm which can classify the given image sequences into one of the motion frames. The contributions of this work lie mainly in two aspects. Firstly, an optical flow algorithm is used for feature extraction, that instead of using two subsequent images (or two subsequent frames in a video), the distinction between images and the normal state is used. Secondly, we realize a multilayer perceptron network that their inputs are matrices obtained from optical flow algorithm to model a mapping between person movements and database movement categories. A three-dimensional avatar, which is made by means of Kinect data, is used to represent the face movements in a graphical environment. In order to evaluate the proposed method, several videos are recorded in order to compare the available modes and discovered modes. The results indicate that the proposed method is effective.

Author Biographies

Fateme Zare Mehrjardi, Yazd University

Fateme Zare Mehrjardi
Computer Engineering Department, Yazd University, Iran
Zarefateme41@yahoo.com

Mehdi Rezaeian, Yazd University

Mehdi Rezaeian
Computer Engineering Department, Yazd University, Iran
mrezaeian@yazd.ac.ir

?

Downloads

Published

2018-05-08

How to Cite

Mehrjardi, F. Z., & Rezaeian, M. (2018). A Facial Motion Capture System Based on Neural Network Classifier Using RGB-D Data. BRAIN. Broad Research in Artificial Intelligence and Neuroscience, 9(2), pp. 139-154. Retrieved from https://lumenpublishing.com/journals/index.php/brain/article/view/2040

Publish your work at the Scientific Publishing House LUMEN

It easy with us: publish now your work, novel, research, proceeding at Lumen Scientific Publishing House

Send your manuscript right now