3D shape extraction of human face in presence of facial hair: A profilometric approach

Yagnik, Jay and Sai Siva, G and Ramakrishnan, KR and Kameswara Rao, L. (2006) 3D shape extraction of human face in presence of facial hair: A profilometric approach. In: IEEE Region 10 Conference (TENCON 2005),, Nov 21-24, 2005, Melbourne, Austrailia, pp. 2581-2585.

PDF 04085277.pdf - Published Version Restricted to Registered users only Download (732kB) | Request a copy

Abstract

The increasing use of 3D modeling of Human Face in Face Recognition systems, User Interfaces, Graphics, Gaming and the like has made it an area of active study. Majority of the 3D sensors rely on color coded light projection for 3D estimation. Such systems fail to generate any response in regions covered by Facial Hair (like beard, mustache), and hence generate holes in the model which have to be filled manually later on. We propose the use of wavelet transform based analysis to extract the 3D model of Human Faces from a sinusoidal white light fringe projected image. Our method requires only a single image as input. The method is robust to texture variations on the face due to space-frequency localization property of the wavelet transform. It can generate models to pixel level refinement as the phase is estimated for each pixel by a continuous wavelet transform. In cases of sparse Facial Hair, the shape distortions due to hairs can be filtered out, yielding an estimate for the underlying face. We use a low-pass filtering approach to estimate the face texture from the same image. We demonstrate the method on several Human Faces both with and without Facial Hairs. Unseen views of the face are generated by texture mapping on different rotations of the obtained 3D structure. To the best of our knowledge, this is the first attempt to estimate 3D for Human Faces in presence of Facial hair structures like beard and mustache without generating holes in those areas.

Item Type:	Conference Paper
Series.:	TENCON-IEEE Region 10 Conference Proceedings
Publisher:	Institute of Electrical and Electronics Engineers
Additional Information:	Copyright 2006 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Keywords:	3D shape extraction;profilometry;3D face recognition; facial hair;unseen view synthesis
Department/Centre:	Division of Electrical Sciences > Electrical Engineering Division of Interdisciplinary Sciences > Supercomputer Education & Research Centre
Date Deposited:	02 Sep 2010 06:17
Last Modified:	07 Jul 2011 06:28
URI:	http://eprints.iisc.ac.in/id/eprint/30536

Actions (login required)

View Item