A model based factorization approach for dense 3D recovery from monocular video

Yagnik, J and Ramakrishnan, KR (2005) A model based factorization approach for dense 3D recovery from monocular video. In: 7th IEEE International Symposium on Multimedia, DEC 12-14, 2005, Irvine, CA.

PDF model.pdf - Published Version Restricted to Registered users only Download (761kB) | Request a copy

Abstract

Feature track matrix factorization based methods have been attractive solutions to the Structure-front-motion (Sfnl) problem. Group motion of the feature points is analyzed to get the 3D information. It is well known that the factorization formulations give rise to rank deficient system of equations. Even when enough constraints exist, the extracted models are sparse due the unavailability of pixel level tracks. Pixel level tracking of 3D surfaces is a difficult problem, particularly when the surface has very little texture as in a human face. Only sparsely located feature points can be tracked and tracking error arc inevitable along rotating lose texture surfaces. However, the 3D models of an object class lie in a subspace of the set of all possible 3D models. We propose a novel solution to the Structure-from-motion problem which utilizes the high-resolution 3D obtained from range scanner to compute a basis for this desired subspace. Adding subspace constraints during factorization also facilitates removal of tracking noise which causes distortions outside the subspace. We demonstrate the effectiveness of our formulation by extracting dense 3D structure of a human face and comparing it with a well known Structure-front-motion algorithm due to Brand.

Item Type:	Conference Paper
Publisher:	IEEE
Additional Information:	Copyright 2005 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Department/Centre:	Division of Electrical Sciences > Electrical Engineering Division of Interdisciplinary Sciences > Supercomputer Education & Research Centre
Date Deposited:	08 Jun 2010 06:55
Last Modified:	07 Jul 2011 06:27
URI:	http://eprints.iisc.ac.in/id/eprint/27186

Actions (login required)

View Item