Non-Rigid Shape from Image Streams
Date
1999-07-27
DOI
Authors
Sclaroff, Stan
Alon, Jonathan
Version
OA Version
Citation
Sclaroff, Stan; Alon, Jonathan. "Non-Rigid Shape from Image Streams", Technical Report BUCS-1999-006, Computer Science Department, Boston University, July 27, 1999. [Available from: http://hdl.handle.net/2144/1783]
Abstract
We present a framework for estimating 3D relative structure (shape) and motion given objects undergoing nonrigid deformation as observed from a fixed camera, under perspective projection. Deforming surfaces are approximated as piece-wise planar, and piece-wise rigid. Robust registration methods allow tracking of corresponding image patches from view to view and recovery of 3D shape despite occlusions, discontinuities, and varying illumination conditions. Many relatively small planar/rigid image patch trackers are scattered throughout the image; resulting estimates of structure and motion at each patch are combined over local neighborhoods via an oriented particle systems formulation. Preliminary experiments have been conducted on real image sequences of deforming objects and on synthetic sequences where ground truth is known.