Share Email Print

Proceedings Paper

Foreground object segmentation from binocular stereo video
Author(s): Kevin Law; Stan Sclaroff
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Moving cameras are needed for a wide range of applications in robotics, vehicle systems, surveillance, etc. However, many foreground object segmentation methods reported in the literature are unsuitable for such settings; these methods assume that the camera is fixed and the background changes slowly, and are inadequate for segmenting objects in video if there is significant motion of the camera or background. To address this shortcoming, a new method for segmenting foreground objects is proposed that utilizes binocular video. The method is demonstrated in the application of tracking and segmenting people in video who are approximately facing the binocular camera rig. Given a stereo image pair, the system first tries to find faces. Starting at each face, the region containing the person is grown by merging regions from an over-segmented color image. The disparity map is used to guide this merging process. The system has been implemented on a consumer-grade PC, and tested on video sequences of people indoors obtained from a moving camera rig. As can be expected, the proposed method works well in situations where other foreground-background segmentation methods typically fail. We believe that this superior performance is partly due to the use of object detection to guide region merging in disparity/color foreground segmentation, and partly due to the use of disparity information available with a binocular rig, in contrast with most previous methods that assumed monocular sequences.

Paper Details

Date Published: 24 October 2005
PDF: 8 pages
Proc. SPIE 6006, Intelligent Robots and Computer Vision XXIII: Algorithms, Techniques, and Active Vision, 60060C (24 October 2005); doi: 10.1117/12.630207
Show Author Affiliations
Kevin Law, Boston Univ. (United States)
Stan Sclaroff, Boston Univ. (United States)

Published in SPIE Proceedings Vol. 6006:
Intelligent Robots and Computer Vision XXIII: Algorithms, Techniques, and Active Vision
David P. Casasent; Ernest L. Hall; Juha Röning, Editor(s)

© SPIE. Terms of Use
Back to Top