Share Email Print

Proceedings Paper

Edge preserving motion estimation with occlusions correction for assisted 2D to 3D conversion
Author(s): Petr Pohl; Michael Sirotenko; Ekaterina Tolstaya; Victor Bucha
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In this article we propose high quality motion estimation based on variational optical flow formulation with non-local regularization term. To improve motion in occlusion areas we introduce occlusion motion inpainting based on 3-frame motion clustering. Variational formulation of optical flow proved itself to be very successful, however a global optimization of cost function can be time consuming. To achieve acceptable computation times we adapted the algorithm that optimizes convex function in coarse-to-fine pyramid strategy and is suitable for modern GPU hardware implementation. We also introduced two simplifications of cost function that significantly decrease computation time with acceptable decrease of quality. For motion clustering based motion inpaitning in occlusion areas we introduce effective method of occlusion aware joint 3-frame motion clustering using RANSAC algorithm. Occlusion areas are inpainted by motion model taken from cluster that shows consistency in opposite direction. We tested our algorithm on Middlebury optical flow benchmark, where we scored around 20th position, but being one of the fastest method near the top. We also successfully used this algorithm in semi-automatic 2D to 3D conversion tool for spatio-temporal background inpainting, automatic adaptive key frame detection and key points tracking.

Paper Details

Date Published: 25 February 2014
PDF: 8 pages
Proc. SPIE 9019, Image Processing: Algorithms and Systems XII, 901906 (25 February 2014); doi: 10.1117/12.2039674
Show Author Affiliations
Petr Pohl, Samsung R&D Institute Russia (Russian Federation)
Michael Sirotenko, Samsung R&D Institute Russia (Russian Federation)
Ekaterina Tolstaya, Samsung R&D Institute Russia (Russian Federation)
Victor Bucha, Samsung R&D Institute Russia (Russian Federation)

Published in SPIE Proceedings Vol. 9019:
Image Processing: Algorithms and Systems XII
Karen O. Egiazarian; Sos S. Agaian; Atanas P. Gotchev, Editor(s)

© SPIE. Terms of Use
Back to Top