Share Email Print

Proceedings Paper

Video colorization based on optical flow and edge-oriented color propagation
Author(s): Mayu Otani; Hirohisa Hioki
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

We propose a novel video colorization method based on sparse optical flow and edge-oriented color propagation. Colorization is a process of adding color to monochrome images or videos. In our video colorization method, it is assumed that key frames are appropriately selected out of a grayscale video stream and are properly colorized in advance. Once key frames are colorized, our method colorizes all the remaining grayscale frames automatically. It is also possible to colorize key frames semi-automatically by our method. For colorizing a grayscale frame between a pair of colorized key frames, sparse optical flow is computed first. The optical flow consists of reliable motion vectors around strong feature points. The colors around feature points of key frames are then copied to the grayscale frame according to the estimated motion vectors. Those colors are then propagated to the rest of the grayscale frame. Colors are blended appropriately during the propagation process. A pair of accuracy and priority measures is introduced to control how the color propagation proceeds. To successfully propagate colors, it is important not to wrongly spread colors across edges. For this purpose, a set of neighboring pixels is adaptively selected not to include edge-like areas and thus not to spread colors across edges. To evaluate effectiveness of our method, image colorization and video colorization were performed. Experimental results show that our method can colorize images and videos better than previous methods when there are edges. We also show that the proposed method enables us to easily modify colors in colored video streams.

Paper Details

Date Published: 7 March 2014
PDF: 9 pages
Proc. SPIE 9020, Computational Imaging XII, 902002 (7 March 2014); doi: 10.1117/12.2037496
Show Author Affiliations
Mayu Otani, Nara Institute of Science and Technology (Japan)
Hirohisa Hioki, Kyoto Univ. (Japan)

Published in SPIE Proceedings Vol. 9020:
Computational Imaging XII
Charles A. Bouman; Ken D. Sauer, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?