DMCA
Video completion using tracking and fragment merging (2005)
| Venue: | VISUAL COMPUT (2005) 21: 601–610 |
| Citations: | 21 - 1 self |
BibTeX
@MISC{Jia05videocompletion,
author = {Yun-tao Jia and Shi-min Hu and Ralph R. Martin},
title = {Video completion using tracking and fragment merging},
year = {2005}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Video completion is the problem of automatically filling space–time holes in video sequences left by the removal of unwanted objects in a scene. We solve it using texture synthesis, filling a hole inwards using three steps iteratively: we select the most promising target pixel at the edge of the hole, we find the source fragment most similar to the known part of the target’s neighborhood, and we merge source and target fragments to complete the target neighborhood, reducing the size of the hole. Earlier methods were slow, due to searching the whole video data for source fragments or completing holes pixel by pixel; they also produced blurred results due to sampling and smoothing. For speed, we track moving objects, allowing us to use a much smaller search space when seeking source fragments; we also complete holes fragment by fragment instead of pixelwise. Fine details are maintained by use of a graph cut algorithm when merging source and target fragments. Further techniques ensure temporal consistency of hole filling over successive frames. Examples demonstrate the effectiveness of our method.
Keyphrases
video completion fragment merging source fragment target fragment target neighborhood graph cut algorithm space time hole promising target pixel whole video data hole filling video sequence temporal consistency hole inwards unwanted object successive frame blurred result fine detail texture synthesis search space
