DMCA
Region Filling and Object Removal by Exemplar-Based Image Inpainting (2004)
Cached
Download Links
| Citations: | 364 - 1 self |
BibTeX
@MISC{Criminisi04regionfilling,
author = {A. Criminisi and P. Pérez and K. Toyama},
title = {Region Filling and Object Removal by Exemplar-Based Image Inpainting},
year = {2004}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
A new algorithm is proposed for removing large objects from digital images. The challenge is to fill in the hole that is left behind in a visually plausible way. In the past, this problem has been addressed by two classes of algorithms: 1) “texture synthesis” algorithms for generating large image regions from sample textures and 2) “inpainting ” techniques for filling in small image gaps. The former has been demonstrated for “textures”—repeating twodimensional patterns with some stochasticity; the latter focus on linear “structures ” which can be thought of as one-dimensional patterns, such as lines and object contours. This paper presents a novel and efficient algorithm that combines the advantages of these two approaches. We first note that exemplar-based texture synthesis contains the essential process required to replicate both texture and structure; the success of structure propagation, however, is highly dependent on the order in which the filling proceeds. We propose a best-first algorithm in which the confidence in the synthesized pixel values is propagated in a manner similar to the propagation of information in inpainting. The actual color values are computed using exemplar-based synthesis. In this paper, the simultaneous propagation of texture and structure information is achieved by a single, efficient algorithm. Computational efficiency is achieved by a block-based sampling process. A number of examples on real and synthetic images demonstrate the effectiveness of our algorithm in removing large occluding objects, as well as thin scratches. Robustness with respect to the shape of the manually selected target region is also demonstrated. Our results compare favorably to those obtained by existing techniques.
Keyphrases
object removal region filling exemplar-based image inpainting efficient algorithm essential process large image region synthesized pixel value simultaneous propagation twodimensional pattern exemplar-based synthesis exemplar-based texture synthesis sample texture target region computational efficiency object contour filling proceeds actual color value thin scratch latter focus one-dimensional pattern digital image structure information best-first algorithm linear structure inpainting technique small image gap block-based sampling process synthetic image new algorithm first note large object texture synthesis algorithm structure propagation plausible way
