Rendering Synthetic Objects into Legacy Photographs

DMCA

Rendering Synthetic Objects into Legacy Photographs

Cached

Download Links

by Kevin Karsch , Varsha Hedau , David Forsyth , Derek Hoiem

Citations:

33 - 3 self

BibTeX

@MISC{Karsch_renderingsynthetic,
    author = {Kevin Karsch and Varsha Hedau and David Forsyth and Derek Hoiem},
    title = {Rendering Synthetic Objects into Legacy Photographs},
    year = {}
}

OpenURL

Abstract

Figure 1: With only a small amount of user interaction, our system allows objects to be inserted into legacy images so that perspective, occlusion, and lighting of inserted objects adhere to the physical properties of the scene. Our method works with only a single LDR photograph, and no access to the scene is required. We propose a method to realistically insert synthetic objects into existing photographs without requiring access to the scene or any additional scene measurements. With a single image and a small amount of annotation, our method creates a physical model of the scene that is suitable for realistically rendering synthetic objects with diffuse, specular, and even glowing materials while accounting for lighting interactions between the objects and the scene. We demonstrate in a user study that synthetic images produced by our method are confusable with real scenes, even for people who believe they are good at telling the difference. Further, our study shows that our method is competitive with other insertion methods while requiring less scene information. We also collected new illumination and reflectance datasets; renderings produced by our system compare well to ground truth. Our system has applications in the movie and gaming industry, as well as home decorating and user content creation, among others.

Keyphrases

synthetic object legacy photograph small amount single ldr photograph physical property single image glowing material home decorating scene information legacy image ground truth physical model additional scene measurement user content creation real scene gaming industry user interaction inserted object new illumination insertion method synthetic image user study reflectance datasets

DMCA