MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  Real-time Cartoon-like Stylization of AR Video Streams on the GPU

Download:
Download as a PDF
by Jan Fischer, Dirk Bartz
http://www.gris.uni-tuebingen.de/publics/paper/Fischer-2005-Realtime.pdf
Add To MetaCart

Abstract:

The ultimate goal of many applications of augmented reality is to immerse the user into the augmented scene, which is enriched with virtual models. In order to achieve this immersion, it is necessary to create the visual impression that the graphical objects are a natural part of the user’s environment. Producing this effect with conventional computer graphics algorithms is a complex task. Various rendering artifacts in the three-dimensional graphics create a noticeable visual discrepancy between the real background image and virtual objects. We have recently proposed a novel approach to generating an augmented video stream. With this new method, the output images are a non-photorealistic reproduction of the augmented environment. Special stylization methods are applied to both the background camera image and the virtual objects. This way the visual realism of both the graphical foreground and the real background image is reduced, so that they are less distinguishable from each other. Here, we present a new method for the cartoon-like stylization of augmented reality images, which uses a novel post-processing filter for cartoon-like color segmentation and high-contrast silhouettes. In order to make a fast postprocessing of rendered images possible, the programmability of modern graphics hardware is exploited. We describe an implementation of the algorithm using the OpenGL Shading Language. The system is capable of generating a stylized augmented video stream of high visual quality at real-time frame rates. As an example application, we demonstrate the visualization of dinosaur bone datasets in stylized augmented reality. 1.

Citations

183 A survey of Augmented Reality. Presence: Teleoperators and Virtual Environments – Azuma - 1997
173 Bilateral filtering for gray and color images – TOMASI, MANDUCHI - 1998
153 Digital image processing – Pratt - 1991
151 tracking and hmd calibration for a video-based augmented reality conferencing sistem – Marker - 1999
79 OpenGL Programming Guide – Woo, Neider, et al. - 1997
68 Stylization and abstraction of photographs – DECARLO, SANTELLA - 2002
50 Painterly rendering for video and interaction – HERTZMANN, PERLIN - 2000
31 Open GL shading language – ROST - 2004
21 Video tooning – WANG, XU, et al. - 2004
14 A Real-time Shadow Approach for an Augmented Reality Application using Shadow Volumes – Haller, Drab, et al. - 2003
12 Stylized Augmented Reality for Improved Immersion – FISCHER, BARTZ, et al. - 2005
10 Hardware-based nonlinear filtering and segmentation using high-level shading languages – Viola, Kanitsar, et al. - 2003
9 Photorealistic Rendering for Augmented Reality using Environment Illumination – Agusanto, Li, et al. - 2003
9 Three Varieties of Realism in Computer Graphics – Ferwerda - 2003
8 The Effects of Shadow Representation of Virtual Objects in Augmented Reality – Sugano, Kato, et al. - 2003
6 Real-Time Painterly Rendering for MR Applications – Haller, Sperl - 2004
6 Videoorbits on eye tap devices for deliberately diminished reality or altering the visual perception of rigid planar patches of a real world scene – Mann, Fung - 2001
5 Photorealism or/and non-photorealism in augmented reality – HALLER - 2004
3 Geometric and Photometric Registration for Real-Time Augmented Reality (posters and demo session – Kanbara, Yokoya - 2002
2 Non-Photorealistic Rendering. A K Peters, 2nd edition – Gooch, Gooch - 2001
2 Interactive Mediated Reality (poster – Grasset, Gascuel, et al. - 2003
1 The OpenGL R○ Shading Language (v1.10). http://www.opengl.org/documentation/oglsl.html – Kessenich, Baldwin, et al. - 2004