Rate-distortion optimized interactive light field streaming

DMCA

Rate-distortion optimized interactive light field streaming (2007)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Prashant Ramanathan , Mark Kalman , Bernd Girod

Venue:	IEEE Transactions on Multimedia
Citations:	9 - 1 self

BibTeX

@ARTICLE{Ramanathan07rate-distortionoptimized,
    author = {Prashant Ramanathan and Mark Kalman and Bernd Girod},
    title = {Rate-distortion optimized interactive light field streaming},
    journal = {IEEE Transactions on Multimedia},
    year = {2007},
    volume = {9},
    pages = {813--825}
}

OpenURL

Abstract

Abstract—High-quality, photorealistic image-based rendering datasets are typically too large to download entirely before viewing, even when compressed. It is more suitable to instead stream the required image data to a remote user who can start interacting with the dataset immediately. This paper presents an interactive light field streaming system and proposes packet scheduling for transmitting the encoded image data in a rate-distortion optimized manner. An interactive light field streaming system must have low user latency. The system presented in this paper predicts the future user viewing trajectory to mitigate the effects of the low-latency constraints. Experimental results show that view prediction can improve performance, and that this improvement is limited by the prediction accuracy. The proposed packet scheduling algorithm considers network conditions and rate-distortion cost, knowledge of sent and received images, and the distortion for a set of images, to optimize the rendered image quality for the remote user. Rate-distortion optimized scheduling can be implemented either at the receiver or the sender. It is shown that this rate-distortion optimized packet scheduling can significantly improve performance over a heuristic scheduling approach. Experimental results also show that the encoding prediction dependency structure affects streaming performance both through the compression efficiency of the encoding and also through any decoding dependencies that may be introduced. Index Terms—Image-based rendering, image coding, image communication, interactive streaming, light field coding, light field streaming, light fields, rate-distortion optimized streaming. I.

Keyphrases

interactive light field remote user experimental result abstract high-quality required image data prediction dependency structure heuristic scheduling approach packet scheduling image communication low-latency constraint interactive streaming light field encoded image data rate-distortion cost decoding dependency index term image-based rendering prediction accuracy rendered image quality light field streaming future user light field coding photorealistic image-based rendering datasets image coding rate-distortion optimized manner compression efficiency view prediction low user latency algorithm considers network condition

DMCA