Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images

Che-Han Chang, Chia-Kai Liang, and Yung-Yu Chuang

National Taiwan University

IEEE Transactions on Multimedia 2011

Algorithm overview. The top row shows the left view and second row shows the right view. (a) The input binocular image pair, (b) their saliency maps, (c) quad importance maps, (d) original images with grid meshes and feature points, (e) retargeted image pair with deformed grid meshes and relocated feature points, and (f) retargeted image pair.

Abstract

We propose a content-aware stereoscopic image display adaptation method which simultaneously resizes a binocular image to the target resolution and adapts its depth to the comfort zone of the display while preserving the perceived shapes of prominent objects. This method does not require depth information or dense correspondences. Given the specification of the target display and a sparse set of correspondences, our method efficiently deforms the input stereoscopic images for display adaptation by solving a least-squares energy minimization problem. This can be used to adjust stereoscopic images to fit displays with different real estates, aspect ratios, and comfort zones. In addition, with slight modifications to the energy function, our method allows users to interactively adjust the sizes, locations, and depths of the selected objects, giving users aesthetic control for depth perception. User studies show that the method is effective at editing depth and reducing occurrences of diplopia and distortions.

Download

[PDF (high resolution, 31.1MB)]
[PDF (low resolution, 1.5MB)]
[BibTex]

Results

Resizing with different aspect ratios.    Red/cyan anaglyph    Cross-eyed viewing
Input 0.75x width 1.5x width
Depth adaptation with different scale factors of depth.    Red/cyan anaglyph    Cross-eyed viewing
Input Scale down Scale up
Simultaneous resizing and depth adaptation.    Red/cyan anaglyph    Cross-eyed viewing
Input Linear scaling Our result