The Effect of Depth Compression on Multiview Rendering Quality

2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2009

The paper deals with prospective 3D video transmission systems that would use compression of both multiview video and depth maps. The paper addresses the problem of quality of views synthesized from other views transmitted together with depth information. For the state-of-the-art depth map estimation and view synthesize techniques, the paper proves that AVC/SVC-based Multiview Video Coding technique can be used for compression of both view pictures and depth maps. The paper reports extensive experiments where synthesized video quality has been estimated by use of both PSNR index and subjective assessment. Defined is the critical value of depth quantization parameter as a function of the reference view quantization parameter. For smaller depth map quantization parameters, depth map compression has negligible influence on fidelity of synthesized views.

2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2009

This paper presents a novel strategy for the compression of depth maps. The proposed scheme starts with a segmentation step which identifies and extracts edges and main objects, then it introduces an efficient compression strategy for the segmented regions' shape. In the subsequent step a novel algorithm is used to predict the surface shape from the segmented regions and a set of regularly spaced samples. Finally the few prediction residuals are efficiently compressed using standard image compression techniques. Experimental results show that the proposed scheme not only offers a significant gain over JPEG2000 on various types of depth maps but also produces depth maps without edge artifacts particularly suited to 3D warping and free viewpoint video applications.

2005

DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the "Taverne" license above, please follow below link for the End User Agreement:

Computer Standards & Interfaces, 1999

DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the "Taverne" license above, please follow below link for the End User Agreement:

Journal of the Optical Society of America A, 2011

The third dimension in the reproduction of real scenes in three-dimensional displays is commonly subject to scale changes. The geometry of the situation is laid out, permitting the depth rendition of displays to be characterized and subjected to empirical examination. Psychophysical experiments are presented showing, even when geometrical deformations have been factored out, specific deviations from veridicality in observers' depth reports for stereograms of simple static patterns devoid of secondary cues.

28th Picture Coding Symposium, 2010

Multi-view video plus depth (MVD) data is a set of multiple sequences capturing the same scene at different viewpoints, with their associated per-pixel depth value. Overcoming this large amount of data requires an effective coding framework. Yet, a simple but essential question refers to the means assessing the proposed coding methods. While the challenge in compression is the optimization of the rate-distortion ratio, a widely used objective metric to evaluate the distortion is the Peak-Signal-to-Noise-Ratio (PSNR), because of its simplicity and mathematically easiness to deal with such purposes. This paper points out the problem of reliability, concerning this metric, when estimating 3D video codec performances. We investigated the visual performances of two methods, namely H.264/MVC and Locally Adaptive Resolution (LAR) method, by encoding depth maps and reconstructing existing views from those degraded depth images. The experiments revealed that lower coding efficiency, in terms of PSNR, does not imply a lower rendering visual quality and that LAR method preserves the depth map properties correctly.

2015

Computing and visual display technologies have made great advances in the last few decades in terms of the interface between man and machine. Many computer applications today make use of 3D interactive computer graphics. Ocular depth is perceived when our visual system combines various different sources of information, which are normally called depth cues, around a scene. This information plays an important role in our life. For example, receiving accurate information about the depth of a scene will save time and effort to a surgeon when performing a surgical operation. The main aim of the dissertation is to improve the impression of depth perception when visualise a multiple-layered computer-generated imagery (CGI). Three experiments were achieved: (1) to investigate which monocular cue provides a better impression of depth when other cues are not available, (2) to perform an evaluation to find which type of translucency among the two common types has a stronger effect on the depth...

2012

ABSTRACT 3D quality of experience (QoE) in nature is a multidimensional problem and involves many factors that contribute to the global quality rating such as image quality, depth perception and visual discomfort. One important aspect for the development and evaluation of 3D processing techniques is the selection of appropriate 3D content.

Eighth IEEE International Symposium on Multimedia (ISM'06), 2006

Multimedia content is becoming more widely used in applications resulting from the easy accessibility of high-speed networks in the public domain. An important component in multimedia content is 3D geometry, which in the past had low resolution due to acquisition, computational and network limitation, and was not able to approximate 3D surfaces realistically. Although processing speed and network capacity have been greatly increased in the last decade, the increase in demands for multimedia content surpass the increase in resources. Consequently, techniques for data simplification especially for 3D mesh data is inevitable in order to achieve shorter latency and satisfactory interactivity in applications. This paper presents a perceptual analysis to evaluate the visual quality associated with a change in level-of-detail. Our analysis is consistent to how the human visual system evaluates 3D objects in the real world and is based on the Just-Noticeable-Difference methodology. Experimental results show that our approach presents an accurate estimation of visual quality and thus provides a systematic method to evaluate the performance of different simplification algorithms.

ITE transactions on media technology and applications, 2022

This paper introduces an adaptive depth compression method that enables content directors to express their intensions on 3D views on light-field displays with limited depth reconstruction capability. Depth compression methods have demonstrated that scenes with significant depth can be shown with appealing subjective quality by contracting scene depth taking into account the characteristics of the human vision. The present study extends the method to add more flexibility on the 3D expressions. We introduced a new depth remapping function with many parameters and optimized the parameter values to satisfy directors' production demands under the constraints of depth reconstruction capability and subjective quality. Objective and subjective evaluation experiments showed that the proposed method allocated sufficient depth to specific objects always in animated scenes and provided a stronger sense of depth and preferable 3D expressions. These results suggest that our method will expand the availability of light-field displays in future 3DTV service.