Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Coding-Related Issues
Conclusions
References
All Topics
Psychology
Experimental and Cognitive Psychology

Stereo/multiview picture quality: Overview and recent advances

Profile image of Stefan WinklerStefan Winkler

2013, Signal Processing: Image Communication

https://doi.org/10.1016/J.IMAGE.2013.07.008
visibility

…

description

37 pages

link

1 file

Abstract

Stereoscopic 3D content brings with it a variety of complex technological and perceptual issues. For the percept of depth to be convincing, consistent, and comfortable, a large number of parameters throughout the imaging and processing pipeline need to be matched correctly. In practice, tradeoffs are inevitable, which may then affect the quality or comfort of the 3D viewing experience. This paper reviews stereo/multiview picture quality from an engineering perspective. With a focus on recent or emerging approaches and technologies used in 3D systems, it addresses in particular depth issues, multiview issues, display issues, viewer issues, as well as possible measurements and standards for 3D quality.

Related papers

Quality Assessment of Stereoscopic Images
alexandre benoit

EURASIP Journal on Image and Video Processing, 2008

Several metrics have been proposed in literature to assess the perceptual quality of two-dimensional images. However, no similar effort has been devoted to quality assessment of stereoscopic images. Therefore, in this paper, we review the different issues related to 3D visualization, and we propose a quality metric for the assessment of stereopairs using the fusion of 2D quality metrics and of the depth information. The proposed metric is evaluated using the SAMVIQ methodology for subjective assessment. Specifically, distortions deriving from coding are taken into account and the quality degradation of the stereopair is estimated by means of subjective tests.

View PDFchevron_right
A comprehensive database and subjective evaluation methodology for quality of experience in stereoscopic video
Touradj Ebrahimi

2010

ABSTRACT While objective and subjective quality assessment of 2D images and video have been an active research topic in the recent years, emerging 3D technologies require new quality metrics and methodologies taking into account the fundamental differences in the human visual perception and typical distortions of stereoscopic content.

View PDFchevron_right
Stereoscopic image quality assessment based on the binocular properties of the human visual system
Christine Fernandez-Maloigne

2017

With the increasing growth of multimedia applications over the networking in recent years, users have put forward much higher requirements for multimedia signals, particularly for image/video signal's quality of experience (QoE) than before. The objective approach of image quality assessment (IQA) plays an important role for the development of compression standards and various multimedia applications. However, the quality assessment of stereoscopic (3-D) images faces more new challenges, such as depth perception, virtual view synthesis, and asymmetric stereo compression. In this paper, we propose a new full-reference (FR) 3-D IQA method to measure the quality of the distorted images. The properties of the depth component, structure component, and gradient component are taken into account to establish the proposed metric. The experimental results show that the proposed metric is highly consistent with the subjective test scores compared with the existing related metrics. In addition, the main significance of the proposed metric is that it not only could effectively evaluate the quality of 3-D image but also has a satisfied effect for measuring the quality of 2-D image. Index Terms-Depth map, full-reference (FR), image quality assessment (IQA), quality of experience (QoE), three-dimensional (3-D) image. I. INTRODUCTION I N recent years, with the high-speed development of the communication systems, the multimedia applications over the networking have grown rapidly for many fields, such as live broadcast, video on demand, real-time conferencing, and so on [1] and [2]. People can have the access to use the network on any facilities, anyplace, and anytime. Consequently, the user have put forward much higher requirements for the quality of the multimedia signals than before; in particular, the video/image quality at the terminal is becoming the representative one in abundant emerging multimedia quality of experience (QoE). Currently, 3-D media services have been widely using Manuscript

View PDFchevron_right
Impact of acquisition distortions on the quality of stereoscopic images
Touradj Ebrahimi

2010

ABSTRACT While objective and subjective quality assessment of 2D images and video has been an active research topic in the recent years, emerging 3D technologies require new quality metrics and methodologies taking into account the fundamental differences in the human visual perception and typical distortions of stereoscopic content.

View PDFchevron_right
A New Metric of Image Quality Assessment for Stereoscopic Content
Christine Fernandez-Maloigne

2015 Data Compression Conference, 2015

Automatic or semi-automatic stereoscopic image quality assessment has arisen due to the recent diffusion of a new generation of stereoscopic technologies and content demand. Thereby, there is a growth in asking for algorithms of Stereoscopic Image Quality Metrics (SIQA). In this paper, we present a method for assessing the stereoscopic image quality, QUALITAS. QUALITAS is grounded on some human visual system features such as contrast sensitivity, effect of disparate image quality in left and right images, and distance perception, which do not depend on the images being tested. QUALITAS is defined in five stages. Instead of averaging individual qualities of the stereo-pair, QUALITAS introduces Contrast Band-Pass Filtering on a wavelet domain at both views, namely our algorithm perceptually weights left and right images depending on certain viewing conditions. This paper includes the comparison of 27 Metrics SIQA proposed by 16 authors, which summarizes the work made in this field in the recent five years, on image database LIVE 3D. Some algorithms can be combined with any 2D/Normal Image Quality Assessments (NIQA), giving as a result that QUALITAS was compared against 221 Metrics. QUALITAS obtained the best results in terms of overall performance of correlation coefficients. We conclude all metrics in SIQA-SET are simple modifications of NIQA, which take into account some extra characteristics from the disparity map (usually depth variances). Instead QUALITAS incorporates disparity masking in addition to divide 3D scenario in two parts: background and foreground planes. Moreover QUALITAS employs a contrast bandpass filtering, so dynamic parameters are considered as observational distance. It includes loss of correlation, luminance and contrast distortion. It takes into account the visual differences between left and right images, employing a penalization depending on their wavelet energy. Thus, the novelty of QUALITAS lies in combining some the best features of stereoscopic image quality assessments.

View PDFchevron_right
Improving Perceptual Quality of 3DTV Systems
Varuna De Silva

3D video has become a buzzword in the recent years within the entertainment industry. It has the capability to enhance the multimedia experience of viewers by providing an added sensation of depth. Stereoscopic 3D video has already made its mark in the cinema industry in the recent past with wide consumer acceptance of Hollywood blockbusters such as 'Avatar'. Driven by the developments in capturing techniques, display technologies, storage and fibre optic broadband technologies, the entertainment industry is now focused on delivering 3D media to the home entertainment systems and mobile devices. In the light of these developments, this thesis presents several models and techniques to perceptually optimize production, compression, transmission and quality evaluation stages of the 3D video distribution chain. The thesis begins by deriving a mathematical model that quantifies the sensitivity of the human visual system for depth cues provided by a stereoscopic 3D display, such as binocular disparity, retinal blur and relative size cue. The applications of the derived sensitivity models are illustrated by developing a novel 3D video pre-processing technique and a 3D video assessment method. The depth maps are an aid for virtual view generation process in DIBR applications. However, depth map estimation techniques are yet to mature. The quality of virtual views, which are required for multiview displays, generated with DIBR algorithms depends on the quality/accuracy of the depth maps. Therefore, the depth maps need to be processed and compressed in a way that is suitable for virtual view generation. However, depth map estimation techniques are yet to mature. Therefore, this thesis presents a pre-processing technique based on the sensitivity models derive, which eliminates optical noise in depth maps due to production imperfections. The next part of this thesis presents novel techniques to compress depth maps used in DIBR applications. To compress depth maps in a way that is suitable for virtual view generation process, a novel object based coding technique, which exploits the correlations that exist between the color image and its corresponding depth maps, is proposed. In an attempt to adapt the existing video codecs to encode depth maps in such a way that the rendering artefacts are minimised, two techniques are proposed in this thesis to optimize the encoding mode selection strategy in a H.264 video codec. The first technique is based on Genetic Algorithms and the other is based on an analytical model that approximate rendering errors caused by depth pixel errors. Furthermore, an adaptive bilateral filter that could be implemented as a decoder based post-processing filter is proposed to reduce the effects of quantization of depth maps, to improve the quality of rendered views. Finally, this thesis addresses two issues related to the transmission of 3D video over error-prone channels. Firstly, the error propagation characteristics of interview predicted stereoscopic video streams is compared against independent encoding of stereoscopic views at various packet loss rates. Secondly, transmission of color plus depth represented 3D video is compared against the stereoscopic 3D video under detrimental channel conditions. Significant improvements have been made by the proposed techniques over the existing methods. It is expected that the proposed models and techniques will have important use cases in advanced 3D video distribution systems.

View PDFchevron_right
The effect of stereoscopic acquisition parameters on both distortion and comfort
Rob Black

The purpose of our experiments was to investigate the effect of interaxial camera separation on the perceived shape and viewing comfort of 3D images. Horizontal Image Translation (HIT) and interaxial distance were altered together. Following Banks et al (2009), our stimuli were simple stereoscopic hinges and we measured the perceived angle as a function of camera separation. We compared the predictions based on ray tracing with the perceived 3D shape obtained psychophysically. 40 participants were asked to judge the angles of 250 hinges at different camera separations (interaxial and HIT linked a 20-100mm; angle range: 50°-130°). Comfort data was obtained using a five point Likert scale. Stimuli were presented in orthoscopic conditions with screen and observer Field of View (FOVO) matched at 45°. Our main results are: (1) For the 60mm camera separation, observers perceived a right angle correctly, but at other camera separations right angles were perceived as larger than 90° (camera separations > 60mm) or smaller than 90° (camera separations < 60 mm).

View PDFchevron_right
Using disparity for quality assessment of stereoscopic images
Alexandre Benoit

2008 15th IEEE International Conference on Image Processing, 2008

3DTV has been widely studied these last years from a technical point of view but the related quality evaluations does not follow this enthusiasm. This article reviews the quality assessment for 3DTV. Compared to 2D quality measure, the third dimension adds several new problems and quality assessment becomes a complex issue. Nevertheless, efforts made for 2D content quality estimation can be used for an extension to 3D. In this paper we propose a first attempt to adapt such 2D metrics to 3D content and add the contribution of a measure of the distortion on the disparity map for stereoscopic image pairs. This 3D metric performances has been evaluated with subjective tests.

View PDFchevron_right
Subjective and Objective Visual Quality Assessment in the Context of Stereoscopic 3D-TV
Kjell Brunnström

3D-TV System with Depth-Image-Based Rendering, 2012

Objective visual quality assessment of 3D models is a fundamental issue in computer graphics. Quality assessment metrics may allow a wide range of processes to be guided and evaluated, such as level of detail creation, compression, filtering, and so on. Most computer graphics assets are composed of geometric surfaces on which several texture images can be mapped to make the rendering more realistic. While some quality assessment metrics exist for geometric surfaces, almost no research has been conducted on the evaluation of texture-mapped 3D models. In this context, we present a new subjective study to evaluate the perceptual quality of textured meshes, based on a paired comparison protocol. We introduce both texture and geometry distortions on a set of 5 reference models to produce a database of 136 distorted models, evaluated using two rendering protocols. Based on analysis of the results, we propose two new metrics for visual quality assessment of textured mesh, as optimized linear combinations of accurate geometry and texture quality measurements. These proposed perceptual metrics outperform their counterparts in terms of correlation with human opinion. The database, along with the associated subjective scores, will be made publicly available online.

View PDFchevron_right
Using binocular and monocular properties for the construction of a quality assessment metric for stereoscopic images
Christine Fernandez-Maloigne

More and more people are getting access to 3D; 3D-TV is a next expecting step in telecommunication. Before being presented to the public, any 3D content has to be coded, compressed and transmitted. All these treatments can impact the quality of the nal product, thus it is essential to have a measurement tool for the estimation of the quality of stereoscopic content. Several studies have already modi ed the existing 2D quality metrics to be able evaluate 3D images, however the results are not satisfying. In this work, we propose a full-reference metric for a quality assessment of stereoscopic images employing the properties of binocular perception. The principle of the metric estimates the probability of fusion, that can be obtained perceptually. The quality of one view is assessed relatively to the other, and according to the result metric makes a decision, that is based on the binocular fusion properties. The comparison between views is performed only on the salient area. It is detected using the visual attention model based on the monocular depth cues and interest points. The metric has been tested on the publicly available dataset, and its results are coherent to the subjective scores. Keywords: S3D quality assessment, 3D imaging, Quality of experience, binocular perception

View PDFchevron_right

References (159)

  1. S. Winkler and P. Mohandas, "The evolution of video quality measurement: From PSNR to hybrid metrics," IEEE Trans. Broadcasting, vol. 54, no. 3, pp. 660-668, Sept. 2008, invited paper.
  2. L. M. J. Meesters, W. A. IJsselsteijn, and P. J. H. Seuntiëns, "A survey of perceptual evaluations and requirements of three-dimensional TV," IEEE Trans. Circ. Syst. Video Tech., vol. 14, no. 3, March 2004.
  3. S. Kim, J. Yoshitake, H. Morikawa, T. Kawai, O. Yamada, and A. Iguchi, "Psycho-physiological effects of visual artifacts by stereoscopic display systems," in Proc. SPIE, vol. 7863, San Jose, CA, Jan. 23-27, 2011.
  4. A. G. Solimini, A. Mannocci, D. Di Thiene, and G. La Torre, "A survey of visually induced symptoms and associated factors in spectators of three dimensional stereoscopic movies," BMC Public Health, vol. 12, no. 779, 2012.
  5. S. J. Daly, R. T. Held, and D. M. Hoffman, "Perceptual issues in stereoscopic signal processing," IEEE Trans. Broadcasting, vol. 57, no. 2, pp. 347-361, 2011.
  6. M. S. Banks, J. C. A. Read, R. S. Allison, and S. J. Watt, "Stereoscopy and the human visual system," SMPTE Motion Imaging J., vol. 121, no. 4, pp. 24-43, May 2012.
  7. I. P. Howard and B. J. Rogers, Perceiving in Depth. Oxford University Press, 2012.
  8. L. Zhang, S. Daly, O. Grau, N. Hur, and W. J. Tam, "Special issue on 3D-TV horizon: Contents, systems, and visual perception," IEEE Trans. Broadcasting, vol. 57, no. 2, June 2011.
  9. S. Winkler and D. Min, "Stereoscopic image quality compendium," in Proc. ICICS, Singapore, Dec. 13-16, 2011.
  10. R. Blake and R. Sekuler, Perception, 5 th ed. McGraw-Hill, 2005.
  11. S. Reichelt, R. Häussler, G. Fütterer, and N. Leister, "Depth cues in human visual perception and their realization in 3D displays," in Proc. SPIE, vol. 7690, Orlando, FL, April 6-8, 2010.
  12. J. Cutting and P. Vishton, "Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth," in Perception of Space and Motion, W. Epstein and S. Rogers, Eds. Academic Press, 1995, pp. 69-117.
  13. P. Lebreton, A. Raake, M. Barkowsky, and P. Le Callet, "Evaluating depth perception of 3D stereoscopic videos," IEEE J. Sel. Topics Sig. Proc., vol. 6, no. 6, pp. 710-720, Oct. 2012.
  14. M. Mikkola, S. Jumisko-Pyykkö, D. Strohmeier, A. Boev, and A. Gotchev, "Stereoscopic depth cues outperform monocular ones on autostereoscopic display," IEEE J. Sel. Topics Sig. Proc., vol. 6, no. 6, pp. 698-709, Oct. 2012.
  15. R. Held, E. Cooper, and M. Banks, "Blur and disparity are complementary cues to depth," Current Biology, vol. 22, pp. 426-431, March 2012.
  16. D. Hoffman and M. Banks, "Focus information is used to interpret binocular images," J. Vision, vol. 10, no. 5, 2010.
  17. A. Vetro, "Frame-compatible formats for 3D video distribution," in Proc. ICIP, Hong Kong, Sept. 2010.
  18. W. Chen, J. Fournier, M. Barkowsky, and P. Le Callet, "New requirements of subjective video quality assessment methodologies for 3DTV," in Proc. VPQM, Scottsdale, AZ, Jan. 13-15, 2010.
  19. P. Merkle, A. Smolic, K. Müller, and T. Wiegand, "Multi-view video plus depth representation and coding," in Proc. ICIP, San Antonio, TX, Oct. 2007.
  20. P. Kauff et al., "Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability," Sig. Proc.: Image Comm., vol. 22, no. 2, pp. 217-234, 2007.
  21. K.-J. Yoon and I. Kweon, "Adaptive support-weight approach for correspondence search," IEEE Trans. PAMI, vol. 28, no. 4, pp. 650-656, 2006.
  22. D. Min and K. Sohn, "Cost aggregation and occlusion handling with WLS in stereo matching," IEEE Trans. Image Processing, vol. 17, no. 8, pp. 1431-1442, 2008.
  23. M. F. Tappen and W. T. Freeman, "Comparison of graph cuts with belief propagation for stereo using identical MRF parameters," in Proc. ICCV, Nice, France, Oct. 2003, pp. 900-906.
  24. C. Fehn, "Depth image based rendering (DIBR), compression and transmission for a new approach on 3D-TV," in Proc. SPIE, vol. 5291, San Jose, CA, Jan. 2004, pp. 93-104.
  25. K.-J. Oh, S. Yea, and Y.-S. Ho, "Hole-filling method using depth based in- painting for view synthesis in free viewpoint television (FTV) and 3D video," in Proc. PCS, Chicago, IL, May 2009.
  26. S. Choi, B. Ham, and K. Sohn, "Space-time hole filling with random walks in view extrapolation for 3-D video," IEEE Trans. Image Processing, vol. 22, no. 6, pp. 2429-2441, 2013.
  27. D. Min, D. Kim, S. Yun, and K. Sohn, "2D/3D freeview video generation for 3DTV system," Sig. Proc.: Image Comm., vol. 24, no. 1-2, pp. 31-48, 2009.
  28. J. Shade, S. J. Gortler, L.-W. He, and R. Szeliski, "Layered depth images," in Proc. ACM SIGGRAPH, 1998, pp. 231-242.
  29. L. Zitnick, S. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High- quality video view interpolation using a layered representation," ACM Trans. Graphics, vol. 23, no. 3, pp. 600-608, 2004.
  30. S.-U. Yoon and Y.-S. Ho, "Multiple color and depth video coding using a hierarchical representation," IEEE Trans. Circ. Syst. Video Tech., vol. 17, no. 11, pp. 1450-1460, 2007.
  31. K. Müller, A. Smolic, K. Dix, P. Kauff, and T. Wiegand, "Reliability-based generation and view synthesis in layered depth video," in Proc. MMSP, 2008, pp. 34-39.
  32. S. M. Seitz and C. R. Dyer, "Photorealistic scene reconstruction by voxel coloring," Int. J. Comp. Vis., vol. 35, no. 2, pp. 151-173, 1999.
  33. D. Mahajan, F.-C. Huang, W. Matusik, R. Ramamoorthi, and P. N. Belhumeur, "Moving gradients: A path-based method for plausible image interpolation," ACM Trans. Graphics, vol. 28, no. 3, 2009.
  34. M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M. H. Gross, "Nonlinear disparity mapping for stereoscopic 3D," ACM Trans. Graphics, vol. 29, no. 4, 2010.
  35. W. Matusik and H. Pfister, "3D TV: A scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes," ACM Trans. Graphics, vol. 23, no. 3, pp. 814-824, 2004.
  36. B. Wilburn, N. Joshi, V. Vaish, E.-V. Talvala, E. R. Antúnez, A. Barth, A. Adams, M. Horowitz, and M. Levoy, "High performance imaging using large camera arrays," ACM Trans. Graphics, vol. 24, no. 3, pp. 765-776, 2005.
  37. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. PAMI, vol. 22, no. 11, pp. 1330-1334, 2000.
  38. J. Y. Bouguet, "Camera calibration toolbox for matlab," http://www.vision. caltech.edu/bouguetj/calib doc.
  39. T. Svoboda, D. Martinec, and T. Pajdla, "A convenient multicamera self- calibration for virtual environments," Presence, vol. 14, no. 4, pp. 407-422, 2005.
  40. Point Grey Research, http://www.ptgrey.com/products/multisync/.
  41. G. Litos, X. Zabulis, and G. Triantafyllidis, "Synchronous image acquisition based on network synchronization," in Proc. Computer Vision and Pattern Recognition Workshop (CVPRW), 2006, p. 167.
  42. D. Bradley, B. Atcheson, I. Ihrke, and W. Heidrich, "Synchronization and rolling shutter compensation for consumer video camera arrays," in Proc. PROCAMS, 2009, pp. 1-8.
  43. A. Elhayek, C. Stoll, K. I. Kim, H.-P. Seidel, and C. Theobalt, "Feature-based multi-video synchronization with subframe accuracy," in Proc. DAGM/OAGM Symp., 2012, pp. 266-275.
  44. J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling," ACM Trans. Graphics, vol. 26, no. 3, 2007.
  45. D. Min, J. Lu, and M. N. Do, "Depth video enhancement based on weighted mode filtering," IEEE Trans. Image Processing, vol. 21, no. 3, 2012.
  46. C. Zhang and Z. Zhang, "Calibration between depth and color sensors for commodity depth cameras," in Proc. ICME, 2011, pp. 1-6.
  47. D. Herrera C., J. Kannala, and J. Heikkila, "Joint depth and color camera calibration with distortion correction," IEEE Trans. PAMI, vol. 34, no. 10, pp. 2058-2064, 2012.
  48. I. V. Mikhelson, P. G. Lee, A. V. Sahakian, Y. Wu, and A. K. Katsaggelos, "Automatic, fast, online calibration between depth and color cameras," Vis. Comm. Image Repres., (in press).
  49. A. Staranowicz and G. L. Mariottini, "A comparative study of calibration methods for Kinect-style cameras," in Proc. Int. Conf. on PErvasive Technologies Related to Assistive Environments (PETRA), 2012, p. 49.
  50. L. Zhang, C. Vazquez, and S. Knorr, "3D-TV content creation: Automatic 2D-to-3D video conversion," IEEE Trans. Broadcasting, vol. 57, no. 2, pp. 372-383, 2011.
  51. D. Kim, D. Min, and K. Sohn, "A stereoscopic video generation method using stereoscopic display characterization and motion analysis," IEEE Trans. Broadcasting, vol. 54, no. 2, pp. 188-197, 2008.
  52. M. T. Pourazad, P. Nasiopoulos, and R. K. Ward, "Generating the depth map from the motion information of H.264-encoded 2D video sequence," EURASIP J. Image Video Proc., vol. 2010, 2010, Article ID 108584.
  53. S. Battiato, A. Capra, S. Curti, and M. L. Cascia, "3D stereoscopic image pairs by depth-map generation," in Proc. IEEE 3DPVT, Thessaloniki, Greece, Sept. 2004, pp. 124-131.
  54. K. Moustakas, D. Tzovaras, and M. G. Strintzis, "Stereoscopic video generation based on efficient layered structure and motion estimation from a monoscopic image sequence," IEEE Trans. Circ. Syst. Video Tech., vol. 15, no. 8, pp. 1065-1073, 2005.
  55. G. Zhang, W. Hua, X. Qin, T.-T. Wong, and H. Bao, "Stereoscopic video synthesis from a monocular video," IEEE Trans. Vis. Comput. Graph., vol. 13, no. 4, 2007.
  56. M. Guttmann, L. Wolf, and D. Cohen-or, "Semi-automatic stereo extraction from video footage," in Proc. ICCV, Kyoto, Japan, Oct. 2009, pp. 136-142.
  57. M. Liao, J. Gao, R. Yang, and M. Gong, "Video stereolization: Combining motion analysis with user interaction," IEEE Trans. Vis. Comput. Graph., vol. 18, no. 7, pp. 1079-1088, July 2012.
  58. ISO/IEC JTC1/SC29/WG11, "Call for proposals on 3D video coding technology," MPEG2011/N12036, 2011.
  59. A. Vetro, T. Wiegand, and G. J. Sullivan, "Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard," Proc. IEEE, vol. 99, no. 4, pp. 626-642, 2011.
  60. P. Merkle, K. Müller, A. Smolic, and T. Wiegand, "Efficient compression of multi-view video exploiting inter-view dependencies based on H.264/MPEG4- AVC," in Proc. ICME, 2006, pp. 1717-1720.
  61. J.-H. Hur, S. Cho, and Y.-L. Lee, "Adaptive local illumination change compensation method for H.264/AVC-based multiview video coding," IEEE Trans. Circ. Syst. Video Tech., vol. 17, no. 11, pp. 1496-1505, 2007.
  62. J. H. Kim et al., "New coding tools for illumination and focus mismatch compensation in multiview video coding," IEEE Trans. Circ. Syst. Video Tech., vol. 17, no. 11, pp. 1519-1535, 2007.
  63. S. Yea and A. Vetro, "View synthesis prediction for multiview video coding," Sig. Proc.: Image Comm., vol. 24, no. 1-2, pp. 89-100, 2009.
  64. P. Merkle, Y. Morvan, A. Smolic, D. Farin, K. Müller, P. H. N. de With, and T. Wiegand, "The effects of multiview depth video compression on multiview rendering," Sig. Proc.: Image Comm., vol. 24, no. 1-2, pp. 73-88, 2009.
  65. M. Maitre and M. N. Do, "Joint encoding of the depth image based representation using shape-adaptive wavelets," in Proc. ICIP, San Diego, CA, Oct. 2008.
  66. K.-J. Oh, A. Vetro, and Y.-S. Ho, "Depth coding using a boundary reconstruction filter for 3-D video systems," IEEE Trans. Circ. Syst. Video Tech., vol. 21, no. 3, pp. 350-359, 2011.
  67. V.-A. Nguyen, D. Min, and M. N. Do, "Efficient techniques for depth video compression using weighted mode filtering," IEEE Trans. Circ. Syst. Video Tech., vol. 23, no. 2, pp. 189-202, Feb. 2013.
  68. P. Benzie et al., "A survey of 3DTV displays: Techniques and technologies," IEEE Trans. Circ. Syst. Video Tech., vol. 17, no. 11, pp. 1647-1658, 2007.
  69. H. Jorke and M. Fritz, "Advanced stereo projection using interference filters," J. Society for Information Display, vol. 17, no. 5, pp. 407-410, May 2009.
  70. N. S. Holliman, N. A. Dodgson, G. E. Favalora, and L. Pockett, "Three- dimensional displays: A review and applications analysis," IEEE Trans. Broadcasting, vol. 57, no. 2, pp. 263-371, June 2011.
  71. K. M. Schreiber, J. M. Hillis, H. R. Filippini, C. M. Schor, and M. S. Banks, "The surface of the empirical horopter," J. Vision, vol. 8, no. 3, pp. 1-20, March 2008.
  72. ANSI/SCTE 187-3, "Informative guidance for stereoscopic video," American National Standards Institute and Society of Cable Telecommunications Engineers, 2012.
  73. Y. Nojiri, H. Yamanoue, S. Ide, S. Yano, and F. Okano, "Parallax distribution and visual comfort on stereoscopic HDTV," in Proc. IBC, Amsterdam, 2006.
  74. D. M. Hoffman, A. R. Girshick, K. Akeley, and M. S. Banks, "Vergence- accommodation conflicts hinder visual performance and cause visual fatigue," J. Vision, vol. 8, no. 3, March 2008.
  75. K. Ukai and P. Howarth, "Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations," Displays, vol. 29, no. 2, pp. 106-116, Feb. 2008.
  76. W. Chen, J. Fournier, M. Barkowsky, and P. Le Callet, "New stereoscopic video shooting rule based on stereoscopic distortion parameters and comfortable viewing zone," in Proc. SPIE, vol. 7863, San Jose, CA, Jan. 23-27, 2011.
  77. J. L. Semmlow and D. Heerema, "The role of accommodative convergence at the limits of fusional vergence," Inv. Ophthalmol. Vis. Sci., vol. 18, no. 9, pp. 970-976, Sept. 1979.
  78. T. Shibata, J. Kim, D. M. Hoffman, and M. S. Banks, "The zone of comfort: Predicting visual discomfort with stereo displays," J. Vision, vol. 11, no. 8, July 2011.
  79. S. Yano, S. Ide, T. Mitsuhashi, and H. Thwaites, "A study of visual fatigue and visual comfort for 3D HDTV/HDTV images," Displays, vol. 23, no. 4, pp. 191-201, April 2002.
  80. S. Yano, M. Emoto, and T. Mitsuhashi, "Two factors in visual fatigue caused by stereoscopic HDTV images," Displays, vol. 25, no. 9, pp. 141-150, Sept. 2004.
  81. W. J. Tam, F. Speranza, S. Yano, K. Shimono, and H. Ono, "Stereoscopic 3D- TV: Visual comfort," IEEE Trans. Broadcasting, vol. 57, no. 2, pp. 335-346, June 2011.
  82. C. Schor and C. Tyler, "Spatio-temporal properties of Panum's fusional area," Vision Res., vol. 21, no. 5, pp. 683-692, 1981.
  83. S. J. Koppal et al., "A viewer-centric editor for 3D movies," IEEE Computer Graphics and Applications, vol. 31, no. 1, pp. 20-35, 2011.
  84. D. Kim and K. Sohn, "Visual fatigue prediction for stereoscopic image," IEEE Trans. Circ. Syst. Video Tech., vol. 21, no. 2, pp. 231-236, Feb. 2011.
  85. C. Fehn and R. Pastoor, "Interactive 3-D TV -concepts and key technologies," Proc. IEEE, vol. 94, no. 3, pp. 524-538, 2006.
  86. D. K. Broberg, "Guidance for horizontal image translation (HIT) of high definition stereoscopic video production," in Proc. SPIE, vol. 7863, San Jose, CA, Jan. 23-27, 2011.
  87. F. Devernay, S. Duchene, and A. Ramos-Peon, "Adapting stereoscopic movies to the viewing conditions using depth-preserving and artifact-free novel view synthesis," in Proc. SPIE, vol. 7863, 2011.
  88. C.-H. Chang, C.-K. Liang, and Y.-Y. Chuang, "Content-aware display adaptation and interactive editing for stereoscopic images," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 589-601, 2011.
  89. T. Basha, Y. Moses, and S. Avidan, "Stereo seam carving a geometrically consistent approach," IEEE Trans. PAMI, vol. 35, no. 10, pp. 2513-2525, Oct. 2013.
  90. S. Avidan and A. Shamir, "Seam carving for content-aware image resizing," ACM Trans. Graph., vol. 26, no. 3, July 2007.
  91. S.-W. Jung and S.-J. Ko, "Depth sensation enhancement using the just noticeable depth difference," IEEE Trans. Image Processing, vol. 21, no. 8, pp. 3624-3637, 2012.
  92. V. De Silva, A. Fernando, S. Worrall, H. K. Arachchi, and A. M. Kondoz, "Sensitivity analysis of the human visual system for depth cues in stereoscopic 3-D displays," IEEE Trans. Multimedia, vol. 13, no. 3, pp. 498-506, 2011.
  93. C. Thébault, D. Doyen, P. Routhier, and T. Borel, "Automatic depth grading tool to successfully adapt stereoscopic 3D content to digital cinema and home viewing environments," in Proc. SPIE, vol. 8648, San Jose, CA, 2013.
  94. H. Ujike and H. Watanabe, "Effects of stereoscopic presentation on visually induced motion sickness," in Proc. SPIE, vol. 7863, San Jose, CA, Jan. 23-27, 2011.
  95. S.-N. Yang, T. Schlieski, B. Selmins, S. Cooper, R. Doherty, P. J. Corriveau, and J. E. Sheedy, "Stereoscopic viewing and reported perceived immersion and symptoms," Optometry & Vision Science, vol. 89, no. 7, pp. 1068-1080, July 2012.
  96. D. A. Wismeijer, C. J. Erkelens, R. van Ee, and M. Wexler, "Depth cue combination in spontaneous eye movements," J. Vision, vol. 10, no. 6, June 2010.
  97. A. Saxena, S. H. Chung, and A. Y. Ng, "3-D depth reconstruction from a single still image," Int. J. Comp. Vis., vol. 76, no. 1, pp. 53-69, Jan. 2008.
  98. J. Schild and M. Masuch, "Designing stereoscopic information visualization for 3D-TV: What can we can learn from S3D gaming?" in Proc. SPIE, vol. 8288, San Jose, CA, Jan. 2012.
  99. M. Lambooij, M. J. Murdoch, W. A. IJsselsteijn, and I. Heynderickx, "The impact of video characteristics and subtitles on visual comfort of 3D TV," Displays, vol. 34, no. 1, Jan. 2013.
  100. Z. Arican, S. Yea, A. Sullivan, and A. Vetro, "Intermediate view generation for perceived depth adjustment of stereo video," in Proc. SPIE, vol. 7443, San Diego, CA, Aug. 2009.
  101. K. Müller, A. Smolic, K. Dix, P. Merkle, P. Kauff, and T. Wiegand, "View synthesis for advanced 3D video systems," EURASIP J. Image Video Proc., vol. 2008, 2008, Article ID 438148.
  102. C. Hewage, S. Worrall, S. Dogan, S. Villette, and A. Kondoz, "Quality evaluation of color plus depth map-based stereoscopic video," IEEE J. Sel. Topics Sig. Proc., vol. 3, no. 2, pp. 304-318, 2009.
  103. V. De Silva, W. Fernando, G. Nur, E. Ekmekcioglu, and S. Worrall, "3D video assessment with just noticeable difference in depth evaluation," in Proc. ICIP, Hong Kong, Sept. 2010.
  104. H. T. Nguyen and M. N. Do, "Error analysis for image-based rendering with depth information," IEEE Trans. Image Processing, vol. 18, no. 4, pp. 703-716, April 2009.
  105. C. Doutre and P. Nasiopoulos, "Color correction preprocessing for multiview video coding," IEEE Trans. Circ. Syst. Video Tech., vol. 19, no. 9, pp. 1400- 1405, 2009.
  106. F. Shao, G.-Y. Jiang, M. Yu, and Y.-S. Ho, "Fast color correction for multi-view video by modeling spatio-temporal variation," Vis. Comm. Image Repres., vol. 21, no. 5-6, pp. 392-403, 2010.
  107. A. Vetro et al., "Overview of multiview video coding and anti-aliasing for 3D displays," in Proc. ICIP, San Antonio, TX, Sept. 2007.
  108. M. Zwicker, W. Matusik, F. Durand, and H. Pfister, "Antialiasing for automultiscopic 3D displays," in Proc. Eurographics Rendering Symposium, Nicosia, Cyprus, June 2006.
  109. C. Moller and A. Travis, "Correcting interperspective aliasing in autostereoscopic displays," IEEE Trans. Vis. Comput. Graph., vol. 11, no. 2, pp. 228-236, 2005.
  110. J. Konrad and P. Agniel, "Subsampling models and anti-alias filters for 3-D automultiscopic displays," IEEE Trans. Image Processing, vol. 15, no. 1, pp. 128-140, Jan. 2006.
  111. W.-J. Kim, S.-D. Kim, and J. Kim, "Analysis on the spectrum of a stereoscopic 3-D image and disparity-adaptive anti-aliasing filter," IEEE Trans. Circ. Syst. Video Tech., vol. 19, no. 10, pp. 1561-1565, Oct. 2009.
  112. W.-J. Kim, S.-D. Kim, N. Hur, and J. Kim, "Temporal anti-aliasing of a stereoscopic 3D video," ETRI Journal, vol. 31, no. 1, pp. 1-9, Feb. 2009.
  113. P. Seuntiëns, L. Meesters, and W. IJsselsteijn, "Perceived quality of compressed stereoscopic images: effects of symmetric and asymmetric JPEG coding and camera separation," ACM Trans. Applied Perception, vol. 3, no. 2, pp. 95-109, April 2006.
  114. G. Saygili, C. Gurler, and A. Tekalp, "Quality assessment of asymmetric stereo video coding," in Proc. ICIP, Hong Kong, Sept. 2010.
  115. P. Aflaki, M. Hannuksela, J. Hakkinen, P. Lindroos, and M. Gabbouj, "Subjective study on compressed asymmetric stereoscopic video," in Proc. ICIP, Hong Kong, Sept. 2010.
  116. G. Saygili, C. G. Gürler, and A. M. Tekalp, "Evaluation of asymmetric stereo video coding and rate scaling for adaptive 3D video streaming," IEEE Trans. Broadcasting, vol. 57, no. 2, pp. 593-601, 2011.
  117. X. Zhang and B. Li, "Impact of disparate video quality in stereo channels on 3D perception," in Proc. VPQM, 2010.
  118. A. J. Woods, T. Docherty, and R. Koch, "Image distortions in stereoscopic video systems," in Proc. SPIE, vol. 1915, San Jose, CA, Feb. 1993.
  119. L. Goldmann, F. De Simone, and T. Ebrahimi, "Impact of acquisition distortion on the quality of stereoscopic images," in Proc. VPQM, Scottsdale, AZ, Jan. 13-15, 2010.
  120. F. L. Kooi and A. Toet, "Visual comfort of binocular and 3D displays," Displays, vol. 25, no. 2, pp. 99-108, Aug. 2004.
  121. D. C. Burr and J. Ross, "How does binocular delay give information about depth?" Vision Res., vol. 19, pp. 523-532, 1980.
  122. L. Goldmann, J.-S. Lee, and T. Ebrahimi, "Temporal synchronization in stereoscopic video: Influence on quality of experience and automatic asynchrony detection," in Proc. ICIP, Hong Kong, Sept. 26-29, 2010.
  123. R. T. Held and M. S. Banks, "Misperceptions in stereoscopic displays: A vision science perspective," in Proc. APGV, New York, NY, Aug. 2008.
  124. M. Barkowsky, P. Campisi, P. L. Callet, and V. Rizzo, "Crosstalk measurement and mitigation for autostereoscopic displays," in Proc. SPIE, vol. 7526, Jan. 2010.
  125. P. J. H. Seuntiëns, L. M. J. Meesters, and W. A. IJsselsteijn, "Perceptual attributes of crosstalk in 3D images," Displays, vol. 26, no. 4-5, pp. 177-183, 2005.
  126. A. J. Woods, "Crosstalk in stereoscopic displays: A review," J. Electronic Imaging, vol. 21, no. 4, pp. 040 902-1-040 902-21, 2012.
  127. A. J. Woods and C. R. Harris, "Comparing levels of crosstalk with red/cyan, blue/yellow, and green/magenta anaglyph 3D glasses," in Proc. SPIE, vol. 7524, San Jose, CA, Jan. 2010.
  128. M. Salmimaa and T. Jarvenpaa, "3-D crosstalk and luminance uniformity from angular luminance profiles of multiview autostereoscopic 3-D displays," J. Soc. Info. Display, vol. 16, no. 10, pp. 1033-1040, 2008.
  129. Q. Wang, X. Li, L. Zhou, A. Wang, and D. Li, "Cross-talk reduction by correcting the subpixel position in a multiview autostereoscopic three- dimensional display based on a lenticular sheet," Applied Optics, vol. 50, no. 7, pp. B1-B5, 2011.
  130. Y. G. Lee and J. B. Ra, "New image multiplexing scheme for compensating lens mismatch and viewing zone shifts in three-dimensional lenticular displays," Opt. Eng., vol. 48, no. 4, 2009.
  131. H. Lim et al., "A simultaneous intermediate view interpolation and multiplexing algorithm for a fast lenticular display," Opt. Eng., vol. 46, no. 11, pp. 114 003 1-8, 2007.
  132. J. Konrad, B. Lacotte, and E. Dubois, "Cancellation of image crosstalk in time-sequential displays of stereoscopic video," IEEE Trans. Image Processing, vol. 9, no. 5, pp. 897-908, 2000.
  133. F. A. Smit, R. van Liere, and B. Fröhlich, "Three extensions to subtractive crosstalk reduction," in Proc. IPT-EGVE Symp., Weimar, Germany, July 2007.
  134. W. Tan, S. Z. Zhou, and S. C. Read, "Methods and systems for reducing or eliminating perceived ghosting in displayed stereoscopic images," U.S. Patent No. US20110080401.
  135. D. J. McKnight, "Enhanced ghost compensation for stereoscopic imagery," U.S. Patent No. US20100040280.
  136. G. A. Slavenburg, T. F. Fox, and D. R. Cook, "System, method, and computer program product for compensating for crosstalk during the display of stereo content," U.S. Patent No. US20080036696.
  137. I. Tsirlin, L. M. Wilcox, and R. S. Allison, "The effect of crosstalk on the perceived depth from disparity and monocular occlusions," IEEE Trans. Broadcasting, vol. 57, no. 2, pp. 445-453, 2011.
  138. L. Xing, T. Ebrahimi, and A. Perkis, "Subjective evaluation of stereoscopic crosstalk perception," in Proc. SPIE VCIP, vol. 7744, Huang Shan, China, July 2010.
  139. L. Xing, J. You, T. Ebrahimi, and A. Perkis, "A perceptual quality metric for stereoscopic crosstalk perception," in Proc. ICIP, Hong Kong, Sept. 2010.
  140. A. Jain and J. Konrad, "Crosstalk in automultiscopic 3-D displays: Blessing in disguise?" in Proc. SPIE, vol. 6490, San Jose, CA, Jan. 2007.
  141. L. B. Stelmach and W. J. Tam, "Stereo-anomalous vision in a sample of young adults," in Proc. SPIE, vol. 2657, San Jose, CA, Jan. 28-Feb. 2, 1996.
  142. C. Akai, "Depth perception in real and virtual environments an exploration of individual differences," Master's thesis, University of British Columbia, 1998.
  143. A. Bruce, D. Atchison, and H. Bhoola, "Accommodation-convergence relationships and age," Inv. Ophthalmol. Vis. Sci., vol. 36, no. 2, pp. 406- 413, Feb. 1995.
  144. J. F. Norman et al., "Stereopsis and aging," Vision Res., vol. 48, no. 23-24, pp. 2456-2465, 2008.
  145. J.-H. Lee and J.-K. Song, "Individual variation in 3D visual fatigue caused by stereoscopic images," IEEE Trans. Circ. Syst. Video Tech., vol. 58, no. 2, pp. 500-504, May 2012.
  146. N. A. Dodgson, "Variation and extrema of human inter-pupillary distance," in Proc. SPIE, vol. 5291, San Jose, CA, Jan. 2004.
  147. P. A. Howarth, "Potential hazards of viewing 3-D stereoscopic television, cinema and computer games: a review," Ophthalmic and Physiological Optics, vol. 31, no. 2, pp. 111-122, March 2011.
  148. J. F. Norman, T. Dawson, and A. Butler, "The effects of age upon the perception of depth and 3-D shape from differential motion and binocular disparity," Perception, vol. 29, no. 11, pp. 1335-1359, Nov. 2000.
  149. J. F. Norman et al., "Aging and the depth of binocular rivalry suppression," Psychology and Aging, vol. 22, no. 3, pp. 625-631, 2007.
  150. M. Lambooij and W. IJsselsteijn, "Visual discomfort and visual fatigue of stereoscopic displays: A review," J. Imaging Sci. Tech., vol. 53, no. 3, pp. 1-14, May 2009.
  151. T. Bando, A. Iijima, and S. Yano, "Visual fatigue caused by stereoscopic images and the search for the requirement to prevent them: A review," Displays, vol. 33, pp. 76-83, 2012.
  152. P. Neveu, M. Philippe, A. E. Priot, P. Fuchs, and C. Roumes, "Vergence tracking: A tool to assess oculomotor performance in stereoscopic displays," J. Eye Movement Res., vol. 5, no. 2, pp. 1-8, 2012.
  153. P. Seuntiëns, I. Heynderickx, and W. IJsselsteijn, "Viewing experience and naturalness of 3D images," in Proc. SPIE, vol. 6016, Boston, MA, Oct. 2005.
  154. W. IJsselsteijn, "Presence in depth," Ph.D. dissertation, Eindhoven University of Technology, Netherlands, 2004.
  155. J. Hakala, "The added value of stereoscopy in still images," Master's thesis, Aalto University, Finland, 2010.
  156. D. Strohmeier, S. Jumisko-Pyykko, K. Kunze, and M. O. Bici, "The extended- OPQ method for user-centered quality of experience evaluation: A study for mobile 3D video broadcasting over DVB-H," EURASIP J. Image Video Proc., no. 538294, 2011.
  157. Q. Huynh-Thu, M. Barkowsky, and P. Le Callet, "Video quality assessment: From 2D to 3D -challenges and future trends," in Proc. ICIP, Hong Kong, Sept. 26-29, 2010.
  158. ITU-R Recommendation BT.2021, "Subjective methods for the assessment of stereoscopic 3DTV systems," International Telecommunication Union, Geneva, Switzerland, 2012.
  159. S. McCarthy, "Glossary for video & perceptual quality of stereoscopic video," 3D@Home Consortium and MPEG Industry Forum, Aug. 2010.

Related papers

Stereoscopic image quality compendium
Stefan Winkler

2011 8th International Conference on Information, Communications &amp; Signal Processing, 2011

Stereoscopic viewing of 3D content brings with it a variety of complex perceptual quality issues. For the percept of depth to be convincing, consistent, and comfortable, many parameters throughout the imaging pipeline must to be matched correctly. However, tradeoffs are inevitable for practical reasons, which may lead to various distortions. This paper reviews the issues from an engineering perspective, addressing in particular depth issues, multiview issues, display issues, viewer-specific issues, as well as possible measurements for the overall 3D quality of experience (QoE).

View PDFchevron_right
Three factors that influence the overall quality of the stereoscopic 3D content: image quality, comfort, and realism
Patricia Ladret

SPIE Proceedings, 2013

View PDFchevron_right
Quality of Experience in a Stereoscopic Multiview Environment
Jonathan Gois

IEEE Transactions on Multimedia, 2017

In this paper we investigate how visualization factors, such as disparity, mobility, angular resolution and viewpoint interpolation, influence the Quality of Experience (QoE) in a stereoscopic multiview environment. In order to do so, we set up a dedicated testing room and conducted subjective experiments. We also developed a framework that emulates a super-multiview environment. This framework can be used to investigate and assess the effects of angular resolution and viewpoint interpolation on the quality of experience produced by multiview systems, and provide relevant cues as to how the baselines of cameras and interpolation strategies in such systems affect user experience. Aspects such as visual comfort, model fluidity, sense of immersion, and the 3D experience as a whole have been assessed for several test cases. Obtained results suggest that user experience in an motion parallax environment is not as critically influenced by configuration parameters such as disparity as initially thought. In addition, extensive subjective tests have indicated that while users are very sensitive to angular resolution in multiview 3D systems, this sensitivity tends not to be as critical when a user is performing a task that involves a great amount of interaction with the multiview content. These tests have also indicated that interpolating intermediate viewpoints can be effective in reducing the required view density without degrading the perceived QoE.

View PDFchevron_right
Analysis of the Motion Picture Quality of Stereoscopic Three-dimensional Images
Byoung-Ho Lee, Hee-Jin Choi

2010

The stereoscopic three-dimensional (3D) display provides a 3D image by inducing binocular disparity for the observers who wear special glasses. With the rapid progress in flat panel display technologies, the stereoscopic 3D display is becoming a new benefit-model of the current display industry, and several kinds of commercial stereoscopic 3D products have been released and are attracting people. Nowadays, the motion picture quality of the 3D image becomes as important as resolution or luminance since most of the commercial 3D products are 3D televisions or 3D monitors which are required to display a clear motion 3D image. In this paper, an analysis and simulation of the motion picture quality of stereoscopic 3D image is proposed, and a comparison of the motion picture performance among the current stereoscopic 3D technologies is also provided.

View PDFchevron_right
Factors impacting quality of experience in stereoscopic images
Andrew Perkis

SPIE Proceedings, 2011

View PDFchevron_right

Related topics

  • Computer Science
  • Depth Perception
  • Quality of Experience (QoE)
  • Electrical and Electronic Engine...
  • Human Visual System (HVS)
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved