Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Related Work
Results
Conclusion
References
All Topics
Computer Science
Artificial Intelligence

Neural Reflectance Fields for Appearance Acquisition

Profile image of David KriegmanDavid Kriegman

2020

Abstract
sparkles

AI

Neural Reflectance Fields, a novel deep scene representation, are introduced for modeling complex scene geometry and reflectance through a fully-connected neural network that encodes volume density, normals, and reflectance properties at any 3D point in a scene. By integrating this representation with a differentiable ray marching framework, the method facilitates high-quality view synthesis and relighting from images captured with a simple camera-light setup. The proposed approach demonstrates capabilities in rendering photo-realistic images under novel viewpoints and non-collocated lighting, effectively reproducing challenging visual effects such as specularities and shadows, while also enabling compatibility with traditional graphical rendering engines.

Related papers

Recent methods for image-based modeling and rendering
Darius Burschka

2003

Abstract A long standing goal in image-based modeling and rendering is to capture a scene from camera images and construct a sufficient model to allow photo-realistic rendering of new views. With the confluence of computer graphics and vision, the combination of research on recovering geometric structure from un-calibrated cameras with modeling and rendering has yielded numerous new methods.

View PDFchevron_right
Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography
Paul Debevec

1998

ABSTRACT We present a method that uses measured scene radiance and global illumination in order to add new objects to light-based models with correct lighting. The method uses a high dynamic range imagebased model of the scene, rather than synthetic light sources, to illuminate the new objects. To compute the illumination, the scene is considered as three components: the distant scene, the local scene, and the synthetic objects.

View PDFchevron_right
Rendering real-world objects using view interpolation
Vasek Hlavac

Proceedings of IEEE International Conference on Computer Vision, 1995

This paper presents a new approach to rendering arbitrary views of real-world 3-D objects of complex shapes. We propose to represent an object by a sparse set of corresponding .2-D views, and to construct any other view as a combination of these reference views. We show that this combination can be linear, assuming proximity of the views, and we suggest how the visibility of constructed points can be determined. Our approach makes it possible to avoid difficult 3-D reconstruction, assuming only rendering is required. Moreover, almost no calibration of views is needed. We present preliminary results on real objects, indicating that the approach is feasible.

View PDFchevron_right
Illumination networks: fast realistic rendering with general reflectance functions
Donald Fussell

ACM SIGGRAPH Computer Graphics, 1989

We present a technique for modeling global illumination which allows a wide variety of reflectance functions. Scene coherence is exploited in a preprocessing step in which the geometry is analyzed using iterative techniques. Memory is traded for speed, in anticipation of the high memory capacities of workstations of the future. The algorithm operates well over a wide range of time and image quality constraints: realistic results may be produced very quickly while very accurate results require more time and space. The method can be extended for animation and parallelization.

View PDFchevron_right
Fast image synthesis of virtual objects in a real scene with natural shadings
K. Ikeuchi

Systems and Computers in Japan, 2005

We propose a new method for superimposing synthetic objects with natural shadings and cast shadows onto a real scene whose illumination condition is dynamically changing in this paper. In general, high computational cost for rendering virtual objects with convincing shading and shadows, such as interreflections or shadows under area light sources, prohibits real-time synthesis of such composite images with superimposed virtual objects. To overcome this limitation, we take advantage of the linearity of the relationship between brightness changes observed on an object surface and change of illumination radiance in a scene and introduce an efficient rendering technique based on a linear combination of pre-rendered reference images of the scene. We have successfully tested the proposed method in a natural illumination condition of an indoor environment to demonstrate how fast the method could superimpose a virtual object onto the scene with highly realistic shadings and shadows.

View PDFchevron_right
RTcams: A New Perspective on Nonphotorealistic Rendering from Photographs
Peter Hall

IEEE Transactions on Visualization and Computer Graphics, 2007

We introduce a simple but versatile camera model that we call the Rational Tensor Camera (RTcam). RTcams are well principled mathematically and provably subsume several important contemporary camera models in both Computer Graphics and Vision; their generality is one contribution. They can be used alone, or compounded to produce more complicated visual effects. In this paper we apply RTcams to generate synthetic artwork with novel perspective effects from real photographs. Existing Non-Photorealistic Rendering from Photographs (NPRP) is constrained to the projection inherent in the source photograph, which is most often linear. RTcams lift this restriction and so contribute to NPRP via multi-perspective projection. This paper describes RTcams, compares them to contemporary alternatives, and discusses how to control them in practice. Illustrative examples are provided throughout.

View PDFchevron_right
Image-based reconstruction of spatial appearance and geometric detail
Wolfgang Heidrich

2003

Abstract Real-world objects are usually composed of a number of different materials that often show subtle changes even within a single material. Photorealistic rendering of such objects requires accurate measurements of the reflection properties of each material, as well as the spatially varying effects. We present an image-based measuring method that robustly detects the different materials of real objects and fits an average bidirectional reflectance distribution function (BRDF) to each of them.

View PDFchevron_right
Deep reflectance fields
Julien Valentin

ACM Transactions on Graphics

View PDFchevron_right
Integrating synthetic objects into real scenes
Emilio Camahort

Computers & Graphics, 2003

This paper presents a methodology for integrating synthetic objects into real scenes. We take a set of photographs of the real scene and build a simple image-based model. We use high dynamic range images to build an accurate representation of the lighting in the scene. Then we insert a synthetic object into the model and compute its illumination and shading using the lighting information. Illumination changes produced by the synthetic object are also applied to real-scene objects located nearby. We show how easy it is to achieve photo-realistic results without specialized hardware. Our approach takes advantage of techniques like automatic camera calibration, highdynamic range image capture and image-based lighting.

View PDFchevron_right
Photorealistic Image Based Objects from Uncalibrated Images
MIGUEL Herreria sainz

In this paper we present a complete pipeline for image based mod-eling of objects using a camcorder or digital camera. Our sys-tem takes an uncalibrated sequence of images recorded around a scene, it automatically selects a subset of keyframes and then it recovers the underlying 3D structure and camera path. The fol-lowing step is a volumetric scene reconstruction performed using a hardware accelerated voxel carving approach. From the recovered voxelized volume we obtain the depth images for each of the ref-erence views and then we triangulate them following a Restricted Quadtree meshing scheme. During rendering, we use a highly op-timized approach to combine the available information from mul-tiple overlapped reference images generating a generate a full 3D photo-realistic reconstruction. The final reconstructed models can be rendered in real time very efficiently, making them very suitable to be used to enrich the content of large virtual environments.

View PDFchevron_right

References (63)

  1. Miika Aittala, Timo Aila, and Jaakko Lehtinen. 2016. Reflectance Modeling by Neural Texture Synthesis. ACM Trans. Graph. 35, 4, Article 65 (July 2016), 13 pages. https: //doi.org/10.1145/2897824.2925917
  2. Miika Aittala, Tim Weyrich, and Jaakko Lehtinen. 2015. Two-shot SVBRDF Capture for Stationary Materials. ACM Transactions on Graphics 34, 4, Article 110 (July 2015), 13 pages. https://doi.org/10.1145/2766967
  3. Sai Bi, Zexiang Xu, Kalyan Sunkavalli, Miloš Hašan, Yannick Hold-Geoffroy, David Kriegman, and Ravi Ramamoorthi. 2020a. Deep Reflectance Volumes: Relightable Reconstructionsfrom Multi-View Photometric Images. ECCV (2020).
  4. Sai Bi, Zexiang Xu, Kalyan Sunkavalli, David Kriegman, and Ravi Ramamoorthi. 2020b. Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images. arXiv preprint arXiv:2003.12642 (2020).
  5. Rui Chen, Songfang Han, Jing Xu, and Hao Su. 2019. Point-based multi-view Stereo Network. In ICCV.
  6. Shuo Cheng, Zexiang Xu, Shilin Zhu, Zhuwen Li, Li Erran Li, Ravi Ramamoorthi, and Hao Su. 2019. Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awareness. arXiv preprint arXiv:1911.12012 (2019).
  7. Paul Debevec, Tim Hawkins, Chris Tchou, Haarm-Pieter Duiker, Westley Sarokin, and Mark Sagar. 2000. Acquiring the reflectance field of a human face. In SIGGRAPH. ACM Press/Addison-Wesley Publishing Co., 145-156.
  8. Valentin Deschaintre, Miika Aittala, Fredo Durand, George Drettakis, and Adrien Bousseau. 2018. Single-image SVBRDF capture with a rendering-aware deep net- work. ACM Transactions on Graphics 37, 4 (2018), 128.
  9. Carlos Hernández Esteban and Francis Schmitt. 2004. Silhouette and stereo fusion for 3D object modeling. Computer Vision and Image Understanding 96, 3 (2004), 367-392.
  10. Sing Choong Foo. 1997. A gonioreflectometer for measuring the bidirectional reflectance of material for use in illumination computation. Ph.D. Dissertation. Citeseer.
  11. Yasutaka Furukawa and Jean Ponce. 2009. Accurate, dense, and robust multiview stereopsis. IEEE 32, 8 (2009), 1362-1376.
  12. Peter Hedman, Julien Philip, True Price, Jan-Michael Frahm, George Drettakis, and Gabriel Brostow. 2018. Deep blending for free-viewpoint image-based rendering. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1-15.
  13. Zhuo Hui, Kalyan Sunkavalli, Joon-Young Lee, Sunil Hadap, Jian Wang, and Aswin C Sankaranarayanan. 2017. Reflectance capture using univariate sampling of BRDFs. In ICCV. 5362-5370.
  14. Wenzel Jakob. 2010. Mitsuba renderer. http://www.mitsuba-renderer.org.
  15. Mengqi Ji, Juergen Gall, Haitian Zheng, Yebin Liu, and Lu Fang. 2017. SurfaceNet: An end-to-end 3D neural network for multiview stereopsis. In ICCV. 2307-2315.
  16. James T Kajiya and Timothy L Kay. 1989. Rendering fur with three dimensional textures. ACM Siggraph Computer Graphics 23, 3 (1989), 271-280.
  17. Kaizhang Kang, Zimin Chen, Jiaping Wang, Kun Zhou, and Hongzhi Wu. 2018. Efficient reflectance capture using an autoencoder. SIGGRAPH 37, 4 (2018), 127-1.
  18. Kaizhang Kang, Cihui Xie, Chengan He, Mingqi Yi, Minyi Gu, Zimin Chen, Kun Zhou, and Hongzhi Wu. 2019. Learning efficient illumination multiplexing for joint capture of reflectance and shape. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1-12.
  19. Brian Karis and Epic Games. 2013. Real shading in unreal engine 4. SIGGRAPH 2013 Course (2013).
  20. Joe Kniss, Simon Premoze, Charles Hansen, Peter Shirley, and Allen McPherson. 2003. A model for volume lighting and modeling. IEEE transactions on visualization and computer graphics 9, 2 (2003), 150-162.
  21. Kiriakos N Kutulakos and Steven M Seitz. 2000. A theory of shape by space carving. International journal of computer vision 38, 3 (2000), 199-218.
  22. Alexandr Kuznetsov, Miloš Hašan, Zexiang Xu, Ling-Qi Yan, Bruce Walter, Nima Khademi Kalantari, Steve Marschner, and Ravi Ramamoorthi. 2019. Learning generative models for rendering specular microgeometry. ACM Transactions on Graphics (SIGGRAPH Asia 2019) 38, 6 (2019), 225.
  23. Marc Levoy and Pat Hanrahan. 1996. Light field rendering. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. ACM, 31-42.
  24. Zhengqin Li, Kalyan Sunkavalli, and Manmohan Chandraker. 2018a. Materials for masses: SVBRDF acquisition with a single mobile phone image. In ECCV. 72-87.
  25. Zhengqin Li, Zexiang Xu, Ravi Ramamoorthi, Kalyan Sunkavalli, and Manmohan Chandraker. 2018b. Learning to reconstruct shape and spatially-varying reflectance from a single image. In SIGGRAPH Asia 2018. ACM, 269.
  26. Tom Lokovic and Eric Veach. 2000. Deep shadow maps. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques. 385-392.
  27. Stephen Lombardi, Tomas Simon, Jason Saragih, Gabriel Schwartz, Andreas Lehrmann, and Yaser Sheikh. 2019. Neural volumes: Learning dynamic renderable volumes from images. ACM Transactions on Graphics (TOG) 38, 4 (2019), 65.
  28. Wojciech Matusik, Hanspeter Pfister, Matt Brand, and Leonard McMillan. 2003. A Data-Driven Reflectance Model. SIGGRAPH 22, 3 (July 2003), 759-769.
  29. Nelson Max. 1995. Optical models for direct volume rendering. IEEE Transactions on Visualization and Computer Graphics 1, 2 (1995), 99-108.
  30. Abhimitra Meka, Christian Haene, Rohit Pandey, Michael Zollhöfer, Sean Fanello, Graham Fyffe, Adarsh Kowdle, Xueming Yu, Jay Busch, Jason Dourgarian, et al. 2019. Deep reflectance fields: high-quality facial reflectance field inference from color gradient illumination. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1-12.
  31. Lars Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, and Andreas Geiger. 2018. Occupancy Networks: Learning 3D Reconstruction in Function Space. arXiv preprint arXiv:1812.03828 (2018).
  32. Ben Mildenhall, Pratul P Srinivasan, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, and Abhishek Kar. 2019. Local light field fusion: Practical view synthesis with prescriptive sampling guidelines. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1-14.
  33. Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ra- mamoorthi, and Ren Ng. 2020. NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis. arXiv preprint arXiv:2003.08934 (2020).
  34. Giljoo Nam, Joo Ho Lee, Diego Gutierrez, and Min H Kim. 2018. Practical SVBRDF acquisition of 3D objects with unstructured flash photography. In SIGGRAPH Asia 2018. ACM, 267.
  35. Jannik Boll Nielsen, Henrik Wann Jensen, and Ravi Ramamoorthi. 2015. On optimal, minimal BRDF sampling for reflectance acquisition. ACM Transactions on Graphics (TOG) 34, 6 (2015), 1-11.
  36. Jan Novák, Iliyan Georgiev, Johannes Hanika, and Wojciech Jarosz. 2018. Monte Carlo methods for volumetric light transport simulation. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 551-576.
  37. Julien Philip, Michaël Gharbi, Tinghui Zhou, Alexei A Efros, and George Drettakis. 2019. Multi-view relighting using a geometry-aware network. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1-14.
  38. Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017. Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 652-660.
  39. Nasim Rahaman, Aristide Baratin, Devansh Arpit, Felix Draxler, Min Lin, Fred A Hamprecht, Yoshua Bengio, and Aaron Courville. 2018. On the spectral bias of neural networks. arXiv preprint arXiv:1806.08734 (2018).
  40. Gilles Rainer, Wenzel Jakob, Abhijeet Ghosh, and Tim Weyrich. 2019. Neural btf compression and interpolation. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 235-244.
  41. Peiran Ren, Yue Dong, Stephen Lin, Xin Tong, and Baining Guo. 2015. Image based relighting using neural networks. ACM Transactions on Graphics 34, 4 (2015), 1-12.
  42. Stephan R Richter and Stefan Roth. 2018. Matryoshka networks: Predicting 3d geometry via nested shape layers. In CVPR. 1936-1944.
  43. Johannes Lutz Schönberger and Jan-Michael Frahm. 2016. Structure-from-Motion Revisited. In Conference on Computer Vision and Pattern Recognition (CVPR).
  44. Johannes Lutz Schönberger, Enliang Zheng, Marc Pollefeys, and Jan-Michael Frahm. 2016. Pixelwise View Selection for Unstructured Multi-View Stereo. In ECCV.
  45. Vincent Sitzmann, Justus Thies, Felix Heide, Matthias Nießner, Gordon Wetzstein, and Michael Zollhofer. 2019a. Deepvoxels: Learning persistent 3d feature embeddings. In CVPR. 2437-2446.
  46. Vincent Sitzmann, Michael Zollhöfer, and Gordon Wetzstein. 2019b. Scene represen- tation networks: Continuous 3D-structure-aware neural scene representations. In Advances in Neural Information Processing Systems. 1119-1130.
  47. Pratul P Srinivasan, Richard Tucker, Jonathan T Barron, Ravi Ramamoorthi, Ren Ng, and Noah Snavely. 2019. Pushing the boundaries of view extrapolation with multi- plane images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 175-184.
  48. Pratul P Srinivasan, Tongzhou Wang, Ashwin Sreelal, Ravi Ramamoorthi, and Ren Ng. 2017. Learning to synthesize a 4d rgbd light field from a single image. In Proceedings of the IEEE International Conference on Computer Vision. 2243-2251.
  49. Marc Stamminger and George Drettakis. 2002. Perspective shadow maps. In SIGGRAPH. 557-562.
  50. Tiancheng Sun, Jonathan T Barron, Yun-Ta Tsai, Zexiang Xu, Xueming Yu, Graham Fyffe, Christoph Rhemann, Jay Busch, Paul Debevec, and Ravi Ramamoorthi. 2019. Single image portrait relighting. SIGGRAPH (2019).
  51. A. Tewari, O. Fried, J. Thies, V. Sitzmann, S. Lombardi, K. Sunkavalli, R. Martin-Brualla, T. Simon, J. Saragih, M. Nießner, R. Pandey, S. Fanello, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, E. Shechtman, D. B Goldman, and M. Zollhöfer. 2020. State of the Art on Neural Rendering. Computer Graphics Forum (EG STAR 2020) (2020).
  52. Justus Thies, Michael Zollhöfer, and Matthias Nießner. 2019. Deferred neural rendering: Image synthesis using neural textures. ACM Transactions on Graphics 38, 4 (2019), 1-12.
  53. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998-6008.
  54. Delio Vicini, Vladlen Koltun, and Wenzel Jakob. 2019. A learned shape-adaptive sub- surface scattering model. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1-15.
  55. Bruce Walter, Stephen R. Marschner, Hongsong Li, and Kenneth E. Torrance. 2007. Microfacet Models for Refraction Through Rough Surfaces. EGSR 07 (2007).
  56. Lance Williams. 1978. Casting curved shadows on curved surfaces. In SIGGRAPH, Vol. 12. ACM, 270-274.
  57. Zexiang Xu, Sai Bi, Kalyan Sunkavalli, Sunil Hadap, Hao Su, and Ravi Ramamoorthi. 2019. Deep view synthesis from sparse photometric images. SIGGRAPH 38, 4 (2019), 76. Zexiang Xu, Jannik Boll Nielsen, Jiyang Yu, Henrik Wann Jensen, and Ravi Ramamoorthi. 2016. Minimal BRDF sampling for two-shot near-field reflectance acquisition. ACM Transactions on Graphics 35, 6 (2016), 188.
  58. Zexiang Xu, Kalyan Sunkavalli, Sunil Hadap, and Ravi Ramamoorthi. 2018. Deep image-based relighting from optimal sparse samples. SIGGRAPH 37, 4 (2018), 126.
  59. Yao Yao, Zixin Luo, Shiwei Li, Tian Fang, and Long Quan. 2018. MVSNet: Depth inference for unstructured multi-view stereo. In ECCV. 767-783.
  60. Yao Yao, Zixin Luo, Shiwei Li, Tianwei Shen, Tian Fang, and Long Quan. 2019. Recurrent mvsnet for high-resolution multi-view stereo depth inference. In CVPR. 5525-5534.
  61. Hao Zhou, Sunil Hadap, Kalyan Sunkavalli, and David W Jacobs. 2019. Deep Single- Image Portrait Relighting. In CVPR. 7194-7202.
  62. Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, and Noah Snavely. 2018. Stereo magnification: learning view synthesis using multiplane images. ACM Trans- actions on Graphics (TOG) 37, 4 (2018), 1-12.
  63. Zhenglong Zhou, Zhe Wu, and Ping Tan. 2013. Multi-view photometric stereo with spatially varying isotropic materials. In CVPR. 1482-1489.

Related papers

Image-Based Rendering for Non-Diffuse Synthetic Scenes
Ari V Rapoport

Rendering Techniques ’98, 1998

Most current image-based rendering methods operate under the assumption that all of the visible surfaces in the scene are opaque ideal diffuse (Lambertian) reflectors. This paper is concerned with image-based rendering of non-diffuse synthetic scenes. We introduce a new family of image-based scene representations and describe corresponding image-based rendering algorithms that are capable of handling general synthetic scenes containing not only diffuse reflectors, but also specular and glossy objects. Our image-based representation is based on layered depth images. It represents simultaneously and separately both view-independent scene information and view-dependent appearance information. The view-dependent information may be either extracted directly from our data-structures, or evaluated procedurally using an image-based analogue of ray tracing. We describe image-based rendering algorithms that recombine the two components together in a manner that produces a good approximation to the correct image from any viewing position. In addition to extending image-based rendering to non-diffuse synthetic scenes, our paper has an important methodological contribution: it places image-based rendering, light field rendering, and volume graphics in a common framework of discrete raster-based scene representations.

View PDFchevron_right
Abad F, Camahort E, Viv!o R. A technique for integrating synthetic objects with real scenes. Tech. Rep. DSIC-II/06/ 02, Depto.
Vlad Evtushenko

This paper presents a methodology for integrating synthetic objects into real scenes. We take a set of photographs of the real scene and build a simple image-based model. We use high dynamic range images to build an accurate representation of the lighting in the scene. Then we insert a synthetic object into the model and compute its illumination and shading using the lighting information. Illumination changes produced by the synthetic object are also applied to real-scene objects located nearby. We show how easy it is to achieve photo-realistic results without specialized hardware. Our approach takes advantage of techniques like automatic camera calibration, high dynamic range image capture and image-based lighting. r

View PDFchevron_right
3D Scene Creation and Rendering via Rough Meshes: A Lighting Transfer Avenue
Binqiang Zhao

arXiv (Cornell University), 2022

This paper studies how to flexibly integrate reconstructed 3D models into practical 3D modeling pipelines such as 3D scene creation and rendering. Due to the technical difficulty, one can only obtain rough 3D models (R3DMs) for most real objects using existing 3D reconstruction techniques. As a result, physically-based rendering (PBR) would render low-quality images or videos for scenes that are constructed by R3DMs. One promising solution would be representing real-world objects as Neural Fields such as NeRFs, which are able to generate photo-realistic renderings of an object under desired viewpoints. However, a drawback is that the synthesized views through Neural Fields Rendering (NFR) cannot reflect the simulated lighting details on R3DMs in PBR pipelines, especially when object interactions in the 3D scene creation cause local shadows. To solve this dilemma, we propose a lighting transfer network (LighTNet) to bridge NFR and PBR, such that they can benefit from each other. LighTNet reasons about a simplified image composition model, remedies the uneven surface issue caused by R3DMs, and is empowered by several perceptual-motivated constraints and a new Lab angle loss which enhances the contrast between lighting strength and colors. Comparisons demonstrate that LighT-Net is superior in synthesizing impressive lighting, and is promising in pushing NFR further in practical 3D modeling workflows. Project page: https://3d-frontfuture.github.io/LighTNet.

View PDFchevron_right
Image-based modeling and rendering
Paul Debevec

1998

Image-based modeling and rendering differs from traditional graphics in that both the geometry and appearance of the scene are derived from real photographs. The techniques often allow for shorter modeling times, faster rendering speeds, and unprecedented levels of photorealism. In this course we will explain and demonstrate a variety of ways of turning images into models and then back into renderings, including movie maps, panoramas, image warping, photogrammetry, light fields, and 3D scanning.

View PDFchevron_right
Hybrid Image-based Rendering for Free-view Synthesis
Siddhant Prakash

Proceedings of the ACM on Computer Graphics and Interactive Techniques, 2021

View PDFchevron_right

Related topics

  • Computer Science
  • Artificial Intelligence
  • Computer Vision
  • Global Illumination
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved