Critical overview of image-based 3D modeling
2006
Abstract
AI
AI
This paper provides a comprehensive overview of 3D modeling techniques, specifically focusing on the challenges and solutions associated with generating 3D models from terrestrial images. It categorizes various methods including image-based rendering, image-based modeling, range-based modeling, and hybrid approaches that integrate both image and range data. The discussion extends to practical applications, the effectiveness of each technique, and the use of 3D scanners, concluding with examples of 3D modeling achieved for historical and architectural sites.
References (66)
- Ackermann, F. 1983. High precision digital image correlation. Photogrammetric Week 1983, Institut für Photogrammetrie, Stuttgart, Schriftenreihe, Heft 9: 231-242.
- Amenta, N., Bern, M. & Kamvyselis, M. 1998. New Voronoi Based Surface Reconstruction Algorithm. In Proc. of ACM of SIGGRAPH'98, 415-422, Orlando, Florida, 19-24 July.
- Asada, M. 1993. Cylindrical Shape from Contour and Shading without Knowledge of Lighting Condi- tions or Surface Albedo. Information Processing Society of Japan Journal 34(5).
- Beraldin, J.A & Blais, F. 2000. Active 3D sensing. Scuola Normale Superiore Pisa, Centro di Ricerche Informatiche per I Beni Culurali, Quaderni 10 : 22-46.
- Beraldin, J.-A., Picard, M., El-Hakim, S., Godin, G., Latouche, C., Valzano, V. & Bandiera, A. 2002. Ex- ploring a Byzantine crypt through a high-resolution texture mapped 3D model: combining range data and photogrammetry. Proc. of the ISPRS/CIPA International Workshop Scanning for Cultural Heri- tage Recording, 65-72, Corfu, Greece, 1-2 September.
- Beraldin, J.A., Picard, M., El-Hakim, S., Godin, G., Valzano, V. & Bandiera, A. 2005. Combining 3D technologies for cultural heritage interpretation and entertainment. Beraldin, J.A., El-Hakim, S., Gruen, A. & Walton, J. (eds), Videometrics VIII, SPIE Vol. 5665: 108-118.
- Bern, M. & Eppstein D. 1992. Mesh Generation and Optimal Triangulation. Computing in Euclidean Ge- ometry, Du/Hwang, (eds.), World Scientific, Lecture Notes Series on Computing, Vol. 1: 23-90.
- Blais, F. 2004. Review of 20 years of range sensor development, J. Electronic Imaging 13(1): 232-240.
- Boissonnat, J.D. 1984. Geometric structures for three-dimensional shape representation. ACM Transac- tions on Graphics 3(4): 266-286.
- Brinkley, J.F. 1985. Knowledge-driven ultrasonic three-dimensional organ modeling. IEEE Transaction on PAMI 7(4): 431-441.
- Brown, L.G., 1992: A survey of image registration techniques. Computing survey, 24(4): 325-376.
- Chen, F., Brown, G.M. & Song, M. 2000. Overview of three-dimensional shape measurement using opti- cal methods. Optical Engineering 39: 10-22.
- Curless, B. & Levoy, M. 1996. A volumetric method for building complex models from range images. In Proc. of ACM SIGGRAPH'96, 303-312, New Orleans, USA, 4-9 August.
- D'Apuzzo, N. 2003. Surface Measurement and Tracking of Human Body Parts from Multi Station Video Sequences. Ph.D. Thesis, Department of Civil, Environmental and Geomatics Engineering, ETH Zu- rich, Switzerland, Mitteilungen No. 81.
- Debevec, P.E., Taylor, C.J. & J. Malik, 1996. Modelling and rendering architecture from photographs: A hybrid geometry and image-based approach. Proc. of ACM SIGGRAPH'96,11-20, New Orleans, USA, 4-9 August.
- Dey, T.K. & Giesen, J. 2001. Detecting undersampling in surface reconstruction. In Proc. of the 17th Symposium of Computational Geometry, 257-263, Medford, USA, 3-5 June.
- Dick, A.R., Torr, P.H., Ruffle, S.J. & Cipolla, R. 2001. Combining single view recognition and multiple view stereo for architectural scenes. In Proc. of the 8 th IEEE International Conference on Computer Vision (ICCV 01), 268-274, Vancouver, Canada, 9-12 July.
- Dhond, U. and Aggarwal, J.K., 1989. Structure from stereo -a review. IEEE Transaction on System, Man and Cybern., 19(6): 1489-1510.
- Edelsbrunner H. & Mucke, E. 1994. Three Dimensional Alpha Shapes. ACM Transactions on Graphics 13(1): 43-72.
- Edelsbrunner, H. 2001. Geometry and Topology for Mesh Generation, Cambridge Monographs on Ap- plied and Computational Mathematics, Vol. 6, Cambridge University Press, UK.
- El-Hakim, S.F. 2002. Semi-automatic 3D reconstruction of occluded and unmarked surfaces from widely separated views. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 34, Part 5: 143-148.
- El-Hakim, S., Beraldin, J.A., Picard, M. & Godin, G. 2004. Detailed 3D reconstruction of large-scale heritage sites with integrated techniques. IEEE Computer Graphics and Application 24(3): 21-29.
- Ferrari, V., Tuytelaars, T. & Van Gool, L. 2003. Wide-baseline muliple-view correspondences. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition, 718-728, Madison, USA, 16-22 June.
- Fitzgibbon, A. & Zisserman, A. 1998. Automatic 3D model acquisition and generation of new images from video sequence. In Proc. of the European Signal Processing Conference, 1261-1269, Rhodes, Greece, 8 -11 September.
- Förstner, W. 1982. On the geometric precision of digital correlation. International Archives of Photo- grammetry and Remote Sensing, Vol. 26, Part 3: 150-166.
- Gartner, H., Lehle, P. & Tiziani, H.J. 1995. New, high efficient, binary codes for structured light meth- ods. SPIE Proceedings, Vol. 2599: 4-13.
- Gotsman, C. & Keren, D. 1998. Tight Fitting of Convex Polyhedral Shapes. International Journal of Shape Modeling 4(3-4): 111-126.
- Grün, A. 1985. Adaptive least square correlation: a powerfull image matching technique. South African Journal of Photogrammetry, Remote Sensing and Cartography 14(3): 175-187.
- Grün, A. 2000. Semi-automated approaches to site recording and modeling. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 33, Part 5/1: 309-318.
- Guidi, G., Beraldin, J-A., Ciofi, S. & Atzeni, C. 2003. Fusion of range camera and photogrammetry: a systematic procedure for improving 3D models metric accuracy, IEEE Trans. on Systems, Man and Cybernetics 33(4): 667-676.
- Hastie, T. & Stuetzle W. 1989. Principal curves. Journal of the American Statistical Association 84: 502- 516.
- Healey, G. & Binford, T.O. 1987. Local Shape from Specularity. In Proc. of the International Conference on Computer Vision, 151-160, June, London, UK.
- Heok, T.K. & Damen, D. 2004. A review of level of detail. In Proc. of the IEEE International Conference on Computer Graphics, Imaging and Visualization, 70-75, Penang, Malaysia, 26-29 July.
- Hoppe, H., DeRose, T., Duchamp, T., McDonald, J. & Stuetzle, W. 1992. Surface reconstruction from unorganized points. In Proc. ACM of SIGGRAPH'92, 71-78, Chicago, USA, 26 -31 July.
- Horn, B.K.P. & Brooks, M.J. 1989. Shape from Shading. MIT Cambridge.
- Isselhard, F., Brunnett, G., Schreiber, T., 1997. Polyhedral reconstruction of 3D objects by tetrahedra re- moval. Technical report No. 288/97, Fachbereich Informatik, University of Kaiserslautern, Germany.
- Kender, J.R. 1978. Shape from Texture. In Proc. DARPA Image Understanding Workshop: 134-138.
- Kersten, T., Pardo, C.A. & Lindstaedt, M. 2004. 3D acquisition modeling and visualization of north Ger- man castles by digital architectural Photogrammetry. International Archives of Photogrammetry, Re- mote Sensing and Spatial Information Sciences, Vol. 35, Part B2: 126-132.
- Lee, S.C. & Nevatia, R. 2003. Interactive 3D Building Modeling Using a Hierarchical Representation, IEEE Workshop on Higher-Level Knowledge in 3D Modeling and Motion (HLK) part of the 9 th Inter- national Conference on Computer Vision: 58-65.
- Liebowitz, D., A. Criminisi, A. & Zisserman, A. 1999. Creating Architectural Models from Images, EU- ROGRAPHICS '99 , Vol. 18, 39-50, Milano, Italy, 7-11 September.
- Lorensen, W.E. & Cline, H.E. 1987. Marching cubes: a high resolution 3d surface reconstruction algo- rithm. Computer Graphics 21(4):163-169.
- Maas, H.G. 1992. Robust Automatic Surface Reconstruction with Structured Light. International Ar- chives of Photogrammetry and Remote Sensing, Vol. 24, Part B5: 102-107.
- Mencl, R. 2001. Reconstruction of Surfaces from Unorganized 3D Points Clouds. PhD Thesis, University of Dortmund, Germany.
- Merriam, M. 1992. Experience with the cyberware 3D digitizer. Proc. of the National Computer Graphics Association: 125-133, March.
- Miller, J.V., Breen, D., Lorensen, W., O'Bara, R. & Wozny, M. 1991. Geometrically deformed models: A method for extracting closed geometric models from volume data. Computer Graphics 25(4): 217- 226.
- Moore D. & Warren, J. 1990. Approximation of dense scattered data using algebraic surfaces. Technical Report: 90-135, Rice University, USA.
- Muraki, S. 1991. Volumetric shape description of range data using "blobby model". Computer Graphics 25(4): 217-226.
- Nister, D. 2004. Automatic Passive Recovery of 3D from Images and Video. IEEE Proceedings of the 2nd Intl Symp 3D Data Processing, Visualization, and Transmission (3D Data Processing, Visualiza- tion and Transmission 2004), 438-445, 6-9 September, Thessaloniki, Greece.
- Pollefeys, M., Koch, R. & Van Gool, L., 1999. Self-calibration and metric reconstruction in spite of vary- ing and unknown internal camera parameters. Int. Journal of Computer Vision, 32(1): 7-25
- Pritchett, P. & Zisserman, A. 1998. Matching and Reconstruction from Widely Separated Views. Koch, R. & Van Gool, L. (eds.), 3D Structure from Multiple Images of Large-Scale Environments, LNCS 1506: 78-92.
- Roth, G. & Whitehead, A. 2000. Using projective vision to find camera positions in an image sequence. In Proc. of 13th Vision Interface Conference, 87-94, Montreal, Canada, May.
- Sablatnig, R. & Menard, C. 1997. 3D Reconstruction of Archaeological Pottery using Profile Primitives. Sarris N. & Strintzis M.G. (eds.), In Proc. of the International Workshop on Synthetic-Natural Hybrid Coding and Three-Dimensional Imaging, 93-96.
- Scharstein, D. & Szeliski, R., 2002: A taxonomy and evaluation of dense two-frame stereo correspon- dence algorithms. Int. Journal of Computer Vision, 47(1/2/3):7-42.
- Schindler, K. & Bauer, J. 2003. A model-based method for building reconstruction. In Proc. of the Inter- national Conference on Computer Vision workshop on Higher-Level Knowledge in 3D Modeling and Motion (HLK'03), 74-82, Nice, France.
- Sequeira V. & Ng K. 1999. Automated reconstruction of 3D models from real environments. ISPRS Journal for Photogrammetry and Remote Sensing 54(1): 1-22.
- Streilein, A. 1994. Towards Automation in Architectural Photogrammetry: CAD-Based 3D-Feature Ex- traction. ISPRS Journal of Photogrammetry & Remote Sensing 49(5): 4-15.
- Terzopoulos, D. 1988. The Computation of Visible Surface Representation. IEEE Transactions on PAMI 10(4): 417-438.
- Ulupinar F. & Nevatia R. 1995. Shape from Contour: Straight Homogeneous Generalized Cylinders and Constant Cross Section Generalized Cylinders. IEEE Transaction on Pattern Analysis Machine Intelli- gence 17(2): 120-135.
- Van den Heuvel, F.A., 1999a. A line-photogrammetric mathematical model for the reconstruction of polyhedral objects. In El-Hakim, Gruen (eds.), SPIE Proceedings, Videometrics VI, Vol. 3641: 60-71.
- Xiao, J. & Shah, M. 2003. Two-Frame Wide Baseline Matching. In Proc. of 9th IEEE International Con- ference on Computer Vision, Vol. 1: 603-610.
- Wahl, F.M. 1984. A Coded Light Approach for 3-Dimensional Vision. IBM Research Report, RZ 1452.
- Werner, T. & Zisserman, A. 2002. New technique for automated architectural reconstruction from photo- graphs. In Proc. of the 7 th European Conference Computer Vision, Vol. 2, 541-555, Copenhagen, May.
- Wilczkowiak, M., Trombettoni, G., Jermann, C., Sturm, P. & Boyer, E. 2003. Scene modeling based on constraint system decomposition techniques. In Proc. of the 9 th IEEE International Conference on Computer Vision (ICCV 03), 1004-1010, Nice, France, 14-17 October.
- Winkelbach, S. & Wahl, F.M. 2001. Shape from 2D Edge Gradient. Pattern Recognition, Lecture Notes in Computer Science 2191. Berlin: Springer.
- Zhang, H. 1998. Effective occlusion culling for the interactive display of arbitrary models. Ph.D. Thesis, Department of Computer Science, UNC Chapel Hill.
- WEB LINKS 3DMax: http://www.discreet.com [May 2005] Breuckmann: http://www.breuckmann.com [May 2005] Canoma: http://www.metacreations.com/products/canoma [May 2005] Cyberware: http://www.cyberware.com [May 2005] ImageModeler: http://www.realviz.com [May 2005] IWitness: http://www.iwitnessphoto.com [May 2005] Lightwave: http://www.newtek.com [May 2005] Maya: http:// www.aliaswavefront.com/ [May 2005] PhotoModeler: http://www.photomodeler.com [May 2005] PolyWorks: http://www.innovmetric.com [May 2005] ShapeCapture: http://www.shapecapture.com [May 2005] ShapeGrabber: http://www.shapegrabber.com [May 2005]