Three-dimensional object registration using wavelet features
2009, Engineering With Computers
Abstract
Recent developments in shape-based modeling and data acquisition have brought three-dimensional models to the forefront of computer graphics and visualization research. New data acquisition methods are producing large numbers of models in a variety of fields. Three-dimensional shape-based matching and registration (alignment) are key to the useful application of such models in areas from automated surface inspection to cancer detection and surgery. The three-dimensional models in these applications are typically huge. State-of-the-art simulations in computational fluid dynamics produce upward of four terabytes of data per second of flow. Research-level magnetic resonance imaging (MRI) resolutions can reach 1 cubic micro-meter. As a result, object registration and matching algorithms must handle very large amounts of data. The algorithms developed in this thesis accomplish automatic registration and matching of three-dimensional voxelized models. We employ features in a wavelet transform domain to accomplish registration. The features are extracted in a multiresolutional format, thus delineating features at various scales for robust and rapid matching. Registration is achieved through seeking peaks in sets of rotation quaternions using a voting scheme, then separately identifying translation. The method is robust to occlusion, clutter and noise. The efficacy of the algorithm is demonstrated through examples from solid modeling and medical imaging applications.
References (112)
- 2 Feature Points ................... ......... .. 46
- 2.1 Invariance ................... .........
- 2.2 Wavelet Coefficient Magnitude . ................. 52
- 2.3 Quantity of Feature Points ................... Bibliography
- Paul S. Addison. The Illustrated Wavelet Transform Handbook: Introductory Theory and Applications in Science, Engineering, Medicine and Finance. Insti- tute of Physics Publishing, Bristol, 2002.
- Pankaj K. Agarwal, Sariel Har-Peled, Micha Sharir, and Yusu Wang. Hausdorff distance under translation for points and balls. In Proceedings of the 30th International Conference on Computer Graphics and Interactive Techniques - SIGGRAPH 2003, pages 282-291, San Diego, CA, June 8-10 2003. ACM.
- G. Barequet and M. Sharir. Partial surface and volume matching in three dimensions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(9):929-948, September 1997.
- P. J. Besl. The free-form surface matching problem. In H. Freeman, editor, Machine Vision for Three-Dimensional Scenes, pages 25-71. Academic Press, 1990.
- P. J. Besl and N. D. McKay. A method for registration of 3D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239--256, February 1992.
- P. Cachier and X. Pennec. 3D non-rigid registration by gradient descent on a Gaussian-windowed similarity measure using convolutions. In Proceedings of the IEEE Workshop on Mathematical Methods in Biomedical Image Analysis, 2000, pages 182 --189, Hilton Head Island, SC, 2000. IEEE.
- Carlos J. Camacho and Sandor Vajda. Protein-protein association kinetics and protein docking. Current Opinion in Structural Biology, 12:36-40, 2002.
- P. Campisi, A. Neri, G. Panci, and G. Scarano. Robust rotation-invariant texture classification using a model based approach. IEEE Transactions on Image Processing, 13:782-791, 2004.
- Y. Chen and G. Medioni. Object modeling by registration of multiple range images. In Proceedings of the 1991 IEEE International Conference on Robotics and Automation, pages 2724-2729, Sacramento, California, April 1991.
- C. S. Chua and R. Jarvis. 3D free-form surface registration and object recog- nition. International Journal of Computer Vision, 17(1):77-99, 1996.
- A. A. Cole-Rhodes, K. L. Johnson, J. LeMoigne, and I. Zavorin. Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient. IEEE Transactions on Image Processing, 12:1495- 1511, 2003.
- A. Collignon, F. Maes, D. Delaere, D. Vandermeulen, P. Suetens, and G. Mar- chal. Automated multimodality image registration using information theory. In Yves Bizais, Christian Barillot, and Robert Di Paola, editors, Proceedings of the 14th International Conference on Information Processing in Medical Imaging: IPMI '95, pages 263-274, Ile de Berder, France, June 26-30, 1995.
- W. R. Crum, L. D. Griffin, D. L. G. Hill, and D. J. Hawkes. Zen and the art of medical image registration: Correspondence, homology, and quality. Neurolmage, 20:1425-1437, 2003.
- Ingrid Daubechies. Ten Lectures on Wavelets. Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania, 1992.
- Paul Debevec. Knee, 1993. http://www.debevec.org/Knee/.
- T. K. Dey, J. Giesen, and S. Goswami. Shape segmentation and matching with flow discretization. In Frank Dehne, Jorg Riidiger Sack, and Michiel Smid, editors, Proceedings of the 8th International Workshop on Algorithms and Data Structures (WADS), volume 2748 of Lecture Notes in Computer Science, pages 25-36, Ottawa, Canada, 2003.
- M. N. Do and M. Vetterli. The Contourlet transform: an efficient directional multiresolution image representation. IEEE Transactions on Image Processing, 14(12):2091-2106, December 2005.
- C. Dorai and A. K. Jain. COSMOS-a representation scheme for 3D free-form objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(10):1115-1130, October 1997.
- Bruce Gooch Computer Scientist. Bruce Gooch's Brain, 2001. http://www.cs.utah.edu/-bgooch/BruceBrain.html.
- C. Guerra and V. Pascucci. Line-based object recognition using Hausdorff distance: from range images to molecular secondary structures. Image And Vision Computing, 23:405-415, 2005.
- S. Gundimada and V. Asari. Face detection technique based on rotation in- variant wavelet features. In Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'04), volume 2, pages 157-158, Las Vegas, Nevada, April 2004. IEEE.
- Inbal Halperin, Buyong Ma, Haim Wolfson, and Ruth Nussinov. Principles of docking: An overview of search algorithms and a guide to scoring functions. Proteins: Structure, Function, and Genetics, 47:409-443, 2002.
- Peter Hastreiter and Thomas Ertl. Integrated registration and visualization of medical image data. In Proceedings of Computer Graphics International (CGI), pages 78-85, Hannover, Germany, 1998. IEEE.
- Derek L. G. Hill, Philipp G. Batchelor, Mark Holden, and David J. Hawkes. Medical image registration. Physics in Medicine and Biology, 46:R1-R45, 2001.
- P. R. Hill, D. R. Bull, and C. N. Canagarajah. Rotationally invariant texture features using the dual-tree complex wavelet transform. In Proceedings of the International Conference on Image Processing (ICIP), pages 901-904, Vancou- ver, BC, Canada, September 10-13, 2000. IEEE.
- B. K. P. Horn. Closed-form solution of absolute orientation using unit quater- nions. Journal of the Optical Society of America, Series A, 4(4):629--642, 1987.
- J. Hoschek and D. Lasser. Fundamentals of Computer Aided Geometric Design. A. K. Peters, Wellesley, MA, 1993. Translated by L. L. Schumaker.
- P. W. Huang and S. K. Dai. Design of a two-stage content-based image retrieval system using texture similarity. Information Processing & Management, 40:81-- 96, 2004.
- Etienne Huot, Hussein Yahia, Isaac Cohen, and Isabelle Herlin. Matching structures by computing minimal paths on a manifold. Journal of Visual Communication and Image Representation, 13:302-312, 2002.
- Charles E. Jacobs, Adam Finkelstein, and David H. Salesin. Fast multireso- lution image querying. In Proceedings of SIGGRAPH '95, the 22nd Annual Conference on Computer Graphics and Interactive Techniques, pages 277-286, Los Angeles, CA, August 6-11, 1995.
- B. Javidi, I. Moon, S. Yeom, and E. Carapezza. Three-dimensional imaging and recognition of microorganism using single-exposure on-line (SEOL) digital holography. Optics Express, 13:4492-4506, 2005.
- M. Jenkinson and S. Smith. A global optimisation method for robust affine registration of brain images. Medical Image Analysis, 5:143-156, 2001.
- A. E. Johnson and M. Hebert. Recognizing objects by matching oriented points. In Proceedings of the 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pages 684-689, San Juan, Puerto Rico, June 1997.
- Eric M. Jones and Paul Fjeld. Gimbal angles, gimbal lock, and a fourth gimbal for Christmas, 2000. http://www.hq.nasa.gov/alsj/gimbals.html.
- A. Karasaridis and E. P. Simoncelli. A filter design technique for steerable pyramid image transforms. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pages 2389-2392, Atlanta, GA, May 1996. IEEE.
- Nick Kingsbury. Image processing with complex wavelets. Philosophical Transactions of The Royal Society of London Series A-Mathematical Physical and Engineering Sciences, 357:2543-2560, 1999.
- Nick Kingsbury. Complex wavelets for shift invariant analysis and filtering of signals. Applied and Computational Harmonic Analysis, 10(3):234-253, 2001.
- K. H. Ko, T. Maekawa, and N. M. Patrikalakis. An algorithm for optimal free- form object matching. Computer-Aided Design, 35(10):913-923, September 2003.
- K. H. Ko, T. Maekawa, N. M. Patrikalakis, H. Masuda, and F.-E. Wolter. Shape intrinsic properties for free-form object matching. Journal of Computing and Information Science in Engineering, 3(4):325-333, 2003.
- Pavel Krsek, TomaS Pajdla, and Vaclav Hlav'6. Differential invariants as the base of triangulated surface registration. Computer Vision and Image Understanding, 87:27-38, 2002.
- Hamid Laga, Hiroki Takahashi, and Masayuki Nakajima. Spherical wavelet descriptors for content-based 3D model retrieval. In Proceedings of the IEEE International Conference on Shape Modeling and Applications, Shape Modeling International (SMI 2006), page 15, Matsushima, Japan, 2006. IEEE.
- Moon-Chuen Lee and Chi-Man Pun. Rotation and scale invariant wavelet fea- ture for content-based texture image retrieval. Journal of the American Society for Information Science and Technology, 54(1):68-80, 2003.
- D. G. Lowe. Distinctive image features from scale-invariant keypoints. International Journal Of Computer Vision, 60:91-110, 2004.
- H. X. Luan, F. H. Qi, Z. Xue, L. Y. Chen, and D. G. Shen. Multimodality im- age registration by maximization of quantitative-qualitative measure of mutual information. Pattern Recognition, 41:285-298, 2008.
- L. Ma, T. N. Tan, Y. H. Wang, and D. X. Zhang. Efficient iris recognition by characterizing key local variations. IEEE Transactions on Image Processing, 13:739-750, 2004.
- J. B. A. Maintz and M. A. Viergever. A survey of medical image registration. Medical Image Analysis, 2:1 36, 1998.
- U. Malsch, C. Thieke, P. E. Huber, and R. Bendl. An enhanced block match- ing algorithm for fast elastic registration in adaptive radiotherapy. Physics In Medicine And Biology, 51:4789-4806, 2006.
- Matlab, 2007. The Mathworks, http://www.mathworks.com.
- Patrick Min. Binvox, 2006. http://www.google.com/search?q= binvox or http://www.cs.princeton.edu/ min/binvox/.
- X. Ming, T. Xu, and Z. X. Wang. Using multi-matching system based on a sim- plified deformable model of the human iris for iris recognition. In David Zhang and Anil K. Jain, editors, Proceedings of the First International Conference on Biometric Authentication, ICBA, volume 3072 of Lecture Notes in Computer Science, pages 434-441, Hong Kong, China, 2004.
- G. Mori, S. Belongie, and J. Malik. Efficient shape matching using shape contexts. IEEE Transactions On Pattern Analysis And Machine Intelligence, 27:1832-1837, 2005.
- P. Mr6azek and J. Weickert. Rotationally invariant wavelet shrinkage. In B. Michaelis and G. Krell, editors, Proceedings of the German Association for Pattern Recognition (DAGM), volume 2781 of Lecture Notes in Computer Science, pages 156-163. Springer, 2003.
- David C. Munson, Jr. A note on Lena. IEEE Transactions on Image Processing, 5(1):3, 1996.
- A. Natsev, R. Rastogi, and K. Shim. WALRUS: A similarity retrieval algorithm for image databases. IEEE Transactions on Knowledge and Data Engineering, 16:301-316, 2004.
- A. Nelleri, U. Gopinathan, J. Joseph, and K. Singh. Three-dimensional object recognition from digital Fresnel hologram by wavelet matched filtering. Optics Communications, 259:499-506, 2006.
- N. S. Netanyahu, J. Le Moigne, and J. G. Masek. Georegistration of LANDSAT data via robust matching of multiresolution features. IEEE Transactions on Geoscience and Remote Sensing, 42:1586-1600, 2004.
- F. S. Nooruddin and G. Turk. Simplification and repair of polygonal models using volumetric techniques. IEEE Transactions on Visualization and Computer Graphics, 9:191-205, 2003.
- T. Pajdla and L. Van Gool. Matching of 3-D curves using semi-differential invariants. In 5th International Conference on Computer Vision, pages 390- 395, Cambridge, MA, 1995. IEEE Computer Society Press.
- K. Park, D. Metaxas, and L. Axel. A finite element model for functional analysis of 4D cardiac-tagged MR images. In Randy E. Ellis and Terry M. Peters, edi- tors, Medical Image Computing and Computer-Assisted Intervention -MICCAI 2003, Pt 1, volume 2878 of Lecture Notes in Computer Science, pages 491-498, 2003.
- N. M. Patrikalakis and T. Maekawa. Shape Interrogation for Computer Aided Design and Manufacturing. Springer-Verlag, Heidelberg, February 2002.
- V. Pekar, E. Gladilin, and K. Rohr. An adaptive irregular grid approach for 3d deformable image registration. Physics In Medicine And Biology, 51:361-377, 2006.
- Chi-Man Pun and Moon-Chuen Lee. Extraction of shift invariant wavelet fea- tures for classification of images with different sizes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(9):1228-1233, 2004.
- Lawrence R. Rabiner and Charles M. Rader. Digital Signal Processing. IEEE Press, New York, 1972.
- Scott Reed, Yvan Petillot, and Judith Bell. An automatic approach to the detection and extraction of mine features in sidescan sonar. IEEE Journal of Oceanic Engineering, 28(1):90-105, January 2003.
- Phil Schewe and Ben Stein. MRI with 80-nanometer resolution. Physics News Update, 680:1, 2004.
- H. Schneiderman and T. Kanade. Object detection using the statistics of parts. International Journal of Computer Vision, 56:151-177, 2004.
- David W. Scott. Averaged shifted histograms: Effective nonparametric density estimators in several dimensions. The Annals of Statistics, 13(3):1024-1040, 1985.
- Y. Shan, H. S. Sawhney, B. Matei, and R. Kumar. Shapeme histogram projec- tion and matching for partial object recognition. IEEE Transactions On Pattern Analysis And Machine Intelligence, 28:568-577, 2006.
- R. Shekhar, V. Walimbe, S. Raja, V. Zagrodsky, M. Kanvinde, G. Y. Wu, and B. Bybel. Automated 3-dimensional elastic registration of whole-body pet and ct from separate or combined scanners. Journal Of Nuclear Medicine, 46:1488- 1496, 2005.
- H. Shimazaki and S. Shinomoto. A method for selecting the bin size of a time histogram. Neural Computation, 19:1503-1527, 2007.
- E. P. Simoncelli and W. Freeman. The steerable pyramid: A flexible architecture for multi-scale derivative computation. In Proceedings of the International Conference on Image Processing (ICIP), pages 444-447, Washington, DC, 1995. IEEE.
- B. J. Son, J. H. Ahn, J. H. Park, and Y. B. Lee. Identification of humans using robust biometric features. Structural, Syntactic, and Statistical Pattern Recognition, Proceedings, 3138:903-911, 2004.
- Murray R. Spiegel. Schaum's Outline Series, Theory and Problems of Statistics, 2nd Edition. McGraw-Hill, Inc., New York, 1988. Eighth printing, 1994.
- T. Srinark, C. Kambhamettu, and M. Stone. A hierarchical method for 3D rigid motion estimation. In P.J. Narayanan, Shree K. Nayar, and Heung-Yeung Shum, editors, Proceedings of the Asian Conference on Computer Vision -ACCV 2006, Pt II, volume 3852 of Lecture Notes in Computer Science, pages 791-800, Hyderabad, India, 2006.
- Stanford University. The Stanford 3D Scanning Repository, 2005. http:// graphics.stanford.edu/data/3Dscanrep/.
- F. Stein and G. Medioni. Structural indexing: Efficient 3-D object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):125- 145, February 1992.
- Eric J. Stollnitz, Tony D. DeRose, and David H. Salesin. Wavelets for Computer Graphics. Morgan Kaufmann Publishers, Inc., San Francisco, California, 1996.
- G. Strang and T. Nguyen. Wavelets and filter banks. Wellesley-Cambridge Press, Wellesley, Massachusetts, 1996.
- C. Studholme, D. L. G. Hill, and D. J. Hawkes. Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures. Medical Physics, 24:25-35, 1997.
- M. Styner, G. Gerig, J. Lieberman, D. Jones, and D. Weinberger. Statistical shape analysis of neuroanatomical structures based on medial models. Medical Image Analysis, 7:207-220, 2003.
- Yiyong Sun, Joonki Paik, Andreas Koschan, David L. Page, and Mongi A. Abidi. Point fingerprint: A new 3-D object representation scheme. IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics, 33(4):712--717, 2003.
- Johan W.H. Tangelder and Remco C. Veltkamp. Polyhedral model retrieval using weighted point sets. In Proceedings of the International Conference on Shape Modeling and Applications, pages 119-129, Seoul, Korea, May 12-15, 2003. IEEE.
- C. J. Tymczak, Anders M. N. Niklasson, and Heinrich R6der. Separable and nonseparable multiwavelets in multiple dimensions. Journal of Computational Physics, 175(2):363-397, 2002.
- M. Urschler, J. Bauer, H. Ditt, and H. Bischof. SIFT and shape context for feature-based nonlinear registration of thoracic CT images. Computer Vision Approaches To Medical Image Analysis, 4241:73-84, 2006.
- Ilya A. Vakser, Omar G. Matar, and Chan F. Lam. A systematic study of low- resolution recognition in protein-protein complexes. Proceedings of the National Academy of Sciences, 96:8477-8842, July 1999.
- D. Van De Ville, T. Blu, and M. Unser. Isotropic polyharmonic B-splines: Scaling functions and wavelets. IEEE Transactions on Image Processing, 14(11):1798-1813, November 2005.
- P. A. Viola. Alignment by maximization of mutual information. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, 1995.
- F. Wang, B.C. Vemuri, M. Rao, and Y Chen. A new & robust information theoretic measure and its application to image alignment. In Chris Taylor and J. Alison Noble, editors, Proceedings of the Conference on Information Processing in Medical Imaging : IPMI03, volume 2732 of Lecture Notes in Computer Science, pages 388-400, Ambleside, UK, July 2003.
- James Ze Wang, Jia Li, Gio Wiederhold, and Oscar Firschein. System for screening objectionable images. Computer Communications, 21(15):1355-1360, 1998.
- James Ze Wang, Gio Wiederhold, Oscar Firschein, and Sha Xin Wei. Wavelet- based image indexing techniques with partial sketch retrieval capability. In Proceedings of the Fourth International Forum on Research and Technology Advances in Digital Libraries, pages 13-24. IEEE Computer Society, 1997.
- Y. J. Wang and C. S. Chua. Face recognition from 2D and 3D images using 3D Gabor filters. Image And Vision Computing, 23:1018-1028, 2005.
- Yongmei Wang, Bradley S. Peterson, and Lawrence H. Staib. 3D brain surface matching based on geodesics and local geometry. Computer Vision and Image Understanding, 89:252-271, 2003.
- Eric W. Weisstein. Rotation Matrix, 2006. From MathWorld-A Wolfram Web Resource. http: //mathworld. wolfram. com/Rotat ionMatrix .html.
- W.M. Wells, P. Viola, H. Atsumi, S. Nakajima, and R. Kikinis. Multi-modal volume registration by maximization of mutual information. Medical Image Analysis, 1:35-52, 1996.
- R. P. Woods, J. C. Mazziotta, and S. R. Cherry. MRI-PET registration with automated algorithm. Journal Of Computer Assisted Tomography, 17:536-546, 1993.
- R. Xu and Y. W. Chen. Wavelet-based multiresolution medical image reg- istration strategy combining mutual information with spatial information. International Journal Of Innovative Computing Information And Control, 3:285-296, 2007.
- Z. Xue, D. G. Shen, and C. Davatzikos. Correspondence detection using wavelet- based attribute vectors. In Randy E. Ellis and Terry M. Peters, editors, Medical Image Computing and Computer-Assisted Intervention -MICCAI 2003, Pt 2, volume 2879 of Lecture Notes in Computer Science, pages 762-770, 2003.
- S. M. Yamany and A. A. Farag. Surface signatures: An orientation indepen- dent free-form surface representation scheme for the purpose of objects regis- tration and matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(8):1105-1120, 2002.
- X. Z. Yang, G. Pang, and N. Yung. Discriminative training approaches to fabric defect classification based on wavelet transform. Pattern Recognition, 37:889-899, 2004.
- S. Yeom and B. Javidi. Three-dimensional object feature extraction and classi- fication with computational holographic imaging. Applied Optics, 43:442-451, 2004.
- S. Yeom, B. Javidi, Y. J. Roh, and H. S. Cho. Three-dimensional object recog- nition using x-ray imaging. Optical Engineering, 44(2):27201.1-23, 2005.
- Mitsuo Yokokawa, Ken'ichi Itakura, Atsuya Uno, Takashi Ishihara, and Yukio Kaneda. 16.4-Tflops direct numerical simulation of turbulence by a Fourier spectral method on the Earth Simulator. In Proceedings of the 2002 ACM/IEEE Conference on Supercomputing, pages 1-17. IEEE Computer Society Press, 2002.
- H. Yoshida. Local contralateral subtraction based on bilateral symmetry of lung for reduction of false positives in computerized detection of pulmonary nodules. IEEE Transactions on Biomedical Engineering, 51:778-789, 2004.
- Q. Z. Yu, J. W. Tian, and H. Liu. A novel contour-based 3D terrain matching algorithm using wavelet transform. Pattern Recognition Letters, 25:87-99, 2004.
- Y. P. Zhang and R. L. Wang. Neural network combines with a rota- tional invariant feature set in texture classification. In Chengqi Zhang,
- Hans W. Guesgen, and Wai K. Yeap, editors, Proceedings of the Pacific Rim International Conference on Artificial Intelligence PRICAI 2004: Trends in Artificial Intelligence, volume 3157 of Lecture Notes in Computer Science, pages 436-444, 2004.
- Z. Zhang. Iterative point matching for registration of free-form curves and surfaces. International Journal of Computer Vision, 13(2):119-152, 1994.
- Hui Zhou, Takashi Takenaka, and Toshiyuki Tanaka. Three-dimensional recon- struction of a shallowly buried mine using time-domain data. Microwave and Optical Technology Letters, 39(4):276-280, 2003.