Tensor Processing for Texture and Colour Segmentation
2005, Lecture Notes in Computer Science
https://doi.org/10.1007/11499145_113Abstract
In this paper, we propose an original approach for texture and colour segmentation based on the tensor processing of the nonlinear structure tensor. While the tensor structure is a well established tool for image segmentation, its advantages were only partly used because of the vector processing of that information. In this work, we use more appropriate definitions of tensor distance grounded in concepts from information theory and compare their performance on a large number of images. We clearly show that the traditional Frobenius norm-based tensor distance is not the most appropriate one. Symmetrized KL divergence and Riemannian distance intrinsic to the manifold of the symmetric positive definite matrices are tested and compared. Adding to that, the extended structure tensor and the compact structure tensor are two new concepts that we present to incorporate gray or colour information without losing the tensor properties. The performance and the superiority of the Riemannian based approach over some recent studies are demonstrated on a large number of gray-level and colour data sets as well as real images.
References (25)
- J. Bigun, G. H. Grandlund, and J. Wiklund, "Multidimensional orientation esti- mation with applications to texture analysis and optical flow," IEEE Trans. on PAMI, 13(8): 775-790, 1991.
- J. Bigun, G. H. Grandlund "Optimal orientation detection of linear symmetry," Proc. 1st IEEE ICCV, London, June 1987
- A. C. Bovik, M. Clark, and W. S. Geisler, "Multichannel texture analysis using localized spatial filters," IEEE Trans. on PAMI, 12(1): 55-73, 1990.
- T. Brox and J. Weickert, "Nonlinear matrix diffusion for optic flow estimation," in Proc. of the 24th DAGM Symp. , vol. 2449 of LNCS, Zurich, Switzerland, sep 2002, pp. 446-453.
- T. Brox, M. Rousson, R. Deriche, and J. Weickert, "Unsupervised segmentation incorporating colour, texture, and motion," INRIA, Research Rep. 4760, mar 2003.
- T. Brox, J. Weickert, B. Burgeth, P. Mrázek "Nonlinear structure tensors", Preprint No. 113, Department of Mathematics, Saarland University, Saarbrücken, Germany. Oct. 2004
- T. F. Chan and L. A. Vese, "Active contours without edges," IEEE Trans. on IP, 10(2): 266-277, 2001. Pattern Recognition 36(9): 1929-1943. 2003.
- D. Cremers, F. Tischhauser, J. Weickert and C. Schnorr, "Diffusion Snakes: Introducing Statistical Shape Knowledge into the Mumford-Shah Functional", In- ternational Journal of Computer Vision 50(3): 295-313; Dec 2002
- A. Dervieux and F. Thomasset "A finite element method for the simulation of Rayleigh-Taylor instability" Lecture Notes in Mathematics, 771:145-159, 1979
- A. Dervieux and F. Thomasset "Multifluid incompressible flows by a finite element method" In International Conference on Numerical Methods in Fluid Dynamics, 158-163, 1980
- C. Feddern, J. Weickert, B. Burgeth and M. Welk "Curvature-driven PDE methods for matrix-valued images.", Technical Report No. 104, Department of Mathematics, Saarland University, Saarbrücken, Germany, Apr. 2004.
- W. Foerstner and E. Gulch, "A fast operator for detection and precise location of distinct points, corners and centres of circular features", in: Intercomm. Conf. on Fast Proc. of Photogrammetric. Data, Interlaken, June 1987, pp. 281-305.
- C. Lenglet, M. Rousson, R. Deriche, and O. Faugeras, "Statistics on multivariate normal distributions: A geometric approach and its application to diffusion tensor mri," INRIA, Research Report 5242, Jun 2004.
- C. Lenglet, M. Rousson, R. Deriche, and O. Faugeras, "Toward segmentation of 3D probability density fields by surface evolution: Application to diffusion mri," INRIA, Research Rep. 5243, June 2004.
- C. Lenglet, M. Rousson, and R. Deriche, "Segmentation of 3d probability density fields by surface evolution: Application to diffusion mri," in Proc. of the MICCAI, Saint Malo, France, Sep. 2004.
- M. E. Leventon, O. Faugeras, W. E. L. Grimson, and W. M. W. III, "Level set based segmentation with intensity and curvature priors," in Proc. of the IEEE Workshop on MMBIA, Hilton Head, SC, USAs, jun 2000, pp. 4-11.
- R. de Luis-Garcia, R. Deriche, C. Lenglet, and M. Rousson, "Tensor processing for texture and colour segmentation," INRIA, Research. Rep., in press.
- R. Malladi, J. A. Sethian, and B. C. Vemuri, "Shape modeling with front propa- gation: A level set approach," IEEE Trans. on PAMI, 17(2): 158-175, feb 1995.
- N. Paragios and R. Deriche, "Geodesic active regions and level set methods for supervised texture segmentation," The International Journal of Computer Vision, 46(3): 223-247, 2002.
- N. Paragios and R. Deriche, "Geodesic active regions: A new framework to deal with frame partition problems in computer vision," Journal of Visual Communi- cation and Image Representation, vol. 13, pp. 249-268, 2002.
- M. Rousson, T. Brox, and R. Deriche, "Active unsupervised texture segmentation on a diffusion based feature space," in Proc. of CVPR, Madison, Wisconsin, USA, jun 2003.
- M. Rousson, C. Lenglet, and R. Deriche, "Level set and region based surface prop- agation for diffusion tensor mri segmentation," in Proc. of the Computer Vision Approaches to Medical Image Analysis Workshop, Prague, May 2004.
- S. Osher and J. A. Sethian, "Fronts propagating with curvature dependent speed: Algorithms based on hamilton-jacobi formulation," Journal of Computational Physics, vol. 79, pp. 12-49, 1988.
- Z. Wang and B. C. Vemuri, "An affine invariant tensor dissimilarity measure and its applications to tensor-valued image segmentation," in Proc. of the IEEE CVPR, Washington DC, USA, 2004, pp. 228-233.
- Z. Wang and B. C.Vemuri, "Tensor field segmentation using region based active contour model," in Proc. of the ECCV, Prague, Czech Republic, may 2004.