Academia.eduAcademia.edu

Outline

Title
Abstract
Results
Conclusions and Future Works
References
All Topics
Computer Science
Computer Graphics

Nonlocal Markovian models for image denoising

Profile image of Nelson MascarenhasNelson Mascarenhas

2016, Journal of Electronic Imaging

https://doi.org/10.1117/1.JEI.25.1.013003
visibility

…

description

21 pages

link

1 file

Abstract

Currently, the state-of-the art methods for image denoising are patch-based approaches. Redundant information present in nonlocal regions (patches) of the image is considered for better image modeling, resulting in an improved quality of filtering. In this respect, nonlocal Markov random field (MRF) models are proposed by redefining the energy functions of classical MRF models to adopt a nonlocal approach. With the new energy functions, the pairwise pixel interaction is weighted according to the similarities between the patches corresponding to each pair. Also, a maximum pseudolikelihood estimation of the spatial dependency parameter (β) for these models is presented here. For evaluating this proposal, these models are used as an a priori model in a maximum a posteriori estimation to denoise additive white Gaussian noise in images. Finally, results display a notable improvement in both quantitative and qualitative terms in comparison with the local MRFs.

Related papers

Image Denoising Algorithms: From Wavelet Shrinkage to Nonlocal Collaborative Filtering
Aleksandra Pizurica

Wiley Encyclopedia of Electrical and Electronics Engineering, 2017

This paper presents an overview of image denoising algorithms ranging from wavelet shrinkage to patchbased non-local processing. The focus is on the suppression of additive Gaussian noise (white and coloured). A great attention is devoted to explaining the main underlying ideas and concepts of representative approaches with illustrative examples, accessible also to non-experts in the field. A Bayesian perspective of wavelet shrinkage is given, with different instances of spatial context modelling (including local spatial activity indicators, Markov Random Fields, Hidden Markov Tree models and Gaussian Scale Mixture models). Extensions to other transform domains (curvelets and other generalizations of wavelets) are addressed too, showing the benefits in terms of image quality. Patch-based image denoising is illustrated with principles of non-local means filtering and collaborative filtering, explaining also the connections with dictionary learning. Some general notes on the performance comparison are given, by summarizing the benefits and limitations of various approaches against each other, and pointing to some of the current trends in the field.

View PDFchevron_right
Learning real-time MRF inference for image denoising
Adrian Barbu

2009

Abstract Many computer vision problems can be formulated in a Bayesian framework with Markov Random Field (MRF) or Conditional Random Field (CRF) priors. Usually, the model assumes that a full Maximum A Posteriori (MAP) estimation will be performed for inference, which can be really slow in practice. In this paper, we argue that through appropriate training, a MRF/CRF model can be trained to perform very well on a suboptimal inference algorithm.

View PDFchevron_right
Analysis of Non Local Image Denoising Methods
alvaro Pardo

2009

Image denoising is probably one of the most studied problems in the image processing community. Recently a new paradigm on non local denoising was introduced. The Non Local Means method proposed by Buades, Morel and Coll attracted the attention of other researches who proposed improvements and modifications to their proposal. In this work we analyze those methods trying to understand their properties while connecting them to segmentation based on spectral graph properties. We also propose some improvements to automatically estimate the parameters used on these methods.

View PDFchevron_right
Image de-noising using Markov Random Field in Wavelet Domain
IJSRP Journal

Removing noise from original image is still a challenging problem for researchers. There have been several published algorithm and each approach has its assumptions, advantages and disadvantages. Markov Random Field is n-dimensional random process defined on a on a discrete lattice. Markov Random Field is a new branch of probability theory that promises to be important both in theory and application of probability. This paper is an attempt to present the basic idea of the subject and its application in image denoising to the wider audience. In this paper, a novel approach for image denoising is introduced using ICM (Iterated Conditional Modes) approach of Markov Random Fields model.

View PDFchevron_right
Markov random field models in image processing
Anand Rangarajan

1995

View PDFchevron_right
Bayesian Non-local Means Filter, Image Redundancy and Adaptive Dictionaries for Noise Removal
Charles Kervrann

Lecture Notes in Computer Science, 2007

Partial Differential equations (PDE), wavelets-based methods and neighborhood filters were proposed as locally adaptive machines for noise removal. Recently, Buades, Coll and Morel proposed the Non-Local (NL-) means filter for image denoising. This method replaces a noisy pixel by the weighted average of other image pixels with weights reflecting the similarity between local neighborhoods of the pixel being processed and the other pixels. The NL-means filter was proposed as an intuitive neighborhood filter but theoretical connections to diffusion and non-parametric estimation approaches are also given by the authors. In this paper we propose another bridge, and show that the NL-means filter also emerges from the Bayesian approach with new arguments. Based on this observation, we show how the performance of this filter can be significantly improved by introducing adaptive local dictionaries and a new statistical distance measure to compare patches. The new Bayesian NL-means filter is better parametrized and the amount of smoothing is directly determined by the noise variance (estimated from image data) given the patch size. Experimental results are given for real images with artificial Gaussian noise added, and for images with real imagedependent noise.

View PDFchevron_right
An Improved Nonlocal Denoising Algorithm
Bart Goossens

2000

Recently, the NLMeans filter has been proposed by Buades et al. for the suppression of white Gaussian noise. This filter exploits the repetitive character of structures in an image, unlike conventional denoising algorithms, which typically operate in a local neighbourhood. Even though the method is quite intuitive and potentially very powerful, the PSNR and visual results are somewhat infe- rior

View PDFchevron_right
Restoration of noisy images modeled by Markov random fields with Gibbs distribution
Majid Ahmadi

IEEE Transactions on Circuits and Systems, 1989

This paper develops techniques for restoration of noisy images using Markov/Gibbs random fields. In the schemes to be presented, the local characteristics of the noise-free image is described by painvise interaction Markov random fiekl, while the noise assumed to be mainly additive is modeled as a zero mean Gaussian process. "be estimation of the clean image is based on the MAP criterion. The contributions of this paper include: (a) restoration algorithms for binary images, multilevel images as well (b) the use of pupdratic potential function to restore images with as images with near continuous gray level distribution, continuous gray level distribution. Optimal estimates of the clean image are derived with p p e r choice of performance criteria. Studies undertaken with a variety of images have confmed the feasibility of the proposed techniques under conditions of high noise.

View PDFchevron_right
A joint inter-and intrascale statistical model for Bayesian wavelet based image denoising
Aleksandra Pizurica

… , IEEE Transactions on, 2002

This paper presents a new wavelet-based image denoising method, which extends a recently emerged "geometrical" Bayesian framework. The new method combines three criteria for distinguishing supposedly useful coefficients from noise: coefficient magnitudes, their evolution across scales and spatial clustering of large coefficients near image edges. These three criteria are combined in a Bayesian framework. The spatial clustering properties are expressed in a prior model. The statistical properties concerning coefficient magnitudes and their evolution across scales are expressed in a joint conditional model. The three main novelties with respect to related approaches are: (1) the interscale-ratios of wavelet coefficients are statistically characterized, and different local criteria for distinguishing useful coefficients from noise are evaluated; (2) a joint conditional model is introduced, and (3) a novel anisotropic Markov Random Field prior model is proposed. The results demonstrate an improved denoising performance over related earlier techniques.

View PDFchevron_right
Learning Non-local Image Diffusion for Image Denoising
CHEN jacky

Proceedings of the 25th ACM international conference on Multimedia, 2017

Image diffusion plays a fundamental role for the task of image denoising. Recently proposed trainable nonlinear reaction diffusion (TNRD) model defines a simple but very effective framework for image denoising. However, as the TNRD model is a local model, the diffusion behavior of which is purely controlled by information of local patches, it is prone to create artifacts in the homogenous regions and over-smooth highly textured regions, especially in the case of strong noise levels. Meanwhile, it is widely known that the non-local selfsimilarity (NSS) prior stands as an effective image prior for image denoising, which has been widely exploited in many nonlocal methods. In this work, we are highly motivated to embed the NSS prior into the TNRD model to tackle its weaknesses. In order to preserve the expected property that end-to-end training is available, we exploit the NSS prior by a set of non-local filters, and derive our proposed trainable non-local reaction diffusion (TNLRD) model for image denoising. Together with the local filters and influence functions, the non-local filters are learned by employing loss-specific training. The experimental results show that the trained TNLRD model produces visually plausible recovered images with more textures and less artifacts, compared to its local versions. Moreover, the trained TNLRD model can achieve strongly competitive performance to recent state-of-theart image denoising methods in terms of peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM).

View PDFchevron_right

References (54)

  1. Taj Mahal 20.28 (0.02) 22.52 (0.04) 24.36 (0.01) 21.73 (0.01) 23.77 (0.02) 22.16 (0.03) 23.34 (0.03) 26.80 (0.03) 28.94 (0.03) 23.89 (2.20)
  2. Walk Bridge 20.16 (0.01) 22.70 (0.01) 24.52 (0.01) 22.09 (0.01) 22.99 (0.02) 22.29 (0.02) 22.92 (0.01) 24.32 (0.01) 26.34 (0.01) 23.32 (1.29)
  3. Note: GMRF, Gaussian Markov random field; NLGMRF, nonlocal Gaussian Markov random field; GIMLL, generalized multilevel logistic; NLGIMLL, nonlocal generalized multi-level logistic; NLM, nonlocal means; BM3D, block matching and three-dimensional filtering. Journal of Electronic Imaging 013003-11 Jan∕Feb 2016 • Vol. 25(1)
  4. Salvadeo, Mascarenhas, and Levada: Nonlocal Markovian models for image denoising Downloaded From: https://www.spiedigitallibrary.org/journals/Journal-of-Electronic-Imaging on 13 Jun 2019 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use Swan 17.19 (0.01) 24.05 (0.04) 25.24 (0.02) 24.04 (0.02) 25.95 (0.03) 24.02 (0.06) 24.60 (0.05) 27.35 (0.05) 28.30 (0.05) 25.22 (1.46)
  5. Sea Star 16.48 (0.02) 22.67 (0.04) 24.66 (0.04) 22.68 (0.02) 23.46 (0.02) 22.48 (0.04) 22.79 (0.03) 24.85 (0.03) 25.89 (0.04) 23.46 (1.17)
  6. Taj Mahal 16.53 (0.01) 21.92 (0.02) 23.38 (0.02) 21.47 (0.01) 23.20 (0.03) 21.72 (0.04) 22.41 (0.03) 25.23 (0.05) 26.22 (0.04) 22.95 (1.54)
  7. Jet Plane 16.65 (0.01) 24.21 (0.04) 26.03 (0.03) 24.48 (0.02) 26.11 (0.04) 24.07 (0.04) 24.50 (0.05) 27.48 (0.03) 29.13 (0.05) 25.45 (1.65)
  8. Living Room 16.27 (0.02) 23.52 (0.02) 24.91 (0.02) 23.62 (0.01) 24.40 (0.02) 23.33 (0.03) 23.51 (0.04) 25.47 (0.03) 27.13 (0.03) 24.26 (1.20)
  9. Walk Bridge 16.41 (0.01) 22.08 (0.03) 23.57 (0.01) 21.87 (0.01) 22.38 (0.03) 21.83 (0.02) 21.99 (0.02) 23.61 (0.03) 24.26 (0.03) 22.53 (0.88)
  10. Mean 16.50 (0.23) 22.65 (1.86) 24.13 (1.86) 22.68 (2.46) 23.81 (2.35) 22.49 (1.94) 22.84 (1.79) 25.32 (1.78) 26.59 (2.24) 23.57 (2.42) Journal of Electronic Imaging 013003-13 Jan∕Feb 2016 • Vol. 25(1)
  11. Salvadeo, Mascarenhas, and Levada: Nonlocal Markovian models for image denoising Downloaded From: https://www.spiedigitallibrary.org/journals/Journal-of-Electronic-Imaging on 13 Jun 2019 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use References
  12. M. Elad, M. Figueiredo, and Y. Ma, "On the role of sparse and redun- dant representations in image processing," Proc. IEEE 98, 972-982 (2010).
  13. P. Chatterjee and P. Milanfar, "Is denoising dead?," IEEE Trans. Image Process. 19, 895-911 (2010).
  14. D. T. Kuan et al., "Adaptive noise smoothing filter for images with signal-dependent noise," IEEE Trans. Pattern Anal. Mach. Intell. 7(2), 165-177 (1985).
  15. A. Buades, B. Coll, and J. M. Morel, "A review of image denoising algorithms, with a new one," SIAM Multiscale Model. Simul. 4(2), 490-530 (2005).
  16. B. Goossens et al., "An overview of state-of-the-art denoising and demosaicking techniques: toward a unified framework for handling artifacts during image reconstruction," in International Image Sensor Workshop (IISW) (2015).
  17. P. Perona and J. Malik, "Scale-space and edge detection using aniso- tropic diffusion," IEEE Trans. Pattern Anal. Mach. Intell. 12, 629-639 (1990).
  18. L. Alvarez, P.-L. Lions, and J.-M. Morel, "Image selective smoothing and edge detection by nonlinear diffusion II," SIAM J. Numer. Anal. 29(3), 845-866 (1992).
  19. M. Black et al., "Robust anisotropic diffusion," IEEE Trans. Image Process. 7, 421-432 (1998).
  20. J. Weickert, Anisotropic Diffusion in Image Processing, Vol. 1, ECMI Series, Teubner-Verlag, Stuttgart, Germany (1998).
  21. L. I. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Phys. D 60(1-4), 259-268 (1992).
  22. A. Chambolle, "An algorithm for total variation minimization and applications," J. Math. Imaging Vision 20(1-2), 89-97 (2004).
  23. D. Donoho, "De-noising by soft-thresholding," IEEE Trans. Inf. Theory 41, 613-627 (1995).
  24. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Sixth International Conference on Computer Vision (ICCV'1998), pp. 839-846 (1998).
  25. S. Paris et al., "Bilateral filtering: theory and applications," Found. Trends Comp. Graph. Vision 4(1), 1-73 (2008).
  26. K. Dabov et al., "Image denoising by sparse 3-D transform-domain collaborative filtering," IEEE Trans. Image Process. 16, 2080-2095 (2007).
  27. E. Candes, J. Romberg, and T. Tao, "Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency informa- tion," IEEE Trans. Inf. Theory 52, 489-509 (2006).
  28. J. Jin et al., "General image denoising framework based on compressive sensing theory," Comp. Graph. 38, 382-391 (2014).
  29. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell. 6, 721-741 (1984).
  30. S. Z. Li, Markov Random Field Modeling in Image Analysis, in Advances in Pattern Recognition, 3rd ed., Springer, London, UK (2009).
  31. F.-C. Jeng and J. Woods, "Compound Gauss-Markov random fields for image estimation," IEEE Trans. Signal Process. 39, 683-697 (1991).
  32. D. H. P. Salvadeo, "Filtragem de Ruído em Imagens Tomográficas com Baixa Taxa de Contagem Utilizando uma Abordagem Bayesiana Contextual," PhD Thesis, Universidade Federal de São Carlos (2013) (in Portuguese).
  33. G. Peyré, "A review of adaptive image representations," IEEE J. Sel. Top. Signal Process. 5, 896-911 (2011).
  34. Y. Chen et al., "Bayesian statistical reconstruction for low-dose X-ray computed tomography using an adaptive-weighting nonlocal prior," Comp. Med. Imaging Graph. 33, 495-500 (2009).
  35. Y. Chen et al., "PET transmission tomography using a novel nonlocal MRF prior," Comp. Med. Imaging Graph. 33, 623-633 (2009).
  36. M. Zhao et al., "Satellite image deconvolution based on nonlocal means," Appl. Opt. 49, 6286-6294 (2010).
  37. J. Sun and M. Tappen, "Learning non-local range Markov random field for image restoration," in IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011), pp. 2745-2752 (2011).
  38. C. S. Won and R. M. Gray, Stochastic Image Processing, Information Technology: Transmission, Processing, and Storage, Kluwer Academic/Plenum Publishers, New York (2004).
  39. C. Deledalle, "Image denoising beyond additive Gaussian noise patch- based estimators and their application to SAR imagery," PhD Thesis, Télécom ParisTech (2011).
  40. C. Deledalle, L. Denis, and F. Tupin, "How to compare noisy patches? patch similarity beyond gaussian noise," Int. J. Comp. Vision 99, 86-102 (2012).
  41. C. Deledalle, L. Denis, and F. Tupin, "Iterative weighted maximum likelihood denoising with probabilistic patch-based weights," IEEE Trans. Image Process. 18, 2661-2672 (2009).
  42. J. Besag, "Statistical analysis of non-lattice data," J. R. Stat. Soc. 24(3), 179-195 (1975).
  43. A. L. M. Levada, N. D. A. Mascarenhas, and A. Tannús, "Pseudolikelihood equations for Potts MRF model parameter estimation on higher order Journal of Electronic Imaging 013003-19 Jan∕Feb 2016 • Vol. 25(1)
  44. Salvadeo, Mascarenhas, and Levada: Nonlocal Markovian models for image denoising Downloaded From: https://www.spiedigitallibrary.org/journals/Journal-of-Electronic-Imaging on 13 Jun 2019 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use neighborhood systems," IEEE Geosci. Remote Sens. Lett. 5, 522-526 (2008).
  45. A. Martins et al., "MAP-MRF super-resolution image reconstruction using maximum pseudo-likelihood parameter estimation," in 16th IEEE Int. Conf. on Image Processing (ICIP 2009), pp. 1165-1168 (2009).
  46. J. Besag, "On the statistical analysis of dirty pictures," J. R. Stat. Soc. Ser. B 48(3), 259-302 (1986).
  47. R. Brent, Algorithms for Minimization without Derivatives, Prentice- Hall, Englewood Cliffs, New Jersey (1973).
  48. C. Deledalle, V. Duval, and J. Salmon, "Non-local methods with shape- adaptive patches (NLM-SAP)," J. Math. Imaging Vision 43, 103-120 (2012).
  49. P. Arbelaez et al., "Contour detection and hierarchical image segmen- tation," IEEE Trans. Pattern Anal. Mach. Intell. 33, 898-916 (2011).
  50. Z. Wang and A. C. Bovik, "Mean squared error: love it or leave it? a new look at signal fidelity measures," IEEE Signal Process. Mag. 26, 98-117 (2009).
  51. Denis H. P. Salvadeo received his BSc, MSc, and PhD in computer science from the Federal University of São Carlos (UFSCar), São
  52. Carlos, Brazil, in 2007, 2009, and 2013, respectively. He is currently a professor of computer science at São Paulo State University (UNESP), Rio Claro, Brazil. His research interests include digital image processing, computer vision, medical images, random field models, and nonlocal approaches.
  53. Nelson D. A. Mascarenhas received his BSc and MSc in electronic engineering from the Technological Institute of Aeronautics, São José dos Campos, Brazil, in 1966 and 1969 and a PhD in electrical engineering from the University of Southern California in 1974. He is presently associated with Faculdade Campo Limpo Paulista, Brazil. His research interests are in digital image processing and pattern recognition.
  54. Alexandre L. M. Levada received his BSc degree in computer sci- ence from São Paulo State University (UNESP) in 2002, MSc degree in computer science from Federal University of São Carlos (UFSCar) in 2006, and PhD degree in computational physics from São Paulo University (USP) in 2010. He is a professor of computer science at Federal University of São Carlos, SP, Brazil. His research interests include pattern recognition, image processing, and random field models.

Related papers

Markovian clustering for the non-local means image denoising
Reza Farrahi Moghaddam

Image Processing (ICIP), …, 2009

The non-local means filter is one of powerful denoising methods which allows participation of far, but proper pixels in the denoising process. Although the weights of non-similar pixels are very small, high number of these pixels results in introduction of blur. In this work, we introduce an automatic and robust method to select the best candidate pixels based on their similarity to the target pixel. This method is based on graphs partitioning and uses Markovian clustering on the pixel adjacency graph (PAG). In this way, a set of relevant pixels is obtained that is used in weighted averaging for denoising each pixel. To evaluate the method, denoising of the natural images is conducted, and the results are compared to the standard NLM filter and the SVD-based method. The results are promising.

View PDFchevron_right
Closed-form Bayesian image denoising: improving the adaptive Wiener filter through pairwise Gaussian-Markov random fields
Alexandre Levada

Communications in Statistics - Simulation and Computation, 2019

In this paper, we propose a contextual adaptive Wiener filter by using an isotropic pairwise Gaussian Markov random field (GMRF) prior to model the spatial correlation existing in natural images. The motivation for the development of the proposed method is that, in the context of Bayesian estimation, the Wiener filter is known to be the optimal estimator under Gaussian noise. The resulting closedform filter can be viewed as a two-stage denoising process in which the first stage considers independent pixels whereas the second stage incorporates a degree of spatial dependence by means of maximum pseudo-likelihood estimation of the coupling parameter. The obtained results show that the proposed method outperforms the classical pointwise Wiener filter, in some cases reaching results comparable to some state-of-the-art methods in denoising, but with a reduced computational cost.

View PDFchevron_right
Image Denoising Methods. A New Nonlocal Principle
Bartomeu Coll

SIAM Review, 2010

The search for efficient image denoising methods is still a valid challenge at the crossing of functional analysis and statistics. In spite of the sophistication of the recently proposed methods, most algorithms have not yet attained a desirable level of applicability. All show an outstanding performance when the image model corresponds to the algorithm assumptions but fail in general and create artifacts or remove fine structures in images. The main focus of this paper is, first, to define a general mathematical and experimental methodology to compare and classify classical image denoising algorithms and, second, to propose a nonlocal means (NL-means) algorithm addressing the preservation of structure in a digital image. The mathematical analysis is based on the analysis of the "method noise," defined as the difference between a digital image and its denoised version. The NL-means algorithm is proven to be asymptotically optimal under a generic statistical image model. The denoising performance of all considered methods is compared in four ways; mathematical: asymptotic order of magnitude of the method noise under regularity assumptions; perceptual-mathematical: the algorithms artifacts and their explanation as a violation of the image model; quantitative experimental: by tables of L 2 distances of the denoised version to the original image. The fourth and perhaps most powerful evaluation method is, however, the visualization of the method noise on natural images. The more this method noise looks like a real white noise, the better the method.

View PDFchevron_right
A Non-Local Algorithm for Image Denoising
Jean-michel Morel, Bartomeu Coll

2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), 2005

We propose a new measure, the method noise, to evaluate and compare the performance of digital image denoising methods. We first compute and analyze this method noise for a wide class of denoising algorithms, namely the local smoothing filters. Second, we propose a new algorithm, the non local means (NL-means), based on a non local averaging of all pixels in the image. Finally, we present some experiments comparing the NL-means algorithm and the local smoothing filters.

View PDFchevron_right
Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights
Charles Deledalle

IEEE Transactions on Image Processing, 2000

Image denoising is an important problem in image processing since noise may interfere with visual or automatic interpretation. This paper presents a new approach for image denoising in the case of a known uncorrelated noise model. The proposed filter is an extension of the Non Local means (NL means) algorithm introduced by Buades et al.

View PDFchevron_right

Related topics

  • Computer Science
  • Electronic Imaging
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved