Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Related Work on Medical Image Interpolation
Simulation Results
Polynomial Interpolation Results
References
All Topics
Mathematics
Numerical Analysis

Enhancement of Corneal Images using High Resolution Techniques

Profile image of Waleed Al-HanafyWaleed Al-Hanafy
https://doi.org/10.21203/RS.3.RS-2650896/V1
visibility

…

description

68 pages

link

1 file

Abstract

This paper presents an enhancement method to deal with the medical images which have low resolution as corneal images that have hexagonal nature and contain edges which must be preserved. So its resolution should be increased to help ophthalmologists to accurately diagnose and monitor diseases. Image interpolation is employed for resolution enhancement. In this paper, we consider interpolation techniques such as: polynomial interpolation, adaptive polynomial interpolation, inverse interpolation, and super-resolution (SR) reconstruction in order to enhance corneal image interpolation-based and learning-based techniques. The polynomial interpolation includes: bilinear, bicubic, cubic spline and cubic O-MOMS as well as their adaptive techniques. While the inverse interpolation techniques comprises linear minimum mean square error (LMMSE), maximum entropy, and a regularized image interpolation. Although polynomial based techniques are the most popular due to their simplicity, they don’t...

Related papers

A Review on Different Image Interpolation Techniques for Image Enhancement
KINJAL MISTREE

IJETAE, 2013

Image enhancement is an important processing task in image processing field. By applying image enhancement, blur or any type of noise in the image can be removed so that the resultant image quality is better. Image enhancement is used in various fields like medical diagnosis, remote sensing, agriculture, geology, oceanography. There are numbers of techniques for image enhancement. Image interpolation is used to do enhancement of any image. This paper gives overview about different interpolation techniques like nearest neighbor, bilinear, bicubic, new edge-directed interpolation (NEDI), data dependent triangulation (DDT), and iterative curvature-based interpolation (ICBI).

View PDFchevron_right
Wavelet-Based Interpolation With Least Squares for Resolution Image Enhancement
el-sayed el-rabaie

A new digital image interpolation method that is performed in the wavelet domain with a least squares algorithm is presented in this paper. This method estimates wavelet coefficients in the high frequency sub-images of the estimated High-Resolution (HR) image from the Low-Resolution (LR) image using a least squares algorithm. An inverse wavelet transform is then performed for the synthesis of the HR image. Experimental results show that the proposed method outperforms other commonly used methods such as the bilinear, bicubic, and traditional least squares methods, objectively and subjectively.

View PDFchevron_right
On Super-Resolution versus Image Interpolation
Guilherme Holsbach Costa

Anais de VII International Telecommunications Symposium, 2010

This work presents a discussion about multi-frame Super-Resolution Reconstruction (SRR) and single-frame interpolation. SRR has been extensively studied in the last decades but it is not yet as popular as image interpolation. Since both methods are directed to improve image quality, comparisons are inevitable and desirable. However, fundamental misunderstandings can still be found in the literature on the choice between these two approaches. Recently, some mistaken conclusions have been reached regarding the SRR performance. This paper clarifies important SRR issues in image reconstruction, in contrast to interpolation. For reasons further discussed, two algorithms are considered: bicubic interpolation and LMS-SRR.

View PDFchevron_right
Comparative Analysis of Different Interpolation Schemes in Image Processing
Prashantha HS

International Conference on Advanced Communication Systems, 2007

Image interpolation techniques often are required in medical imaging for image generation and processing such as compression or resampling. Since the ideal interpolation function spatially is unlimited, several interpolation kernels of finite size have been introduced. This paper discusses different interpolation schemes. The comparison is made using spatial analysis, computation time for qualitative and quantitative interpolation error determinations for particular interpolation tasks. Scaling and interpolation are performed using same techniques and analyzed using MSE and PSNR.

View PDFchevron_right
Image Interpolation Techniques in Digital Image Processing: An Overview
Suvarna Fadnavis

2015

In current digital era the image interpolation techniques based on multi-resolution technique are being discovered and developed. These techniques are gaining importance due to their application in variety if field (medical, geographical, space information) where fine and minor details are important. This paper presents an overview of different interpolation techniques, (nearest neighbor, Bilinear, Bicubic, B-spline, Lanczos, Discrete wavelet transform (DWT) and Kriging). Our results show bicubic interpolations gives better results than nearest neighbor and bilinear, whereas DWT and Kriging give finer details.

View PDFchevron_right
Extrapolation for image interpolation
Olivier Rukundo, Ph.D.

Optoelectronic Imaging and Multimedia Technology V

Unlike traditional linear interpolation algorithms, which compute all kernel pixels locations, a novel image interpolation algorithm that uses the preliminary pixels kernel and extrapolated pixels adjustment has been proposed for interpolation operations. The proposed interpolation algorithm is mainly based on the weighting functions of the preliminary interpolation kernel and linearly extrapolated pixels adjustments. Experimentally, the proposed method demonstrated generally higher performance than state-of-art algorithms mentioned with objective evaluations as well as comparable performances with subjective evaluations. Potential applications may include the ultrasound scan conversion for displaying the sectored image.

View PDFchevron_right
Super-Resolution using Combination of Wavelet Transform and Interpolation Based Method
Tabinda Sarwar

2013

Super-resolution is a technique of producing a high-resolution (HR) image from one or more lowresolution (LR) images. Classical interpolation based magnification techniques like nearest-neighbor, bilinear and bicubic interpolation results in a larger image along with undesirable artifacts like blurring, aliasing and ringing effects. So the aim of super-resolution is to provide a larger image with good quality (quality means an image with less undesirable artifacts). Previous super-resolution techniques are based on using multiple images and learning based methods but the idea here is to use a single image in the super-resolution process. Here we have used the combination of wavelet transform and interpolation based technique to achieve the super-resolution using a single image. First the edges of the image are enhanced using wavelet transform and then the magnification is done using an interpolation based method. A comparison of this algorithm with other technique is also done to pr...

View PDFchevron_right
New Edge Directed Interpolation
xin li

2000

This paper proposes an edge-directed interpolation algorithm for natural images. The basic idea is to first estimate local covariance coefficients from a low-resolution image and then use these covariance estimates to adapt the interpolation at a higher resolution based on the geometric duality between the low-resolution covariance and the high-resolution covariance. The edge-directed property of covariance-based adaptation attributes to its capability of tuning the interpolation coefficients to match an arbitrarily oriented step edge. A hybrid approach of switching between bilinear interpolation and covariance-based adaptive interpolation is proposed to reduce the overall computational complexity. Two important applications of the new interpolation algorithm are studied: resolution enhancement of grayscale images and reconstruction of color images from CCD samples. Simulation results demonstrate that our new interpolation algorithm substantially improves the subjective quality of the interpolated images over conventional linear interpolation.

View PDFchevron_right
Comparison of super-resolution algorithms applied to retinal images
Vasudevan Lakshminarayanan

Journal of Biomedical Optics, 2014

A critical challenge in biomedical imaging is to optimally balance the trade-off among image resolution, signal-to-noise ratio, and acquisition time. Acquiring a high-resolution image is possible; however, it is either expensive or time consuming or both. Resolution is also limited by the physical properties of the imaging device, such as the nature and size of the input source radiation and the optics of the device. Super-resolution (SR), which is an off-line approach for improving the resolution of an image, is free of these trade-offs. Several methodologies, such as interpolation, frequency domain, regularization, and learning-based approaches, have been developed over the past several years for SR of natural images. We review some of these methods and demonstrate the positive impact expected from SR of retinal images and investigate the performance of various SR techniques. We use a fundus image as an example for simulations.

View PDFchevron_right
Medical Image Enhancement Using Super Resolution Methods
Konstantin Markov

Computational Science – ICCS 2020, 2020

Deep Learning image processing methods are gradually gaining popularity in a number of areas including medical imaging. Classification, segmentation, and denoising of images are some of the most demanded tasks. In this study, we aim at enhancing optic nerve head images obtained by Optical Coherence Tomography (OCT). However, instead of directly applying noise reduction techniques, we use multiple state-of-the-art image Super-Resolution (SR) methods. In SR, the low-resolution (LR) image is upsampled to match the size of the high-resolution (HR) image. With respect to image enhancement, the upsampled LR image can be considered as low quality, noisy image, and the HR image would be the desired enhanced version of it. We experimented with several image SR architectures, such as super-resolution Convolutional Neural Network (SRCNN), very deep Convolutional Network (VDSR), deeply recursive Convolutional Network (DRCN), and enhanced super-resolution Generative Adversarial Network (ESRGAN)....

View PDFchevron_right

References (54)

  1. Structures and function of the cornea, The National Eye Institute. [Online]. Available: http://www.nei.nih.gov/health/cornealdisease/
  2. A. Hoffman1, M. Goetz1, M. Vieth2, P. R. Galle1, M. F. Neurath1, and R. Kiesslich, "Confocal laser endomicroscopy: technical status and current indications," Endoscopy, vol. 38, no. 12, pp. 1275-83, 2006.
  3. C. Croix, S. Shand, and S. C. Watkins, "Confocal microscopy: Comparisons, applications, and problems," BioTechniques, vol. 39, no. 6S, 2018. [Online]. Available: https://doi.org/10.2144/000112089
  4. M. Unser, A. Aldroubi, and M. Eden, "B-spline signal processing: Part i -theory," IEEE Trans. Signal Processing, vol. 41, no. 2, pp. 821-833, 1993.
  5. --, "Bspline signal processing: Part ii -efficient design and applications," IEEE Trans. Signal Processing, vol. 41, no. 2, pp. 834-848, 1993.
  6. M. Unser, "Splines: A perfect fit for signal and image processing," IEEE Signal Processing Magazine, vol. 16, no. 6, pp. 22-38, 1999.
  7. P. Thevenaz, T. Blu, and M. Unser, "Interpolation revisited," IEEE Trans. Medical Imaging, vol. 19, no. 7, pp. 739-758, 2000.
  8. W. K. Carey, D. B. Chuang, and S. S. Hemami, "Regularity preserving image interpolation," IEEE Trans. Image Processing, vol. 8, no. 9, pp. 1293-1297, 1999.
  9. J. K. Han and H. M. Kim, "Modified cubic convolution scalar with minimum loss of information," Optical Engineering, vol. 40, no. 4, pp. 540-546, 2001.
  10. H. S. Hou and H. C. Andrews, "Cubic spline for image interpolation and digital filtering," IEEE Trans. on Acoustics, Speech, and Signal Processing, vol. 26, no. 6, pp. 508-517, 1978.
  11. T. M. Lehman, C. Conner, and K. Spitzer, "Addendum: B-spline interpolation in medical image processing," IEEE Trans. Medical Imaging, vol. 20, no. 7, pp. 660-665, 2001.
  12. B. Vrcelj and P. P. Vaidyanathan, "Efficient implementation of all-digital interpolation," IEEE Trans. Image Processing, vol. 10, no. 11, pp. 1639-1646, 2001.
  13. E. Meijering and M. Unser, "A note on cubic convolution interpolation," IEEE Trans. Image Processing, vol. 12, no. 4, pp. 477-479, 2003.
  14. G. Ramponi, "Warped distance for space variant linear image interpolation," IEEE Trans. Image Processing, vol. 8, no. 5, pp. 629-639, 1999.
  15. S. E. El-Khamy, M. M. Hadhoud, M. I. Dessouky, and F. E. A. El-Samie, "Adaptive image interpolation based on local activity levels," in URSI National Radio Science Conference, NRSC'03, Cairo, Egypt, 2003.
  16. S. E. El-Khamy, M. M. Hadhoud, M. I. Dessouky, B. M. Salam, and F. E. A. El-Samie, "A new edge preserving pixel-by-pixel (pbp) cubic image interpolation approach," in URSI NationalRadio Science Conference, NRSC'03, Cairo, Egypt, 2004.
  17. J. W. Hwang and H. S. Lee, "Adaptive image interpolation based on local gradient features," IEEE Signal Processing Letters, vol. 11, no. 3, pp. 359-362, 2004.
  18. X. Li and M. T. Orchard, "New edge directed interpolation," IEEE Trans. Image Processing, vol. 10, no. 10, pp. 1521-1527, 2001.
  19. M. Y, W. Y, Z. J, and J. H, "An infrared image super-resolution reconstruction method based on compressive sensing," Infrared Phys Technol, vol. 76, pp. 735-739, 2016.
  20. Z. Y, S. X, C. Q, and W. S, "Learning-based compressed sensing for infrared image super resolution," Infrared Phys Technol, vol. 76, pp. 139-147, 2016.
  21. Z. Y, C. Q, S. X, and G. G, "A novel infrared image super-resolution method based on sparse representation," Infrared Phys Technol, vol. 71, pp. 506-513, 2015.
  22. X. Yang, W. Wu, K. Liu, K. Zhou, and B. Yan, "Fast multisensor infrared image super-resolution scheme with multiple regression models," Journal of Systems Architecture, vol. 64, pp. 11 -25, 2016, real-Time Signal Processing in Embedded Systems. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S1383762115001411
  23. F. E. A. El-Samie, H. I. Ashiba, H. Shendy, H. M. Mansour, H. M. Ahmed, T. E. Taha, M. I. Dessouky, M. F. Elkordy, M. Abd-Elnaby, and A. S. El-Fishawy, "Enhancement of infrared images using super resolution techniques based on big data processing," Multimedia Tools and Applications, vol. 79, pp. 5671-5692, 2019.
  24. A. Piórkowski, "A statistical dominance algorithm for edge detection and segmentation of medical images," in Conference of Information Technologies in Biomedicine, ITiB, 2016.
  25. V. D. Earshia and M. Sumathi, "A comprehensive study of 1d and 2d image interpolation techniques," in International Conference on Communications and Cyber Physical Engineering, 2018.
  26. K. He, R. Wang, D. Tao, J. Cheng, and W. Liu, "Color transfer pulse-coupled neural networks for underwater robotic visual systems," IEEE Access, vol. 6, pp. 32 850-32 860, 2018.
  27. H. Li, X. He, D. Tao, Y. Tang, and R. Wang, "Joint medical image fusion, denoising and enhancement via discriminative low-rank sparsedictionaries learning," elsevier, vol. 79, pp. 130-146, 2018.
  28. D. Badarinath, N. B. C. Siddu, M. Tanveer, M. Prasad, A. Appaji, S. Vinekar, and A. Ningappa, "Study of clinical staging and classification of retinal images for retinopathy of prematurity (rop) screening," IEEE WCCI, 2018.
  29. M. S. Meena, P. Singh, A. Rana, D. Mery, and M. Prasad, "A robust face recognition system for one sample problem," Pacific-Rim Symposium on Image and Video Technology (PSIVT), 2019.
  30. M. Prasad, S. Rajora, Y. A. D. D. Gupta, E. Daraghmi, P. Yadav, P. Tiwari, and A. Saxena, "Fusion based en-fec transfer learning approach for automobile parts recognition system," IEEE SSCI, 2018.
  31. E. J. Cheng, K. P. Chou, S. Rajora, B. H. Jin, M. Tanveer, C. T. Lin, K. Y. Young, W. C. Lin, and M. Prasad, "Deep sparse representation classifier for facial recognition and detection system," Pattern Recognition Letters, 2019.
  32. E. A.Sultan, S. M. Eldin, and F. E. El-Samie, "New efficient interpolation techniques for medical images," accepted in MTAP, April 2020.
  33. T. Blu, P.Thevenaz, and M.Unser, "Moms: Maximal-order interpolation of minimal support," IEEE Trans, vol. 10, pp. 1069-1080, July 2001.
  34. S. E. El-Khamy, M. M. Hadhoud, M. I. Dessouky, B. M. Salam, and F. E. A. El-Samie, "Sectioned implementation of regularized image interpolation," in IEEE International Midwest Symposium on Circuits and Systems, vol. 2, 2003, pp. 656-659.
  35. --, "Optimization of image interpolation as an inverse problem using the lmmse algorithm," in IEEE Mediterranean Electrotechnical Conference, vol. 1, 2004, pp. 247-250.
  36. --, "A new approach for adaptive polynomial based image interpolation," International Journal of Information Acquisition, vol. 3, no. 2, pp. 139-159, 2006.
  37. S. El-Khamy, M. M. Hadhoud, M. I. Dessouky, B. Salam, and F. A. El-Samie, "An adaptive cubic convolution image interpolation approach," Machine Graphics & Vision International Journal, vol. 14, pp. 235-258, 01 2005.
  38. W. Y. V. Leung and P. J. Bones, "Statistical interpolation of sampled images," Optical Engineering, vol. 40, pp. 547-553, 2001.
  39. J. H. Shin, J. H. Jung, and J. K. Paik, "Regularized iterative image interpolation and its application to spatially scalable coding," IEEE Transactions on Consumer Electronics, vol. 44, pp. 1042-1047, 1998.
  40. H. C. Anderws and B. R. Hunt, Digital Image Restoration. Prentice-Hall, 1977.
  41. S. E. El-Khamy, M. M. Hadhoud, M. I. Dessouky, B. M. Salam, and F. E. A. El-Samie, "Efficient implementation of image interpolation as an inverse problem," Digital Signal Processing, vol. 15, no. 2, pp. 137-152, 2005.
  42. N. P. Galatsanos and R. T. Chin, "Digital restoration of multichannel images," IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 37, pp. 415-421, 1989.
  43. N. B. Karayiannis and A. N. Venetsanopoulos, "Regularization theory in image restoration: the stabilizing functional approach," IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 38, pp. 1155-1179, 1990.
  44. M. G. Kang and A. K. Katsagelos, "Simultaneous iterative image restoration and evaluation of the regularization parameter," IEEE Transactions on Signal Processing, vol. 40, pp. 2329-2334, 1992.
  45. M. S and Y. G, "Super-resolution with sparse mixing estimators," IEEE Trans Image Process, vol. 11, pp. 2889-2900, 2010.
  46. Z. H, Z. Y, and L. H, "Generative bayesian image super resolution with natural image prior," IEEE Trans Image Process, pp. 4054-4067, 2012.
  47. H. J, S. A, and A. N, "Single image super-resolution from transformed self exemplars," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5197-5206, 2015.
  48. P. T and E. M, "A statistical prediction model based on sparse representations for single image super-resolution," IEEE Trans Image Process, vol. 23, pp. 2569-2582, 2014.
  49. Y. G, S. G, and M. S, "Solving inverse problems with piecewise linear estimators: from gaussian mixture models to structured sparsity," IEEE Trans Image Processing, pp. 2481-2499, 2012.
  50. M. Aharon, M. Elad, and A. Bruckstein, "K-svd: an algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans on Signal Processing, vol. 54, no. 11, pp. 4311-4322, 2006.
  51. M. Santhoshi, S. A. Kumari, S. S. Reddy, and A. V. Kumar, "Image and video quality assessment with bliinds-ii algorithm using nss approach in dct domain," International Journal of Engineering Science and Innovative Technology (IJESIT), vol. 2, no. 5, pp. 35-44, 2013.
  52. L. Lixiong, L. Bao, H. Huang, and A. C. Bovik, "No-reference image quality assessment based on spatial and spectral entropies," Image Communication, vol. 29, pp. 856-863, 2014.
  53. A. Mittal, A. K. Moorthy, and A. C. Bovik, "No-reference image quality assessment in the spatial domain," IEEE Transaction on Image Processing, vol. 21, pp. 4695-4708, 2012.
  54. M. A. Saad, A. C.Bovik, and C. Charrier, "Blind image quality assessment: A natural scene statistics approach in the dct domain," IEEE Transaction on Image Processing, vol. 8, pp. 3339-3352, 2012.

Related papers

Review of Image Reconstruction by Interpolation Techniques
Sanjay Khobragade

2014

image interpolation is very interesting areaof research in image processing which consists of various processing tasks such as compression, restoration, denoising, enhancement. Reconstruction quality of any image interpolation algorithm depends on it's ability to adapt changing pixel structures across image. Interpolation is method of creating new data points from set of available or known data points which helps in analyzing exact details of images which is required in many applications such as medical imaging. By interpolation methods many artifacts in low resolution image such as blurring, ringing can be removed.

View PDFchevron_right
Image Interpolation by Super-Resolution
Alexey Lukin

Term "super-resolution" is typically used for a high-resolution image produced from several low-resolution noisy observations. In this paper, we consider the problem of high-quality interpolation of a single noise-free image. Several aspects of the corresponding super-resolution algorithm are investigated: choice of regularization term, dependence of the result on initial approximation, convergence speed, and heuristics to facilitate convergence and improve the visual quality of the resulting image.

View PDFchevron_right
Digital image super-resolution using adaptive interpolation based on Gaussian function
Muhammad Sajjad

This paper presents a new approach to digital image super-resolution (SR). Image SR is currently a very active area of research because it is used in various applications. The proposed technique uses Gaussian edge directed interpolation to determine the precise weights of the neighboring pixels. The standard deviation of the interpolation window determines the value of the sigma ‘σ’ for generating Gaussian kernels. Therefore, the proposed scheme adaptively applies different Gaussian kernels according to the computed standard deviation of the interpolation window. Laplacian is applied to the image generated by the Gaussian kernels to enhance the visual quality of the output image. It has the significant benefit of being isotropic i.e. invariant to rotation. These features of being isotropic not only resemble human visual perception but also respond to intensity variations equally in all directions for any kind of kernel. It highlights the discontinuities of high frequencies in the image generated by the Gaussian kernel and deemphasizes the regions with slowly varying luminance levels. It also recovers the background missing features while preserving the sharpness of the output image. The proposed scheme preserves geometrical regularities across the boundaries and smoothes intensities inside the high frequencies. It also maintains the textures inside geometrical regularities. Therefore, high resolution (HR) images produced by the proposed scheme contain intensity information very close to the original details of the low-resolution (LR) image i.e. edges, smoothness and texture information. Various evaluation metrics have been applied to compute the validity of the proposed technique. Extensive experimental comparisons with state-of-the-art zooming schemes validate the claim of the proposed technique of being superior. It produces high quality at the cost of low time complexity.

View PDFchevron_right
Linear interpolation of biomedical images using a data-adaptive kernel
Hagai Kirshner

2013 IEEE 10th International Symposium on Biomedical Imaging, 2013

In this work, we propose a continuous-domain stochastic model that can be applied to image data. This model is autoregressive, and accounts for Gaussian-type as well as for non-Gaussian-type innovations. In order to estimate the corresponding parameters from the data, we introduce two possible error criteria; namely, Gaussian maximum-likelihood, and least-squares autocorrelation fit. Exploiting the link between autoregressive models and spline approximation, we use our approach to adapt interpolation parameters to a given image. Our numerical results demonstrate that our adaptive approach yields higher SNR values compared to classical polynomial splines for the task of image scaling. They also indicate that our least-squares-based error criterion nearly achieves the oracle performance for parameter estimation, which provides further support to the practical relevance of our model.

View PDFchevron_right
Multi-kernel based adaptive interpolation for image super-resolution
Muhammad Sajjad

Multimedia Tools and Applications, 2012

This paper proposes a cost-effective and edge-directed image super-resolution scheme. Image super-resolution (image magnification) is an enthusiastic research area and is desired in a variety of applications. The basic idea of the proposed scheme is based on the concept of multi-kernel approach. Various stencils have been defined on the basis of geometrical regularities. This set of stencils is associated with the set of kernels. The value of a re-sampling pixel is obtained by calculating the weighted average of the pixels in the selected kernel. The time complexity of the proposed scheme is as low as that of classical linear interpolation techniques, but the visual quality is more appealing because of the edgeorientation property. The experimental results and analysis show that proposed scheme provides a good combination of visual quality and time complexity.

View PDFchevron_right

Related topics

  • Spline Interpolation
  • Bilinear Interpolation
  • Image scaling
  • Bicubic interpolation
  • Nearest neighbor interpolation
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved