Academia.eduAcademia.edu

Shape from Shading

description702 papers
group17 followers
lightbulbAbout this topic
Shape from shading is a computational technique in computer vision and graphics that infers the three-dimensional shape of an object based on the variations in shading and light intensity observed in a two-dimensional image. It relies on the principles of light interaction with surfaces to reconstruct depth and form.
lightbulbAbout this topic
Shape from shading is a computational technique in computer vision and graphics that infers the three-dimensional shape of an object based on the variations in shading and light intensity observed in a two-dimensional image. It relies on the principles of light interaction with surfaces to reconstruct depth and form.

Key research themes

1. How can shape-from-shading methods be enhanced to resolve ambiguities and improve 3D surface recovery under varying lighting and material conditions?

This research area addresses the inherent ill-posedness and ambiguities in traditional shape-from-shading (SFS) formulations, particularly focusing on mathematical well-posedness, incorporation of advanced reflectance models, and user-guided optimization strategies to improve robustness and accuracy of 3D shape recovery from shading cues.

Key finding: Horn's foundational formulation of SFS as a nonlinear PDE (brightness equation) reveals intrinsic ill-posedness and non-uniqueness such as concave-convex ambiguity, known as the Bas-relief ambiguity. This paper provides... Read more
Key finding: By introducing an attenuation factor accounting for distance between the light source and surface (near-light perspective), this work proves unique viscosity solution existence for Hamilton-Jacobi equations arising in... Read more

2. How can image-based cues beyond shading, such as occlusions, silhouettes, and structural priors, be integrated to reconstruct high-quality 3D shapes from single images?

This line of investigation combines classical shape-from-shading with other monocular cues and novel priors to overcome the limitations of shading alone. It also incorporates data-driven and structural constraints particularly suited for complex objects such as human faces and hair, aiming for dense, detailed, and realistic 3D reconstructions from minimal input.

Key finding: Proposes a novel single-image hair reconstruction system integrating shape-from-shading with additional cues: occlusion and silhouette constraints form a coarse depth prior; an adaptive albedo model allows accurate normal... Read more
Key finding: Surveys diverse methods of 3D shape acquisition emphasizing multi-view and single-view paradigms combined with controlled lighting. Highlights single-image shape recovery techniques such as SFS, their challenges due to... Read more

3. What advances in differential geometric and mathematical modeling provide new frameworks for representing and reconstructing shape and texture from images?

This research theme focuses on the use of differential geometry, curvature analysis, and advanced mathematical representations to extract shape and texture information from images and video. It also encompasses theoretical and practical methods that support robust 3D reconstruction through mathematical regularization, curvature-based segmentation, and texture synthesis.

Key finding: Introduces a stereoscopic matching approach leveraging Gaussian and mean curvature of image intensity surfaces to define image regions characterized as peaks, pits, and saddles. It applies a Voronoi graph to represent region... Read more
Key finding: Discusses recent developments in image-based modeling including deformable shape capture (e.g., facial dynamics) via one-shot structured lighting, wide-baseline viewpoint invariant matching for sparse image sets, and... Read more

All papers in Shape from Shading

Our work focuses on the problem of automatic generation of viewpoint invariant geometric surface models from range data to be used in CAD/CAM systems. We developed two methods for recovering the surface. First is on the base of Shape from... more
How do humans see three-dimensional shape based on two-dimensional shading? Much research has assumed that a 'light from above' bias solves the ambiguity of shape from shading. Counter to the 'light from above' bias, studies of Bayesian... more
Relief inversion effect is a perceptual phenomenon that leads to an inverted perception of convex and concave shapes. This perceptual inversion occurs in scenes where the shading/shadows act as the main depth cue. In visuospatial... more
In this work, we propose a new method to enhance text in document-image. Firstly, we introduce a classical model and a way to solve it by means of a non-convex optimization problem. So, a simoultaneaous estimation of the reflectance and... more
In this paper we analyze a specific problem within the context of recovering the geometric shape of an unknown surface from multiple noisy shading patterns generated by consecutive parallel illuminations by different light-sources.... more
Existing Photometric Stereo methods provide reasonable surface reconstructions unless the irradiance image is corrupted with noise and effects of digitisation. However, in real world situations the measured image is almost always... more
In 3-source photometric stereo, a Lambertian surface is illuminated from 3 known independent light-source directions, and photographed to give 3 images. The task of recovering the surface reduces to solving systems of linear equations for... more
A smooth object depicted in a monochrome image will often exhibit brightness variation, or shading. Of interest in computer vision is the inverse problem of how object shape may be recovered from such an image. This is referred to as the... more
A smooth object depicted in a monochrome image will often exhibit brightness variation, or shading. A problem much studied in computer vision has been that of how object shape may be recovered from image shading. When the imaging... more
We describe two psychophysical experiments testing predictions of the square difference mechanism we have previously proposed for intensity-based stereo. Experiment 1 assesses the relative contributions of disparity and contrast to... more
In this paper, we propose a new optimization approach for the simultaneous computation of optical flow and edge detection therein. Instead of using an Ambrosio-Tortorelli type energy functional, we reformulate the optical flow problem as... more
This paper proposes a camera projection model for an oblique‐viewing endoscope, intended for application to an extended virtual reality system. The oblique‐viewing endoscope differs from the forward‐viewing endoscope by the fact that the... more
In this paper we propose a multi-scale Azimuthal Projection Distance Image scheme for analysing 3D texture and use it in classifying wrinkles and pores on high resolution facial normal maps. Azimuthal Projection Distance Images (APDI)... more
Figure 1: First 3 principal components of our statistical diffuse (left) and specular (middle) albedo models. Both are visualised in linear sRGB space. Right: rendering of the combined model under frontal illumination in nonlinear sRGB... more
Abstract. This study employed the use of Cellular Neural Networks (CNN) for Edge Detection in images due to its high operational speed. The process of edge detection is unavoidable in many image processing tasks such as obstacle detection... more
Topographic variations affect the reflectance properties of the Earth's surface and are often removed in remote sensing studies, especially when significant terrain variations exist. In this study, however, we show that shading effects... more
We introduce a normal-based bas-relief generation and stylization method which is motivated by the recent advancement in this topic. Creating bas-relief from normal images has successfully facilitated bas-relief modeling in image space.... more
Automatic bas-relief generation from 2D photographs potentially has applications to coinage, commemorative medals and souvenirs. However current methods are not yet ready for real use in industry due to insufficient artistic effect,... more
Univer sit é Cl er m o nt -F er r a nd II -B l a ise P a sc a l E c o l e Do c t o r a l e S c ienc es P o ur l'Ing énieur d e Cl er m o nt -F er r a nd T H E S E P ré se n té e p a r Renaud GAGLIONE P o u r o b te n ir le g ra d e d e Do... more
Capturing detailed surface geometry currently requires specialized equipment such as laser range scanners, which despite their high accuracy, leave gaps in the surfaces that must be reconciled with photographic capture for relighting... more
Complex reflectance phenomena such as specular reflections confound many vision problems since they produce image 'features' that do not correspond directly to intrinsic surface properties such as shape and spectral reflectance. A common... more
External morphology of egg of Eurygaster maura (LINNAEUS, 1758) was investigated by light (LM) and scanning electron microscope (SEM). The females were collected from Ankara, Ayaş, Asartepe and maintained under the laboratory conditions.... more
We discuss a statistical shape-from-shading framework for images of general and unknown illumination. To overcome arbitrary illumination, the framework makes use of the fact that general lighting can be expressed using low-order spherical... more
For the creation of a realistic 3 meter-sized relief globe of the Moon, a detailed height map of the entire lunar surface is required. Available height measurements of the Moon's surface are too coarse by a factor of 15 for this purpose.... more
This paper proposed a shape recovery approach from Endoscope Image using Eikonal Equation. Photometric constraint equation derived from the Lambert reflectance and geometrical constraint equation derived from the relationship between the... more
In this paper a multiple classifier systems for face verification is proposed based on the study of scores fusion for four face authentication systems. Extraction features is realized by the Gabor wavelets phases, Principal Component... more
A smooth object depicted in a monochrome image will often exhibit brightness variation, or shading. Of interest in computer vision is the problem of how object shape may be recovered from such an image. When the imaging conditions are... more
Psychophysical studies have shown that human observers resolve shape-from-shading ambiguities by assuming that light is coming from above-left. Using event-related potentials (ERPs), we measured the processing time of the perception of an... more
It is a h clear that there are m a l dBerent approaches to the problem of how to integrate visual cuea. Let us list some of the obvious poasibilities: 1 There is no active integration of visual processes. Their individual outputs ate... more
Standard regularization methods can be used to solve satisfactorily several problems in early vision, including edge detection, surface reconstruction, the computation of motion and the recovery of color. In this paper, we suggest (a)... more
by T Caw
Computer vision has developed algorithms for several early vision processes, such as edge detection, stereopsis, motion, texture, and color, which give separate cues as to the distance from the viewer of three-dimensional sur-'Ibmam Po@o... more
This thesis treats static and dynamic surface characterization using radiometric and Fourier optical methods. A Fourier optical method has been developed for real time image processing in paper pro ...
Dual-frequency Precipitation Radar (DPR) on the Global Precipitation Mission (GPM) core satellite started its precipitation measurement in March 2014, and the DPR standard products are available in public since September 2014. DPR... more
In this paper, we first discuss some general problems and issues concerning Shape from Shading (SfS) from Synthetic Aperture Radar (SAR) images and present the state of the art. Starting from this general discussion, we propose a new... more
In this paper we show that the introduction of an attenuation factor in the brightness equations relative to various perspective Shape-from-Shading models allows to make the corresponding differential problems well-posed. We propose a... more
This paper deals with a possible application of computer vision techniques in the field of Cultural Heritage. These techniques allow an effective integration of data from different sources. Particular consideration will be given to an... more
: Wavelet bases are used to generate spaces of approximation for the resolution of bidimensional elliptic and parabolic problems. Under some specific hypotheses relating the properties of the wavelets to the order of the involved... more
We report on the reversal of asymmetry in visual-search tasks with shaded items. Previous studies have suggested that the target of a bottom-lit disk among distractors of top-lit disks is detected in a rapid and parallel manner, but not... more
We present a parallelized algorithm for accelerating the velocity extension calculations in a level-set method, which is essential for surface velocity based topography simulations, such as etching or deposition simulations for... more
There are three reasons for illumination to vary within a scene. First, a light source may be visible from some surfaces but not from others. Second, because of linear perspective, the shape and size of a finite source may be different... more
Our work focuses on the problem of automatic generation of viewpoint invariant geometric surface models from range data to be used in CAD/CAM systems. We developed two methods for recovering the surface. First is on the base of Shape from... more
Given any two images taken under different illumination conditions, there always exist a physically realizable object which is consistent with both the images even if the lighting in each scene is constrained to be a known point light... more
Object recognition systems relying on local descriptors are increasingly used because of their perceived robustness with respect to occlusions and to global geometrical deformations. Descriptors of this type-based on a set of oriented... more
In this paper, we propose an original framework for three dimensional face representation and similarity matching. Basic traits of a face are encoded by extracting convex and concave regions from the surface of a face model. A compact... more
Download research papers for free!