WO2020041987A1

WO2020041987A1 - Biometric recognition apparatus and method, and electronic device

Info

Publication number: WO2020041987A1
Application number: PCT/CN2018/102790
Authority: WO
Inventors: 蒋鹏
Original assignee: 深圳市汇顶科技股份有限公司
Priority date: 2018-08-28
Filing date: 2018-08-28
Publication date: 2020-03-05
Also published as: CN109196520A; CN109196520B

Abstract

A biometric recognition apparatus and method, and an electronic device. The biometric recognition apparatus comprises: a light generating device (101) for generating infrared light and/or at least three pieces of structured light having different phases, wherein the at least three pieces of structured light are used for irradiating a first target and the infrared light is used for irradiating a second target; and a macro image sensor (102), used for performing image acquisition on the first target irradiated by the at least three pieces of structured light to acquire three-dimensional (3D) feature information of the first target, and/or performing image acquisition on the second target irradiated by the infrared light to obtain vein information of the second target, wherein the 3D feature information of the first target and the vein information of the second target are used for performing biometric recognition on the user.

Description

Biometric recognition device, method and electronic equipment

Technical field

The embodiments of the present application relate to the field of biometric identification, and more particularly, to a biometric identification device, method, and electronic device.

Background technique

With the rapid development of the mobile phone industry, biometric technology is receiving more and more attention, and the demand for the security of biometric technology is also increasing. The existing biometric identification devices are large in size and are not portable. How to implement a biometric identification device with small size and high security is an urgent problem.

Summary of the Invention

The embodiments of the present application provide a biometric identification device, a method, and an electronic device, which can take into consideration the size of the biometric identification device and the security of the fingerprint device.

According to a first aspect, a biometric identification device is provided, including: a light generating device for generating infrared light and / or at least three structured lights with different phases, wherein the at least three structured lights are used to irradiate a first A target, the infrared light is used to illuminate a second target; a macro image sensor is used to perform image acquisition on the first target illuminated by the at least three structured lights to obtain a three-dimensional 3D feature of the first target Information, and / or image acquisition of the second target illuminated by the infrared light to obtain vein information of the second target, wherein the three-dimensional 3D feature information of the first target and the second target The vein information is used for biometric identification of the user.

Optionally, the lens selected for the macro image sensor is a macro lens (or a close-up lens), which can be used to collect image information of a close-range object (such as a fingerprint, a joint pattern, etc.), as opposed to performing a 3D human face. The size of the recognized long-distance lens or common mobile phone lens is smaller. Therefore, the graphic sensor using the macro lens can reduce the size of the biometric recognition device.

In a possible implementation manner, the light generating device includes: a diffractive optical component DOE having a specific phase plate structure to generate a specific shape structured light; at least three lasers, which are uniformly arranged in the first section of the DOE. One surface of one side, and the projection of the at least three lasers on the plane where the first surface of the DOE is located at least partially falls on the first surface of the DOE, and the first surface of the DOE is far from the A surface of a user; wherein at least three laser beams generated by the at least three lasers are irradiated on a first surface of the DOE, and the DOE converts the at least three laser beams into the at least three beams having a specific shape Structured light with different phases exits from the second surface of the DOE, and the second surface of the DOE is a surface close to the user.

Optionally, in the embodiment of the present application, a circuit structure is integrated inside the DOE for generating structured light. For example, a photoelectric conversion circuit does not require an additional circuit structure compared to an existing DOP or DMP device. Therefore, Using DOE to generate structured light can reduce the size of biometric identification devices.

In a possible implementation manner, by setting positions of the at least three lasers relative to the DOE and a phase plate structure on the DOE, the at least three lasers emitted from the at least three lasers are emitted from the at least three lasers. The DOE is converted into the at least three structured lights having a phase difference of 60 degrees.

In a possible implementation manner, the at least three lasers are a vertical cavity surface emitting laser VCSEL or a semiconductor laser.

In a possible implementation manner, the at least three lasers use a near-infrared light source or a visible light source.

In a possible implementation manner, the biometric identification device includes: a distance sensor, configured to detect a distance between the first target or the second target and the biometric identification device.

In a possible implementation manner, the biometric identification device further includes:

A processor configured to control the macro image sensor in a standby state when the distance is greater than a first distance threshold; or control the macro image sensor when the distance is less than or equal to the first distance threshold Switch from standby to working.

It should be understood that, in practical applications, the processor may be provided in the biometric identification device, or may be provided in an electronic device in which the biometric identification device is installed, that is, the function of the processor may be implemented in the electronic device. Or, it may be partially implemented in the biometric identification device and partially implemented in an electronic device, which is not limited in the embodiment of the present application.

In a possible implementation manner, the distance sensor is a near-infrared distance sensor or an ultrasonic distance sensor.

In a possible implementation manner, the biometric identification device further includes a processor, configured to: according to a distance from the first target detected by a distance sensor to the biometric identification device, and the macro image sensor The determined distance between the first target and the biometric recognition device determines a measurement error of 3D characteristic information of the first target.

It should be understood that, in practical applications, the processor may be provided in the biometric identification device, or may be provided in an electronic device in which the biometric identification device is installed, that is, the function of the processor may be implemented in the electronic device. This is not limited in the embodiments of the present application.

In a possible implementation manner, the processor is further configured to: when the measurement error of the 3D feature information is greater than an error threshold, send a first prompt message to the user to prompt the user to perform 3D again Collection of feature information.

In a possible implementation manner, a focal length of the macro image sensor is less than or equal to a specific focus distance threshold, an imaging distance is less than a specific imaging distance threshold, and a lens diameter is less than a specific diameter threshold.

In a possible implementation manner, the specific focal distance threshold is 2 mm, the specific imaging distance threshold is 5 cm, and the specific diameter threshold is 3 mm.

In a possible implementation manner, the biometric identification device further includes: a processor, configured to receive 3D feature information of the first target and / or a second target of the second target sent by the macro image sensor. Vein information, and biometric recognition is performed according to the 3D feature information of the first target and / or the vein information of the second target.

In a possible implementation manner, the processor is further configured to: if the 3D feature information of the first target matches the pre-stored 3D feature information of the first target, and / or the second target The vein information matches the pre-stored vein information of the second target, and it is determined that the biometric recognition is successful.

In a possible implementation manner, the light generating device includes an infrared light source for generating the infrared light.

In a possible implementation manner, a distance between the distance sensor and the light generating device is greater than or equal to a second distance threshold.

In a possible implementation manner, the second distance threshold is 5 mm.

In a possible implementation manner, the 3D feature information of the first target is one of the following: 3D fingerprint information of a finger of the user, 3D joint pattern information of a finger joint of the user, and the user 3D palm print information of your palm;

The vein information of the second target is vein information of a finger joint of the user or vein information of a finger of the user.

In a possible implementation manner, the biometric identification device is disposed on a side or a back of the electronic device.

In a second aspect, a biometric identification method is provided. The method includes:

The light generating device generates at least three structured lights with different phases for irradiating the first target;

The macro image sensor performs image acquisition on the first target illuminated by the at least three structured lights to obtain three-dimensional 3D feature information of the first target, wherein the 3D feature information of the first target is used for all The user's biometric identification;

The light generating device generates infrared light for irradiating a second target;

The macro image sensor performs image acquisition on the second target illuminated by the infrared light to obtain vein information of the second target, wherein the vein information of the second target is used for the biological of the user Feature recognition.

In a possible implementation manner, the method further includes:

Performing biometric recognition according to the 3D feature information of the first target and / or the vein information of the second target.

In a possible implementation manner, performing the biometric identification according to the 3D feature information of the first target and / or the vein information of the second target includes:

Determining the user if the 3D feature information of the first target matches the pre-stored 3D feature information of the first target, and the vein information of the second target matches the pre-stored vein information of the second target; Successful biometric identification.

In a possible implementation manner, the method further includes: a distance sensor detects a distance between the first target or the second target to the macro image sensor; and controlling the macro image according to the distance The working state of the sensor.

In a possible implementation manner, controlling the working state of the macro image sensor according to the distance includes: controlling the macro image sensor to be in a standby state when the distance is greater than a first distance threshold. Or when the distance is less than or equal to the first distance threshold, switching the macro image sensor from a standby state to an operating state.

In a possible implementation manner, the method further includes: according to a distance from the first target detected by the distance sensor to the macro image sensor, and the first image determined by the macro image sensor. The distance from the target to the macro image sensor determines a measurement error of the 3D feature information of the first target; when the measurement error of the 3D feature information is greater than an error threshold, sending the first instruction information to the user, and using For instructing the user to re-collect the 3D feature information of the first target.

A third aspect provides an electronic device including the biometric identification device described in the first aspect or any possible implementation manner of the first aspect.

In a possible implementation manner, the electronic device further includes a first distance sensor and a second distance sensor, which are disposed on a surface of the electronic device and configured to detect a user's finger and the first distance sensor or the first distance sensor. A change in the distance between the second distance sensors to determine a moving direction of the user's finger on a surface of the electronic device.

In a possible implementation manner, a moving direction of the user's finger on a surface of the electronic device is used to control a volume of the electronic device, or to control opening or closing of an application program on the electronic device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of a 3D recognition technology based on structured light.

FIG. 2 is a schematic diagram of a biometric identification device according to an embodiment of the present application.

Fig. 3a is a structural diagram of a phase plate of DOE.

FIG. 3b is a partial enlarged view of a phase plate region of the DOE in FIG. 3a.

Fig. 3c is an enlarged view of a 16-stage structure of the phase plate region of the DOE in Fig. 3b.

FIG. 4 is a schematic structural diagram of an implementation manner of structured light.

FIG. 5 is a schematic flowchart of a biometric identification method according to an embodiment of the present application.

FIG. 6 is a schematic diagram of an electronic device according to an embodiment of the present application.

FIG. 7 is a schematic diagram of a mounting position of the biometric identification device on an electronic device.

detailed description

The embodiments of the present application will be described below with reference to the drawings of the embodiments of the present application.

Before introducing the embodiments of the present application, the biometric technology related to the embodiments of the present application will be introduced first.

Vein recognition technology is a biometric technology that uses light transmission technology to compare and identify finger veins. When near-infrared rays pass through human tissues, hemoglobin in venous blood vessels has a significant absorption effect on near-infrared rays, making veins Vessel distribution features are characterized by different gray values in the image. Due to the uniqueness and stability of the shape of the finger veins, the finger vein images of each person are different, and the vein images of different fingers of the same person are also different. Based on this, the user's identity can be identified using the vein distribution image of the finger.

The specific process may be: the infrared light source emits near-infrared rays on one side of the finger, transmits the finger, and on the other side of the finger, an image collector (such as a camera) captures a vein image. Then, based on the collected vein images of the fingers, the vein characteristic information of the fingers is extracted and further compared with the vein characteristics of the fingers registered in advance to confirm that the identity of the registrant is an authorized user.

The basic principle of the three-dimensional 3D feature recognition technology based on structured light is as follows: a structured light projector projects structured light of a specific shape (for example, a light spot, a light stripe, or a light surface) onto a measured object, and is then collected by an image sensor (such as a camera) Image, further, the 3D feature information of the measured object can be determined according to the image, for example, the 3D feature information of the measured object can be determined according to the triangulation method or the phase method, wherein the triangulation method is based on the projector, the image sensor, and the measured object The geometric relationship between the objects determines the 3D feature information of the measured object. The phase method determines the 3D feature information of the measured object according to the relationship between the deformed fringe and the reference plane fringe. As shown in FIG. 1, the structured light projector 11 generates structured light and irradiates the surface of an object 13 (such as a finger). The image sensor 12 can observe from another angle due to the height of the object (such as the ridges and valleys of the fingerprint). ), Which can be understood as a spatial carrier signal whose phase and amplitude are modulated. This deformed fringe is collected and demodulated, for example, using a Fourier transform algorithm or wavelet transform. Algorithms, etc., recover the phase information, and then determine the height information of the measured object from the phase information, so that the 3D feature information of the measured object can be obtained.

The present application provides a biometric identification device that performs 3D feature recognition (for example, 3D fingerprint recognition) and / or vein recognition. The user identity is recognized by means of 3D feature recognition and / or vein recognition, which can improve the biometric recognition. safety. The biometric identification device can be applied to various electronic devices, such as portable or mobile computing devices such as smart phones, laptops, tablets, and gaming devices, as well as electronic databases, automobiles, automated teller machines (ATMs), and other An electronic device, but the embodiment of the present application is not limited thereto.

It should be understood that the 3D feature recognition in the embodiments of the present application includes, but is not limited to, 3D fingerprint recognition, 3D palm print recognition, and 3D joint print recognition. The technology disclosed in this application can also be combined with other biometric technologies to identify the user's identity, which is not limited in the embodiments of this application.

Optionally, the biometric identification device provided in the embodiment of the present application can also be used to detect other biometric data, for example, the user's heartbeat or heart rate can also be detected during fingerprint scanning. Therefore, the biometric identification device in the disclosed technology can be a multifunctional biometric identification device, which can provide secure access to electronic devices, and can also provide other biometric data analysis, such as heartbeat or heart rate detection.

FIG. 2 shows a biometric identification device 100 according to an embodiment of the present application. The biometric identification device 100 may include a light generating device 101 and a macro image sensor 102. among them:

The light generating device 101 is configured to generate infrared light and / or at least three structured lights with different phases;

The macro image sensor 102 is configured to perform image acquisition on the first target illuminated by the at least three structured lights to acquire three-dimensional 3D feature information of the first target, and / or the infrared light irradiated on the first target. Image acquisition is performed on the second target to obtain vein information of the second target.

It should be understood that the embodiment of the present application does not specifically limit the relative positional relationship between the light generating device 101 and the macro image sensor 102 in the biometric identification device 100, and the light generating device 101 and the macro image sensor 102 may be placed side by side, or It can be placed in other ways, as long as the light generating device 101 does not affect the image acquisition of the macro image sensor 102, and the macro image sensor 102 does not affect the irradiation of the structured light onto the surface of the measured object.

It should also be understood that the first target may be a finger, a finger joint, a palm, etc. of the user, and the second target may be a finger joint or a finger abdomen, etc., which are not limited in the embodiments of the present application.

Correspondingly, the 3D feature information of the first target is one of the following: 3D fingerprint information of the user's finger, 3D joint pattern information of the user's finger joint, and 3D palm print information of the user's palm ; The vein information of the second target is vein information of a finger joint of the user or vein information of a finger of the user.

Compared with 2D feature information, 3D feature information increases the height information of the measured object, which is not easy to imitate, and improves security; vein information is more secure and difficult to imitate than fingerprint recognition. Therefore, 3D feature recognition and / Or vein recognition biometric identification device can improve the security of biometric identification.

It should be noted that, in the embodiment of the present application, the lens selected for the macro image sensor is a macro lens (also referred to as a close-up lens), which can be used to collect images of close-range objects (such as fingerprints, joint patterns, etc.) The information is smaller than the long-distance lens for 3D face recognition or the lens of a common mobile phone. Therefore, a graphic sensor using a macro lens can reduce the size of a biometric recognition device.

In some specific embodiments, the focal length of the lens of the macro image sensor is less than or equal to 2 mm, the lens diameter is less than 3 mm, and the imaging distance is less than or equal to 5 cm. Such as fingers).

Optionally, in some embodiments, the macro image sensor may be a complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor) image sensor, and an image sensor is used to acquire an image of a desired detection area. CMOS image sensor technology is relatively mature, the central sensitive wavelength range is easier to achieve through process doping, the cost is lower than the charge-coupled device (CCD), and the drive circuit is simpler than the CCD. The macro image sensor may also use other types of image sensors, which are not limited in the embodiments of the present application.

For ease of description and differentiation, in the embodiment of the present application, a light generating device for generating at least three structured lights with different phases is called a structured light generating device, and a light generating device for generating infrared light is called an infrared light source. It should be understood that the structured light generating device and the infrared light source may be independent devices, or the infrared light source may also be integrated into the structured light generating device, or if the structured light generating device uses an infrared light source, the device for generating light The infrared light source of infrared light may also reuse the infrared light source in the structured light generating device, that is, the light generating device may include only the structured light generating device for generating structured light and infrared light.

Optionally, in some embodiments, the infrared light source may be a light emitting diode (LED), a laser diode (LD), or a photodiode capable of generating infrared light, which is not limited in the embodiments of the present application.

Optionally, in some embodiments, the structured light generating device may include a diffractive optical element (Diffractive Optical Elements) and at least three lasers.

Wherein, the at least three lasers are used to generate at least three laser beams, and the at least three laser beams can be converted into structured light having a specific shape after passing through the DOE, for example, structured light in the shape of line stripes or scattered spots.

Specifically, the surface of the DOE has a specific phase plate design, as shown in FIG. 3a is a schematic diagram of a design of the phase plate of the DOE. When the laser light generated by the laser passes through the DOE device, the distance to the DOE is relatively close ( For example, a distance of about 2.5 cm) produces clearer structured light with a specific shape, for example, striped structured light.

In some specific implementations, the DOE can be etched on the surface of a transparent material such as transparent glass or resin to form different phase regions. These different phase areas can adjust the phase of the laser and change the direction of the laser. Figure 3b shows a partial enlarged view of the phase plate region of the DOE, and Figure 3c shows an enlarged view of the 16-step structure of the phase plate region of the DOE. .

In other specific implementations, DOE can also be achieved through a transparent resin injection process. The phase of the DOE region corresponding to each laser is specially designed so that the phases of the fringe light emitted by the three lasers are different.

FIG. 4 is a schematic diagram of an implementation manner of the structured light generating device. As shown in FIG. 4, the structured light generating device 200 may include a DOE 201. Taking three lasers as an example, the structured light generating device 200 may include a laser 202, a laser 203, and a laser 204.

Wherein, the DOE201 has a first surface 2011 and a second surface 2012, wherein the first surface 2011 is a side far from the user, and the second surface 2012 is a side close to the user, that is, the second surface is in actual use. 2012 is the outward side.

In one arrangement, the laser 202, the laser 203, and the laser 204 may be evenly arranged on one side of the first surface 2011 of the DOE, and the three lasers are on a plane where the first surface of the DOE is located. The projection falls at least partially on the first surface of the DOE, or in other words, the DOE at least partially covers each laser to ensure that at least part of the light emitted by the laser falls on the first surface of the DOE.

It should be understood that the uniform arrangement here may mean that the three lasers are arranged on a plane at a certain distance from the DOE according to a certain spatial period (for example, an equal interval), or the three lasers may be arranged according to a certain spatial period (for example, etc. The pitch) is arranged on a circle that is equidistant from the center of the DOE, etc., which is not limited in the embodiment of the present application.

Optionally, the laser 202, the laser 203, and the laser 204 may also be connected to a control circuit 205 for controlling the direction of the laser emitted by the laser and the turning-on sequence of the laser. For example, the control circuit 205 can control the three lasers to sequentially emit lasers of a specific angle, project them on the first surface 2011 of the DOE, and then convert them into 3 frames with specific shapes and different phases according to the phase plate design on the DOE. Structured light, for example, has a phase difference of 60 degrees.

Taking 3D fingerprint collection as an example, the specific working process of the structured light forming device is introduced.

First, the laser 202 is turned on, and the laser light 1 emitted by the laser 202 is irradiated on the first surface of the DOE. When emitted from the second surface of the DOE, it is converted into structured light with a specific shape and irradiated on the user's finger. The image sensor performs image acquisition to obtain a structured light image 1.

According to the above steps, the laser 203 and the laser 204 are turned on separately in order to perform image acquisition, and a structured light image 2 and a structured light image 3 are acquired.

Further, a 3D fingerprint image of a user's finger can be obtained based on the three structured light images. For example, a Fourier transform algorithm can be used to process the three structured light images to obtain a 3D fingerprint image of the user. Further, based on the The 3D fingerprint image is fingerprinted to determine the identity of the user.

Optionally, in some embodiments, parameters such as the direction of the laser light emitted from the laser, the relative position between the lasers, the relative position between the laser and the DOE, and the phase image on the DOE can be adjusted to adjust the Phases of the three structured lights emitted from the second surface 2012.

For example, the distance between the laser 202, the laser 203, and the laser 204 can be set to 1 millimeter, and each laser surface corresponds to a functional area of the DOE, and the laser lights vertically to the corresponding DOE area.

For another example, the same DOE settings are used above the laser 202, the laser 203, and the laser 204, where the laser 203 faces the center of the DOE, the distance between the laser 202 and the laser 204 is 0.7 mm, and the distance between the center of the laser 204 and the laser 203 is 1.3 mm .

As another example, three lasers may be respectively disposed below the DOE device. The irradiation direction of the laser 202 is 5 ° from the vertical direction, the irradiation direction of the laser 203 is vertical, the irradiation direction of the laser 204 is -5 °, etc. to form three Structured light with phase difference.

The foregoing implementation manner is merely an example, and the embodiment of the present application may also adopt other setting manners so as to form three frames of structured light having a phase difference, and the embodiment of the present application is not limited thereto.

Optionally, in the embodiment of the present application, the laser may be a vertical cavity surface emitting laser (Vertical Cavity Surface Emitting Laser, VCSEL) or other semiconductor lasers, which is not limited in the embodiment of the present application. The laser may use a near-infrared light source or a visible light source, such as a green laser light source, which is not limited in the embodiment of the present application.

It should be understood that in the embodiments of the present application, circuits and structures with lower power consumption and smaller volume are integrated inside the structured light forming device, for example, a photoelectric conversion circuit. Existing devices such as Digital Light Processing (DLP) or Digital Mirror Projector (DMP) require driving circuits with large volume and large power consumption, and the structure of the digital micromirror device itself is also large. This limits its application in smaller volume requirements. The DOE solution according to the present invention uses at least 3 micro lasers and 1 DOE device, and an additional ranging sensor and a macro camera can implement a compact 3D feature recognition device.

Optionally, in some embodiments, the biometric identification device 100 further includes:

The processor 103 is connected to the macro image sensor 102, and is configured to receive 3D feature information of the first target and / or vein information of the second target sent by the macro image sensor, and according to the The 3D feature information of the first target and / or the vein information of the second target performs biometric recognition.

In a specific implementation, the processor may determine that the biometric identification of the user is successful when at least one of the following conditions is met, so that the user may be authorized to access the electronic device installed by the biometric identification device: (1) The 3D feature information of the first target matches the pre-stored 3D feature information of the first target; (2) the vein information of the second target matches the pre-stored vein information of the second target.

It should be understood that, in practical applications, the processor 103 may be provided in the biometric identification device, or may also be provided in an electronic device in which the biometric identification device is installed, that is, the function of the processor 103 may be in the electronic device. The implementation is not limited in the embodiments of the present application.

It should be understood that the embodiment of the present application does not limit the collection order of 3D feature information and vein information. Optionally, the specific execution order may be set by the system, or set by a user, and the like. In one implementation, the 3D fingerprint information of the user's finger can be collected first, and then the vein information of the finger joint of the user can be collected. In this case, when the user's finger approaches or touches the biometric recognition device, first, the structured light generating device generates at least three pieces of structured light and irradiates the surface of the user's finger; secondly, the macro image sensor images the user's finger, Obtain the 3D fingerprint information of the user's finger; then, the user moves the finger and moves the finger joint close to or touches the biometric recognition device. The infrared light source generates infrared light and irradiates the surface of the finger joint. Finally, the macro image sensor performs the finger joint Imaging to obtain vein information of finger joints.

In practical applications, 3D feature information and vein information are usually better for imaging specific parts. For example, for vein information collection, vein information at the finger joints is preferred, and for 3D feature information, the fingertips are preferred. 3D fingerprint information. Therefore, before image acquisition, the biometric identification device (specifically, the processor 103) may also send a prompt message to the user, prompting the user to bring a specific part closer to the biometric identification device, so that the macro image sensor performs the part. Image acquisition. For example, if the 3D characteristic information is collected first, and then the vein information is collected, then when the user approaches the biometric recognition device, the processor may first send the user first instruction information for instructing the user to bring his finger close to his belly The biometric identification device is used for 3D fingerprint collection by the macro image sensor. After the 3D fingerprint collection is completed, a second instruction information may be sent to the user for instructing the user to turn off his finger and approach the biometric identification device so that Distance image sensor for vein image acquisition.

Optionally, in some embodiments, the biometric identification device may further include a distance sensor for detecting a distance from a user's finger or palm to the biometric identification device, and further, the distance may be less than or equal to a specific distance threshold When the macro image sensor is switched from a standby (sleep) state to a working state, so as to facilitate image acquisition.

It should be understood that when the macro image sensor is working, the finger is close to the macro image sensor, and the macro image sensor can perform image acquisition; when the macro image sensor is in the standby state, even if the finger is close to the macro image sensor, the macro image The sensor also does not perform image acquisition. Therefore, when the image acquisition is not performed, switching the macro image sensor to the standby state can reduce the power consumption of the device.

Optionally, in some embodiments, the first distance threshold may be the imaging distance of the macro image sensor, that is, the longest distance that the macro image sensor can image. For example, the first distance threshold may be 10 cm. 5cm, etc., the specific value can be determined according to actual needs.

Optionally, in some embodiments, the distance sensor may be a near-infrared distance sensor or an ultrasonic distance sensor based on acoustic principles, which is not limited in the embodiments of the present application.

Among them, the near-infrared distance sensor can measure the distance through the principle of triangle. The specific process is as follows: the near-infrared distance sensor generates a beam of infrared light and emits from the surface of the biometric recognition device in a non-vertical direction. When the user's finger or palm and other targets When the biometric recognition device is approached, infrared light is reflected. According to the information of the reflected infrared light, such as the intensity of the reflected infrared light, the distance between the user's finger or the finger and the biometric recognition device can be obtained.

Optionally, in some embodiments, the distance sensor may be located outside the macro image sensor, that is, the distance sensor is closer to the user than the macro image sensor, which is beneficial to improving the imaging accuracy of the image sensor. The distance sensor collects the distance of an approaching object in real time, and triggers the structured light forming device and the image sensor to acquire an image according to the distance. The magnification used by the image sensor for each image acquisition is basically the same. Therefore, it is beneficial to improve the accuracy of image recognition by averaging the results of multiple acquisitions.

Optionally, in some embodiments, the processor 103 is further configured to:

Determining the first target according to the distance from the first target to the biometric recognition device detected by the distance sensor and the distance from the first target to the biometric recognition device determined by the macro image sensor Measurement error of 3D feature information.

According to the principle of 3D feature collection, the macro image sensor can determine the height information of the measured object. The height information can be understood as the distance from the surface of the measured object to the biometric recognition device or the macro image sensor. The distance sensor can also The distance from the measured object to the biometric recognition device is measured. Therefore, the measurement error of the 3D feature information collected by the macro image sensor can be assisted to be evaluated according to the distance measured by the distance sensor.

Specifically, the distance sensor can collect the distance information near the object in real time at a specific position above it (that is, the side near the object). The biometric recognition device collects 3 structured lights hitting an object to restore the 3D shape of the object. The 3D shape extracted from the biometric recognition device can reflect the distance of the object from the macro image sensor and the distance sensor. The distance between the distance sensor and the object can be measured in real time. By comparing this distance with the distance extracted by structured light, the measurement error of the macro image sensor can be characterized, and the 3D structure of the object to be measured can be indirectly calibrated. feature. Optionally, if the measurement error is greater than a specific threshold, the processor may prompt the user to re-collect 3D feature information.

Optionally, in some embodiments, the biometric identification device may be installed at a position where no button is provided on the side or the back of the electronic device. For example, as shown in FIG. 5, the electronic device may include a smart phone, a tablet computer, a notebook computer, or a wearable device, which is not limited in the embodiment of the present application.

In some embodiments, the biometric identification device or electronic device may include a first distance sensor and a second distance sensor, and the two distance sensors may be installed at a position where no button is provided on the side or the back of the electronic device. The distance sensors can measure the distance from the user's finger or palm to the surface of the electronic device. According to the change of the distance measured by the two distance sensors, the moving direction of the user's finger or palm can be determined.

For example, the distance sensor 1 and the distance sensor 2 are disposed on the side of the electronic device. The distance sensor 1 is located above the distance sensor 2. At a first moment, the distance measured by the first distance sensor is D1, and the distance measured by the second distance sensor. It is D2. At the second moment, the distance measured by the first distance sensor is D3 and the distance measured by the second distance sensor is D4. If D1 <D3, D2> D4, it can be determined that the user's finger slides downward. Further, the volume of the electronic device can be controlled according to the movement direction of the user's finger, that is, the two distance sensors can replace the existing volume adjustment buttons, or the application can be turned on or off according to the movement direction of the user's finger. , Such as accessing contacts, opening WeChat, etc.

It should be understood that, in the embodiments of the present application, all functions performed by the processor may be implemented in the biometric identification device, or all implemented in electronic devices, or may be implemented partly in the biometric identification device, and partly in the electronic device. It is implemented in a device, which is not limited in the embodiment of the present application.

For example, the functions of 3D feature recognition and vein recognition can be implemented in electronic devices, that is, they can be executed by the processor in the electronic device, the function of controlling the macro image sensor to switch from the standby state to the working state, and determining the 3D feature information. The function of measuring errors can be implemented in a biometric identification device, that is, it can be executed by a processor in the biometric identification device.

In the foregoing, the biometric identification device according to the embodiment of the present application has been described in detail with reference to FIGS. 1 to 5. Hereinafter, the biometric identification method according to the embodiment of the present application will be described with reference to FIG. 6.

It should be understood that FIG. 6 shows detailed steps or operations of the biometric identification method in the embodiment of the present application, but these steps or operations are merely examples, and the embodiment of the present application may also perform other operations or various operations of FIG. 5 Deformation. In addition, each step in FIG. 6 may be performed in a different order from that presented in FIG. 6, and it may not be necessary to perform all operations in FIG. 6.

The biometric identification method according to the embodiment of the present application may be applied to an electronic device equipped with a biometric identification device. The biometric identification device may be the biometric identification device 100 described above. The biometric identification method may perform 3D features. Information identification and / or vein identification. The following describes the biometric recognition method according to the embodiment of the present application with 3D fingerprint recognition and vein recognition as an example in conjunction with FIG. 6. Of course, the biometric recognition method of the embodiment of the present application can also only perform 3D fingerprint recognition or only vein. Recognition, or the order of 3D fingerprint recognition and vein recognition can also be adjusted, which is not limited in the embodiments of the present application.

As shown in FIG. 6, the method 300 may include the following steps:

S301. The distance sensor detects the distance from the user's finger to the distance sensor. When the distance is less than or equal to a specific distance threshold, the macro image sensor is woken up, that is, the macro image sensor is switched from the standby state to the working state.

Optionally, the biometric identification device may not include a distance sensor. In this case, the method 300 may not include step S301, that is, the macro image sensor may always be in a working state. In contrast, in this case, the power Consumption is large.

S302: The structured light generating device generates at least three pieces of structured light with different phases for irradiating a user's finger.

The structured light generating device may adopt the structure of the structured light generating device described above. For the specific working process, refer to the related descriptions above, and details are not described herein again.

S303: The macro image sensor collects images of the at least three structured user's fingers sequentially illuminated, and further processes the collected at least three fingerprint images. For example, a Fourier transform algorithm is used to obtain a 3D fingerprint of the user's finger Information (or 3D fingerprint image).

S304. Perform fingerprint recognition according to the 3D fingerprint information to obtain a fingerprint recognition result.

Optionally, if the 3D feature information of the user's finger matches the pre-stored 3D feature information of the user's finger, it is determined that the fingerprint recognition is successful, otherwise, it is determined that the fingerprint recognition has failed.

S305. The infrared light source can generate infrared light for irradiating the finger joints of the user to obtain the vein information of the user.

S306: The macro image sensor collects an image of a finger joint of the user irradiated with infrared light, and may further process the image, for example, perform feature enhancement processing to obtain vein information (or a vein image) of the finger joint of the user.

S307. Perform vein recognition according to the vein information to obtain a vein recognition result.

Optionally, if the vein information of the user matches the pre-stored vein information of the user, it is determined that the vein recognition is successful; otherwise, it is determined that the vein recognition has failed.

Further, according to the fingerprint recognition result and / or the vein recognition result, a biosafety assessment may be performed on the user, that is, it is determined whether the user is an authorized user who can access the electronic device.

Alternatively, when the fingerprint recognition is successful and the vein recognition is successful, it is determined that the user is allowed to access the electronic device, or when any one of the fingerprint recognition success and the vein recognition success is satisfied, the user may be allowed to access the electronic device. The implementation can be determined according to the security level of the electronic device, which is not limited in the embodiment of the present application.

It should be understood that, in the embodiment of the present application, S302 to S304 may be performed before S305 to S307, or may be performed after S305 to S307, or may be performed simultaneously, which is not limited in the embodiment of the present application.

Optionally, in some embodiments, whether to perform subsequent steps related to vein recognition may be determined according to the fingerprint recognition result. For example, whether to perform S305 to S307 may be determined according to the fingerprint recognition result. For example, if the security level of the electronic device is relatively low, the user may be allowed to access the electronic device directly without performing S305 to S307 when the fingerprint recognition is successful; or, if the security level of the electronic device is high, in this case, If the fingerprint identification fails, you can skip S305 ~ S307, that is, do not perform vein recognition, directly deny the user access to the electronic device, or you can continue to execute S305 ~ S307 when the fingerprint recognition is successful, and when the fingerprint recognition is successful and the vein recognition is successful , And then allow the user to access the electronic device.

Optionally, in other embodiments, it is also possible to determine whether to continue to perform subsequent fingerprint identification-related steps according to the vein recognition result, which is similar to the above implementation process, and is not repeated here.

An embodiment of the present application further provides an electronic device. As shown in FIG. 7, the electronic device 600 may include the biometric identification device 60 described in the foregoing embodiment, and the biometric identification device 60 may be installed in the electronic identification 600. There are no buttons on the side or back.

Optionally, the biometric identification device 60 may include a macro image sensor 610, a distance sensor 630, an infrared light source 622, and a structured light generating device 621. For the structures and functions of the macro image sensor 610, the distance sensor 630, the infrared light source 622, and the structured light generating device 621, reference may be made to related descriptions of the foregoing embodiments, and details are not described herein again.

It should be understood that the specific examples in the embodiments of the present application are only to help those skilled in the art to better understand the embodiments of the present application, but not to limit the scope of the embodiments of the present application.

It should be understood that terminology used in the embodiments of the present application and the appended claims is for the purpose of describing particular embodiments only, and is not intended to limit the embodiments of the present application. For example, the singular forms "a", "the above", and "the" used in the examples of the present application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

Those of ordinary skill in the art may realize that the units of the various examples described in connection with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software In the above description, the composition and steps of each example have been described generally in terms of functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

In the several embodiments provided in this application, it should be understood that the disclosed systems and devices may be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may also be electrical, mechanical or other forms of connection.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions in the embodiments of the present application.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional unit.

When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application is essentially a part that contributes to the existing technology, or all or part of the technical solution may be embodied in the form of a software product, which is stored in a storage medium. Included are instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present application. The foregoing storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes .

The above is only a specific implementation of this application, but the scope of protection of this application is not limited to this. Any person skilled in the art can easily think of various equivalents within the technical scope disclosed in this application. Modifications or replacements, and these modifications or replacements should be covered by the protection scope of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.

Claims

A biometric identification device, comprising:

A light generating device for generating infrared light and / or at least three structured lights with different phases, wherein the at least three structured lights are used to irradiate a first target, and the infrared light is used to irradiate a second target;

A macro image sensor is configured to perform image acquisition on the first target illuminated by the at least three structured lights to obtain three-dimensional 3D feature information of the first target, and / or a target image irradiated by the infrared light. The second target performs image acquisition to obtain the vein information of the second target, wherein the three-dimensional 3D feature information of the first target and the vein information of the second target are used for biometric recognition of the user.
The biometric identification device according to claim 1, wherein the light generating device comprises:

The diffractive optical element DOE has a specific phase plate structure to generate structured light of a specific shape;

At least three lasers are evenly arranged on one side of the first surface of the DOE, and a projection of the at least three lasers on a plane on which the first surface of the DOE is located at least partially falls on the first surface of the DOE The first surface of the DOE is a surface remote from the user;

Wherein, at least three laser beams generated by the at least three lasers are irradiated on the first surface of the DOE, and the DOE converts the at least three laser beams into the at least three different-phase structures having a specific shape Light is emitted from a second surface of the DOE, and the second surface of the DOE is a surface close to the user.
The biometric identification device according to claim 2, wherein the position of the at least three lasers with respect to the DOE and a phase plate structure on the DOE are set so that the light is emitted from the at least three lasers. The at least three laser beams are converted into the at least three structured lights having a phase difference of 60 degrees after passing through the DOE.
The biometric identification device according to claim 2 or 3, wherein the at least three lasers are a vertical cavity surface emitting laser (VCSEL) or a semiconductor laser.
The biometric identification device according to any one of claims 2 to 4, wherein the at least three lasers use a near-infrared light source or a visible light source.
The biometric identification device according to any one of claims 1 to 5, wherein the biometric identification device comprises:

A distance sensor is configured to detect a distance between the first target or the second target and the biometric identification device.
The biometric identification device according to claim 6, wherein the biometric identification device further comprises:

A processor configured to control the macro image sensor in a standby state when the distance is greater than a first distance threshold; or control the macro image sensor when the distance is less than or equal to the first distance threshold Switch from standby to working.
The biometric identification device according to claim 7, wherein the processor is further configured to:

Determining the first based on the distance from the first target to the biometric recognition device detected by the distance sensor and the distance from the first target to the biometric recognition device determined by the macro image sensor. Measurement error of 3D feature information of an object.
The apparatus according to claim 8, wherein the processor is further configured to:

When the measurement error of the 3D feature information is greater than the error threshold, a first prompt message is sent to the user, which is used to prompt the user to restart the collection of 3D feature information of the first target.
The biometric identification device according to any one of claims 6 to 9, wherein the distance sensor is a near-infrared distance sensor or an ultrasonic distance sensor.
The biometric identification device according to any one of claims 1 to 10, wherein a distance between the distance sensor and the light generating device is greater than or equal to 5 mm.
The biometric identification device according to any one of claims 1 to 11, wherein a focal length of the macro image sensor is smaller than or equal to a specific focal distance threshold, an imaging distance is smaller than a specific imaging distance threshold, and a lens diameter is smaller than a specific diameter Threshold.
The biometric identification device according to claim 12, wherein the specific focal distance threshold is 2 mm, the specific imaging distance threshold is 5 cm, and the specific diameter threshold is 3 mm.
The biometric identification device according to any one of claims 1 to 13, wherein the light generating device comprises an infrared light source for generating the infrared light.
The biometric identification device according to any one of claims 1 to 14, wherein the 3D characteristic information of the first target is one of the following: 3D fingerprint information of a finger of the user, and the 3D joint pattern information of a finger joint of a user, and 3D palm pattern information of a palm of the user;

The vein information of the second target is vein information of a finger joint of the user or vein information of a finger of the user.
The biometric identification device according to any one of claims 1 to 15, wherein the biometric identification device is disposed on a side or a back surface of an electronic device.
A biometric identification method, characterized in that the method includes:

The light generating device generates at least three structured lights with different phases for irradiating the first target;

The macro image sensor performs image acquisition on the first target illuminated by the at least three structured lights to obtain three-dimensional 3D feature information of the first target, wherein the 3D feature information of the first target is used for all The user's biometric identification;

The light generating device generates infrared light for irradiating a second target;

The macro image sensor performs image acquisition on the second target illuminated by the infrared light to obtain vein information of the second target, wherein the vein information of the second target is used for the biological of the user Feature recognition.
The method according to claim 17, further comprising:

Performing biometric recognition according to the 3D feature information of the first target and / or the vein information of the second target.
The method according to claim 18, wherein the performing biometric recognition according to the 3D feature information of the first target and / or the vein information of the second target comprises:

Determining the user if the 3D feature information of the first target matches the pre-stored 3D feature information of the first target, and the vein information of the second target matches the pre-stored vein information of the second target; Successful biometric identification.
The biometric identification method according to any one of claims 17 to 19, wherein the method further comprises:

The distance sensor detects a distance from the first target or the second target to the macro image sensor;

Controlling the working state of the macro image sensor according to the distance.
The biometric identification method according to claim 20, wherein controlling the working state of the macro image sensor according to the distance comprises:

When the distance is greater than the first distance threshold, controlling the macro image sensor to be in a standby state; or

When the distance is less than or equal to the first distance threshold, the macro image sensor is switched from a standby state to an operating state.
The biometric identification method according to claim 21, wherein the method further comprises:

Determining the first based on the distance from the first target to the macro image sensor detected by the distance sensor and the distance from the first target to the macro image sensor determined by the macro image sensor. Measurement error of 3D feature information of a target;

When the measurement error of the 3D feature information is greater than an error threshold, sending first instruction information to the user, which is used to instruct the user to restart the collection of 3D feature information of the first target.
The biometric identification method according to any one of claims 17 to 22, wherein a focal length of the macro image sensor is smaller than or equal to a specific focal distance threshold, an imaging distance is smaller than a specific imaging distance threshold, and a lens diameter is smaller than a specific diameter Threshold.
The biometric identification method according to claim 23, wherein the specific focal distance threshold is 2 mm, the specific imaging distance threshold is 5 cm, and the specific diameter threshold is 3 mm.
An electronic device, comprising the biometric identification device according to any one of claims 1 to 16.
The electronic device according to claim 25, wherein the electronic device further comprises a first distance sensor and a second distance sensor, which are disposed on a surface of the electronic device and configured to detect a user's finger and the first distance. A change in a distance between the sensor or the second distance sensor to determine a moving direction of the user's finger on a surface of the electronic device.
The electronic device according to claim 26, wherein the direction of movement of the user's finger on the surface of the electronic device is used to control the volume of the electronic device, or to control an application program on the electronic device On or off.