Smart door lock - comparative analysis of domestic and non-domestic statistical parameters of mobile phone application cameras

Smart door lock - comparative analysis of domestic and non-domestic statistical parameters of mobile phone application cameras

Smart door lock application

From January 1, 2019 to December 31, 2020, the total sales volume of 3D face recognition smart door locks in the whole market has reached nearly 200,000 sets. Among them, Deschmann has become the biggest winner in market development with its first-mover advantage, good market positioning and vigorous promotion. It occupies more than 70% of the market share in the segmented field of 3D face recognition smart door locks, reaching 100%. Seventy-two. Followed by Cadiz, accounting for nearly 20% of the market share, the top two accounted for nearly 90%, occupying an absolute dominant position in the market.

1. Orbi Zhongguang U2

The U2 face recognition module for door locks is designed based on Obi Zhongguang's structured light technology and uses the third-generation self-developed depth engine MX6300 chip, with a built-in algorithm version, smaller size, lower power consumption, and easier door lock assembly. Through 3D multi-modal face recognition technology, financial payment security level is achieved, and it has good adaptability to application scenarios such as backlight, dark light, strong light, different heights, face postures, and face occlusion. The module has passed class1, ROHS and BCTC enhanced living body authentication and double authentication of face recognition algorithm.

Its physical size is 41mmL×15.2mmW×8.72mmH, the depth distance is 0.3m-1.0m, the average power consumption for one recognition is 0.57W, the accuracy is 1m±5mm, and the field of view is H(50±2)°V( 61±2)°, suitable for indoor and semi-outdoor, communicate through the serial port, can identify the height of 1.2m-2m, support self-learning and hostage alarm.

2. ReadSense Aurora

ReadSense Technology launched the Aurora 3D face recognition door lock solution. The Aurora 3D face recognition door lock solution includes three module products, namely AU1000, AU2000 and AU3000. The three module products are suitable for different scenarios and have been applied to the main line products of more than 10 smart door lock brands, and have been highly recognized by the market and customers

3. Royal Golden Shield S2-DM

Royal Golden Shield’s S2-DM adopts SenseTime’s binocular face recognition algorithm, with a 98% pass rate for live security and a 1/100,000 misrecognition rate, and a 98% pass rate for comparative security, and a 1/1 million misrecognition rate .

mobile application

1. Structured light

The commercial use of 3D structured light in the field of consumer electronics can be traced back to 2009. Microsoft and PrimeSense, an Israeli 3D sensing company, jointly released the Kinect generation of somatosensory equipment equipped with 3D structured light modules. The fastest-selling consumer electronics device of the year. Despite the great success of the product, the accuracy, image resolution and response speed of the first generation Kinect were not ideal. In 2009 and 2010, Microsoft acquired the Israeli TOF camera company 3DV Systems and the 3D gesture recognition company Canesta. In 2013, the cooperation with PrimeSense was terminated, and the Kinect 2 generation product equipped with a TOF camera was developed and launched by itself. However, the good times did not last long. Due to the lack of popular game applications and hardware sales at a loss, in October 2017, Microsoft stated that it had stopped producing Kinect. Since its launch in 2011, the cumulative sales volume was only 35 million units. Although Kinect failed, the precipitation in the game market has made 3D sensing technology more and more mature. In 2017, Apple released the iPhone X, which was equipped with a 3D structured light module for the first time, which can realize 3D face recognition technology and has become Apple's biggest innovation in the past two years. Previously, due to the limitations of various technologies such as semiconductor technology, it was difficult to apply 3D sensing to mobile phones with very limited volume and low power consumption requirements. Therefore, the release of iPhone X is a major breakthrough in 3D structured light technology. passion rekindled. Apple's 3D structured light solution comes from PrimeSense, which provides technical solutions for Microsoft's Kinect generation. Apple announced in November 2013 that it will use 3. $600 million to acquire the company. In addition to Apple, the main 3D structured light solution manufacturers include Intel, Qualcomm/Himax in the United States, Mantis Vision in Israel, and domestic companies such as Huawei and Obi Zhongguang. In 2014, Intel released RealSense, the world's first 3D depth-of-field camera embedded in various smart devices, which uses 3D structured light technology and is used in Lenovo, Dell and other ultrabook computers and drones and other devices. In the same year, Qualcomm announced its cooperation with Himax, an imaging IC design company, to provide a high-resolution, low-power 3D structured light module SLiMTM. After the release of the iPhone X, domestic Xiaomi, Huawei and OPPO also successively released the first smartphone equipped with a 3D structured light module. Among them, Xiaomi adopted the solution from Israel’s Mantis Vision, Huawei adopted a self-developed solution, and OPPO adopted a 3D structured light module. What is the solution of the domestic company Obi Zhongguang.
Apple's new iPhone products in 2018 and 2019 are also equipped with 3D structured light modules. Currently released smartphones equipped with 3D structured light modules include all models after Apple's iPhone X, Huawei's Mate20 Pro, Honor Magic 2 and Mate30 Pro, Xiaomi's Mi 8 Explorer Edition, and OPPO's OPPO Find X. According to DigiTimes data, there were about 100 million smartphones equipped with 3D structured light in 2018, of which Apple accounted for about 88%.

1. iPhone X

In September 2017, Apple released the iPhone X. The depth camera of the iPhone X adopts: monocular IR + projection infrared dot matrix + ASIC scheme, and projects more than 30,000 light spots invisible to the naked eye to the human body through the front dot matrix projector. Face, and then according to the reflected light points received by the infrared lens, the depth map of the face can be calculated. The 2D face captured by the RGB camera combined with the calculated depth face information can be processed by an algorithm to draw a precise and detailed 3D face. This technology is highly secure, and can easily identify face recognition attacks that are difficult to handle with ordinary RGB cameras using printed photos, software synthesis, masks, etc., and can perform face liveness detection safely and conveniently. The technology used in the iPhone's face-unlocking scheme, known as FaceID, is one of the most important new features of the iPhone X.

2. Mi 8

In May 2018, the Mi 8 Explorer Edition, which was unveiled at Xiaomi's annual flagship conference, is the flagship model of Xiaomi's 8th anniversary commemorative edition, which incorporates a number of black technologies, among which the application of 3D structured light technology is the most eye-catching. This technology is independently developed by Israel's Mantis Vision Company, and it is the first attempt of this technology in the history of Android phones to be applied to the Mi 8 Explorer Edition.
The original data collection of Mantis Vision relies on "infrared dot matrix projector", "infrared camera" and "RGB camera". Receive; background algorithms and programs decode data in real time, generate point cloud and depth map; RGB camera collects color images; after rapid meshing and texture mapping processing, a lifelike 3D model is presented in front of you.
Unlike iPhone X's DOE (diffractive optical element) projection, Mantis Vision uses Mask-based coded structured light. Its innovative patented encoding technology, with its dense point cloud and accurate depth information, can capture the smallest details, truly restore the original appearance of the scanned target, and effectively reduce the amount of processing calculations. In addition, with the high frame rate of the camera, real-time dynamic capture of 3D content can also be realized.

3. OPPO Find X

In June 2018, OPPO released the Find X series of mobile phones. As the first mass-produced 3D structured light technology in the Android market, Find X can be said to have achieved both practical application and design. First of all, in terms of design, due to With the innovative dual-track periscope structure design, the 3D structured light module is well placed in the lifting module, and can be well hidden inside the fuselage when not in use. Therefore, there is no Liu Haiping. This also makes the screen-to-body ratio of the whole machine reach an astonishing 93.8%.
In terms of actual application experience, in addition to realizing 3D facial recognition, OPPO Find X also fully supports WeChat and Alipay mobile payment functions based on the security of 3D structured light. Applied to photography, OPPO Find X can create a 3D face model for users through 15,000 recognition points brought by 3D structured light, and then use AI technology to conduct intelligent analysis, such as the three-dimensional contour of the face, nose shape, and eye depth , chin, cheekbones, etc., and automatically give relevant beautification suggestions, and finally present a more refined beautification effect, realizing the effect of 3D beautification, which also has a good performance in the actual photo experience.

4. Huawei Mate 20 Pro

Huawei launched the Mate 20 Pro in October 2018. The front camera adopts 3D structured light technology. It was evaluated by China Teller Labs according to the "Mobile Phone Face Recognition Security Capability Evaluation Scheme" and rated as [Face Recognition Security Capable five-star product], and its security capability has been affirmed by authoritative organizations.
Using the principle of 3D structured light, when the HUAWEI Mate 20 Pro is recording face data, the front speckle projector will project 30,000 invisible small light spots onto the various feature structures of the face to obtain facial features. Depth information; at the same time, the infrared fill light is turned on to obtain the feature information of the face. The system then captures and analyzes the information through an infrared camera to obtain accurate face data. Every time it needs to be unlocked, the phone will capture face data through the infrared camera, speckle projector and infrared fill light, and then compare it with the face information in the system. If they are consistent, the identity of the owner will be confirmed and the phone will be successfully unlocked .
Through the speckle structured light technology, the light spots projected by the HUAWEI Mate 20 Pro speckle projector on the human face are random, which is more secure than coded structured light. At the same time, by identifying key facial points, the infrared camera can accurately "recognize" features such as the tip of the nose, reflective pupils, and dark cheeks.

TOF

The earliest commercial use of TOF can be traced back to July 2006. MESA Imaging, a company derived from CSEM (Swiss Electronics and Microtechnology Center), was established and launched the commercial TOF camera product series SwissRanger, which was first applied to passive safety detection of automobiles. In 2014, MESA was acquired by Heptagon, a Singaporean micro-optical device manufacturer. In 2016, Heptagon was acquired by AMS, a well-known Austrian sensor manufacturer, and has certain advantages in the field of miniaturized TOF sensors. In 2013, Microsoft adopted TOF technology in the second-generation Kinect, and the solution came from 3DV Systems, a TOF camera company acquired in 2010. In 2015, Sony Sony acquired the Belgian gesture recognition technology company SoftKinetic, which has a well-known DepthSense TOF sensing system. Two years later, Sony released the world's smallest TOF module. The first application of TOF technology to smartphones was in 2016. Google and Lenovo jointly launched the world's first smartphone equipped with TOF modules, Phab2Pro, which uses the TOF solution of pmd/Infineon. And other simple AR applications, but did not cause a big response in the market.
Infineon and German 3D sensing company pmd have cooperated in the field of TOF for decades and developed the well-known REAL3 TOF sensor chip, in which pmd mainly provides TOF pixel matrix, and Infineon mainly provides system-on-chip (SoC) integration All the functional components and develop the corresponding manufacturing process, which is also used in Zenfone, an AR smartphone released by ASUS in 2017. On August 6, 2018, OPPO held a TOF technical communication meeting in Beijing, and released its first smartphone OPPO R17 Pro equipped with a TOF camera on August 23, using Sony's solution. Then in December 2018, vivo released its first dual-screen version of smartphone vivo NEX equipped with a TOF camera, using Panasonic's solution; Huawei released its first smartphone Honor V20 equipped with a TOF camera module, using the OPPO R17 Pro has the same TOF solution. After entering 2019, Android manufacturers have joined the camp of TOF lenses. In February 2019, Samsung released the Galaxy S10 5G, each equipped with a TOF lens; LG released the LG G8 ThinQ, equipped with a rear TOF lens, using Infineon's solution; Lenovo released the Z6 Pro 5G mobile phone, equipped with a rear TOF lens. Huawei also equipped the rear TOF lens on the mid-range model nova 5 Pro in June.

1. Asus Zenfone

The REAL3™ image sensor chip from Infineon Technologies AG plays a key role in ASUS' latest augmented reality (AR) smartphone. The phone was launched at CES 2017 in Las Vegas in January 2017. ASUS Zenfone AR was the world's thinnest smartphone equipped with a 3D time-of-flight (ToF) camera at that time, which can realize real-time three-dimensional perception of the surrounding environment.
The REAL3 image sensor chip is a key component of the world's smallest dedicated 3D camera module for smartphones. It is based on the Time-of-Flight (ToF) principle, which measures the time it takes for an infrared signal to travel from the camera to the subject. The time it takes is called "flight time". ToF offers many advantages over other 3D sensing principles in terms of performance, size and power consumption for battery powered mobile terminals.

2. OPPO R17 Pro

OPPO R17 Pro was released in August 2018. The R17 Pro adopts a rear three-camera design: TOF lens + main lens with variable aperture + three depth-of-field lenses. TOF is a surface light source projection, which projects infrared light evenly on the object, and then uses the TOF camera to capture the time difference of infrared light reflection, and calculates the depth of field information. The advantage of this is that the projection imaging distance is longer and the accuracy is not bad. Because active light sources are also used, TOF imaging in dark environments is not affected. Moreover, arranging TOF in the rear camera area can make it easier to place active light sources and reduce the squeeze on the space of the mobile phone. Most importantly, TOF technology is relatively mature, and its cost is lower than that of 3D structured light.