556,700 vehicles, an increase of 126.21% year-on-year, and a front-mounted loading rate of 9.84%. This is the DMS (driver fatigue warning based on visual perception) system delivered by passenger cars in the Chinese market (excluding imports and exports) from January to April this year. Pre-installed standard configuration data.
At present, in addition to the European market that has added DMS scores to new car ratings, C-NCAP also plans to add fatigue monitoring functions and driver distraction tests to the 2025 version. In particular, the deployment rate of high-end intelligent driving continues to increase, and DMS is no longer a dispensable function.
"Autonomous driving and human-computer interaction are inseparable." In the view of Horizon, autonomous driving must be human-centered rather than machine-centered. The real value creation lies in the formation of full-scenario vehicle intelligence. The driver monitoring system is a key part of human-computer interaction.
For example, in Desay SV, the driver monitoring system (DMS) product is included in the intelligent driving business segment. With the large-scale deployment of domain controllers and the trend of functional software modularization, the product form of human-machine co-driving is also facing new integration opportunities.
At the same time, more in-cabin interactive devices are also relying on the above technologies to improve their functions. For example, AR HUD or 3D instruments combine driver gaze tracking and angle monitoring to optimize the display effect, and even provide information about points of interest to be highlighted or faded.
For example, Horizon Halo® vehicle-mounted intelligent interaction solution of Horizon Halo is the first large-scale mass-produced solution under the framework of vehicle intelligent perception interaction. Gesture recognition, eye tracking and other technologies realize active and accurate interactive experience.
At present, there are two main types of DMS (visual perception) installed on the front of passenger cars, one is cockpit interaction, and the functional safety level is not high; the other is deep integration with assisted driving, and the entry threshold is relatively high.
Among them, Neusoft Reach is one of the few companies in the market that provides DMS products and solutions for L2-L3 autonomous driving scenarios. Neusoft Reach DMS is designed and developed in accordance with the ISO26262 functional safety standard ASIL-B level, implements software and hardware development for information security, protects the personal privacy of drivers and passengers, and adopts basic software that meets the AUTOSAR standard.
The driver's facial features are captured by the infrared camera, and the deep learning perception model is used to track the driver's head posture, eyelid status, and line of sight, etc., and finally realize Face ID (face recognition), fatigue level monitoring, distraction detection, line of sight Tracking, Eyes on road (concentrate on driving), special action warning and other functions.
In April of this year, Neusoft Reach was also awarded the "Best Collaboration Award" by Jikrypton. Based on the independent DMS controller system, it has carried out in-depth cooperation with Jikrypton in the field of autonomous driving, and has successively realized large-scale on Jikrypton 001 and other models. Mass production delivery. In addition, Neusoft Reach is also the first product in China to pass the EU DDAW export regulation certification.
Zhihua Technology, another major supplier in the market, has mass-produced IMS systems that include monitoring and interaction functions for drivers and occupants, realizing eye-tracking, graded fatigue monitoring, distraction monitoring, dangerous behavior monitoring, and liveness detection. Guardian function, as well as personalized interaction functions such as identity recognition, gesture recognition, emotional music, lip movement detection, etc.
At the same time, Zhihua Technology provides a flexible product matrix covering from the driver to the passenger, and the technical path from visual perception to fusion perception, and supports third-party algorithm adaptation. In terms of hardware, self-developed various in-vehicle driver monitoring cameras, including 1-megapixel and 2-megapixel DMS driver monitoring cameras, integrated LED infrared lights that have passed human eye safety certification, and adopted Global shutter image sensors to meet various Face perception under lighting conditions.
In addition, the company has also self-developed various in-vehicle interactive monitoring cameras, including 1-megapixel, 2-megapixel, 12-megapixel RGB and RGBIR cameras, to meet customers' flexible choices, customize special optical lenses in the cabin, and meet high-quality photos And special requirements such as high-quality algorithm perception.
At present, Zhihua Technology's IMS intelligent cockpit monitoring system product line includes three configuration schemes of low, medium and high to meet the various needs of OEM customers, among which: i-Cabin 1.0 scheme: includes 1*smart camera sensor; single DMS solution to realize driver monitoring and behavior interaction functions. i-Cabin 2.0 solution: including 2*smart camera sensors; DMS+OMS solution to realize the monitoring and behavior interaction functions of the driver and front-seat passengers.
The i-Cabin 3.0 solution includes 4*smart camera sensors, 1*60GHz cabin health monitoring millimeter-wave radar; DMS+OMS fusion perception solution to realize the monitoring and behavioral interaction functions of the driver, front row occupants, and rear row occupants , and innovatively added 60GHz millimeter-wave radar, under the premise of protecting user privacy, it realized the monitoring of the vital signs of the driver and passengers, as well as detecting targets in the cockpit area and performing high-precision classification and monitoring of biometric features .
In addition, in-vehicle 3D ToF applications have also begun to be implemented in DMS, OMS, gesture recognition and other in-cabin human-computer interaction solutions. Not only can it recognize faces and load personalized configurations, it can even achieve financial-level security.
At present, in China, OFILM's in-cabin DMS and OMS cameras, 1M and 2M, have been mass-produced, and 5M is under development; vehicle-mounted TOF products, vehicle-mounted TOF modules with VGA resolution have achieved mass production for the first time (Huawei asked the world) , has achieved mass production for the first time, and the products can be widely used in 3D face recognition, gesture recognition and other fields.
Among them, this set of vehicle-mounted ToF modules has completed human eye safety certification, and the product can be configured with a special matrix of dual ToF pixels in a specific area; under different lighting conditions, each ToF camera can simultaneously measure distance and amplitude, and also Extended dynamic range in bright sunlight conditions.
According to the forecast data of Gaogong Intelligent Automobile Research Institute, in 2023, the Chinese market (excluding imports and exports) will have a chance to exceed the scale of 3 million DMS delivered as standard equipment for passenger cars, while continuing to maintain a high growth rate. It is expected that by 2025 The installed capacity is expected to exceed 7.5 million vehicles.