The industry's first "multimodal wakeup": Tmall Genie releases a new human-computer interaction system

At the 2020 Yunqi Conference, Tmall Elf released the first full-scene human-computer interaction system AliGenie5.0, which integrates various forms of interaction such as vision, voice, and touch, and can more accurately perceive the physical world. Understand the user's intentions. The three new products released on the same day are also all equipped with AliGenie 5.0, which provides a variety of "anthropomorphic" wake-up methods such as lip wake up and wave wake up.

Ku Wei, general manager of the Tmall Genie Division, said that starting from AliGenie5.0, Tmall Genie will begin to focus on services and apply technologies such as micro-kernels and multimodal interaction to build full-scene intelligence. It is reported that the system is simultaneously open to developers and smart home partners. Previously, multi-modal interaction technology mostly stayed at the academic level. Ali was the first company in the industry to apply "multi-modal wake-up" technology to consumer electronics products on a large scale.

Ku Wei, General Manager of Tmall Elf Division, introduces a new system equipped with "lip motion wake" black technology

AliGenie5.0 is a multi-modal human-computer interaction system developed by Tmall Genie. It integrates various forms of information input such as lip movements, gestures, and speech semantics for the first time, and can understand human communication intentions through multi-modal perception. , And give feedback directly. At the same time, it supports a distributed micro-kernel operating system, which can cover a wider range of application scenarios. In addition, AliGenie5.0 also supports "cloud application" technology, which can break through hardware configuration and performance limitations, cross-platform, cross-terminal, and smoothly use the rich applications of Windows, Linux, Android and other systems. Users can even play on Tmall Wizard Computer games, online lessons, experience 3D rendering, etc.

At present, this system has been the first to be applied to the three new products released this time, giving the Tmall Genie the ability to wake up naturally. For example, after the user turns on the “natural wakeup” setting on the speaker, at a distance of about 1 meter, when the machine recognizes that someone is staring at it and talks, it can directly speak naturally without calling out the wake-up words.

Full scene, multi-modal human-computer interaction system AliGenie5.0

The three new products released by Tmall Genie this time are the Tmall Genie CC10 battery version equipped with a 10-inch smart screen and a large-capacity battery, the 4-inch smart screen product Tmall Genie CC MINI, and the second-generation IN candy. All are equipped with the new AliGenie5.0 system. Among them, CC MINI also integrates Alibaba’s self-developed micro-kernel operating system. It is also the world’s first smart speaker equipped with a micro-kernel system. It can realize touch-screen interaction on small-screen products, and integrate the common alarm clocks, schedules, Home control and other functions are integrated, and a minimalist mode of core scenes such as morning wake and sleep has been developed, so that the small needs in life can also be intelligent.

BMW Group joins hands with Tmall Genie to explore car home interconnection technology, and launches MINI joint customized version

It is reported that this system will soon be open to Tmall Genie partners. This year, it will support joint customized products in the fields of automobiles, real estate, smart health, and children's education, covering more than 80 terminal categories. In the future in the intelligent scene of the ecology, users of Tmall Genie can enter the personal interface as long as they log in with the same account and use the intelligent assistant without distinction.

Ku Wei said that the amount of smart terminal equipment is in a period of rapid explosion, and areas that require terminal equipment to serve consumers, such as wearables, in-vehicles, smart homes, smart communities, hotels, and nursing homes, will gradually be intelligently transformed. He believes that the form of smart speakers has completed the first stage of the market popularization of "AI smart assistants". In the future, there will be more product forms with multiple interactive forms that provide AI assistant capabilities. Tmall Genie is also developing visual A full-scene smart device with interactive, voice interaction and even mobility capabilities. "When smart scenes become more and more complicated, a human-computer interaction system that can dynamically adapt to all scenes is needed to ensure the consistency of consumer experience. AliGenie will also continue to upgrade to empower machines to recognize, understand and act. , So that everyone and every family has an exclusive intelligent assistant."

Guess you like

Origin blog.csdn.net/ZabeNbRdit36243qNJX1/article/details/108687723