On September 12, 2023, the "2023 Baidu Top Ten Scientific and Technological Frontier Inventions" conference with the theme of "Patents collaborate with cutting-edge innovation to jointly build an AI-native future" was held in Beijing. Among the top ten cutting-edge inventions, more than 70% involve large-scale model and reconstruction innovation, a number of innovative AI native applications have been launched, and a large number of high-value patent results have been disclosed.
Baidu Chief Technology Officer Wang Haifeng said that the large language model has the core basic capabilities of artificial intelligence such as understanding, generation, logic, and memory, bringing the dawn of general artificial intelligence. Wenxin Yiyan's large language model is a natural result of Baidu's years of technology accumulation and industrial practice. The joint optimization of the Feipiao deep learning platform and Wenxin Yiyan's large model provides a solid foundation for Wenxin Yiyan. "Our large model patent applications and authorizations rank first in the country, and our deep learning patent applications rank first in the world. Today's release of the top ten cutting-edge scientific and technological inventions is a concentrated display of Baidu's cutting-edge innovation achievements over the past year, with more than 70% of Inventions all involve large models and reconstruction innovation, and we encourage the cultivation of AI-native thinking and active innovation of AI-native applications."
Qin Yuanming, deputy director of the Beijing Municipal Intellectual Property Office, mentioned that my country regards technological self-reliance and self-reliance as the strategic support for national development, takes scientific and technological innovation as the first driving force for development, deeply implements the innovation-driven development strategy, and has embarked on a new journey to build a world power in science and technology. . In this new journey, technology companies like Baidu will surely make great achievements; the top ten cutting-edge scientific and technological inventions demonstrate Baidu's innovations and breakthroughs in many of the world's frontier fields, and will surely lead the high-level innovation and high-quality development of the industry.
At present, the integration and development of digital economy and real industry are accelerating. my country's industrial system is complete in categories and large in scale. Artificial intelligence technology has rich application scenarios, empowers the transformation and upgrading of industries, and is widely used in all walks of life, becoming a technological revolution and industry. important driving force for change. Baidu continues to promote the large-scale implementation of artificial intelligence technology. In key directions related to the security of the industrial chain, Baidu insists on strengthening independent innovation through open cooperation and promoting high-quality development of the industry.
Liang Zhixiang, senior vice president and general counsel of Baidu Group, said that behind technological competition is competition for intellectual property rights. Behind a strong company is a strong technical team, and behind a strong technical team are many powerful patents. Baidu has a strong technical team and intellectual property team full of technological genes. Its large-model technology and patent layout are industry-leading, providing important support for Baidu's product leadership. "The world is changing, the world is constantly innovating, and now is the time for technicians of all types." Liang Zhixiang said with emotion.
Cui Lingling of Baidu's Patent Affairs Department released the "Baidu Top Ten Science and Technology Frontier Inventions in 2023". The top ten selected inventions reflect the realization and breakthroughs of Baidu's many international cutting-edge core technologies, fully confirm Baidu's strong strength in promoting cutting-edge innovation and industrial upgrading, and demonstrate the cutting-edge nature and market foresight of Baidu's technology. The top ten scientific and technological cutting-edge inventions released involve large models, end-to-end search based on large models, flying paddles, AI chips, generative retrieval, content generation recommendation technology, autonomous driving decision-making systems, large biological computing models, and high-performance quantum chips.
As more and more large model products are launched one after another, the development of generative artificial intelligence in my country will also move from the stage of "strengthening large model parameters" to the stage of "strengthening native applications and industrial implementation", and every product and application The normal operation of functions is inseparable from a large number of cutting-edge inventions as underlying technical support. These cutting-edge inventions gather together to build the four core capabilities of general artificial intelligence: understanding, generation, logic and memory, driving the application of large model capabilities in thousands of industries.
On August 31, Wen Xinyiyan took the lead in opening up to the whole society, answering 33.42 million questions from netizens on the first day of opening. On October 17, Baidu World 2023 with the theme of "PROMPT THE WORLD" will be held in Beijing. As the most important strategy, technology and product conference of the year, Baidu will release a number of AI native applications to introduce the core capabilities and latest progress of large models.
Baidu’s top ten cutting-edge technological inventions in 2023 are as follows:
1. An intelligent system based on large model retrieval, generation and decision-making interaction
The invention proposes a knowledge-enhanced large-model intelligent interactive system. The invention enhances the knowledge and reasoning ability of the model through knowledge internalization and external application of knowledge, improves the effectiveness and factual accuracy of the model through retrieval enhancement, and improves the model's memory ability and multi-round interaction capability through dialogue enhancement. This invention technology has significantly improved the understanding, generation, logic, and memory capabilities of large models, and is widely used in Baidu's core business, empowering thousands of industries.
2. End-to-end search technology based on large models
This invention proposes large-model end-to-end search technology, breaks the traditional cascade divide-and-conquer model, and marks a major intergenerational change in Baidu's search technology architecture in more than 10 years. This invented technology has been widely used in multiple scenarios such as general search, video search, and enterprise search, and the system effect and R&D efficiency have been significantly improved.
3. End-to-end adaptive distributed training technology for flying paddles
The invention uses "two unified representations" to uniformly model hardware resources and model structures, supports any model to achieve optimal model segmentation and resource allocation under heterogeneous hardware, achieves efficient training with a universal automatic hybrid parallel strategy, and can target Fault interruption, resource expansion and contraction adaptive re-complete optimal segmentation and parallel strategy selection to achieve automatic fault tolerance and elastic scheduling. It has obvious advantages in flexibility, ease of use, efficiency and robustness of large-scale distributed training. Advantage. The invented technology has successfully assisted Wen Xinyiyan in efficient training, increasing the efficiency of large-scale cluster operation training by more than 30%. It plays an important role in core product lines such as Baidu Intelligent Cloud, intelligent search and recommendation, and is also widely used in intelligence in traditional industries. The transformation has produced significant economic and social benefits.
4. Flying paddle multi-hardware hierarchical adaptation integration technology
In view of the diversity of smart chips, through loosely coupled layered design and simple adaptation interfaces, the complexity of chip and framework adaptation is significantly reduced, and it is widely compatible with a variety of hardware types. In response to the high-performance requirements of AI applications, it supports the ultimate optimization of software and hardware systems, fully unleashes the potential of hardware, and maximizes business application benefits. Based on this invented technology, Feipiao has completed efficient adaptation with more than 40 chip/IP manufacturers to realize a prosperous AI software and hardware ecosystem, build an AI software and hardware adaptation technology system, promote national standards, and lead the development of the industry.
5. AI chip optimization technology for enterprise-level large model platforms
This invention proposes AI chip optimization technology for enterprise-level large model platforms. Through precise control and early prediction, it can meet high-performance, low-latency AI calculations while slowing down the instantaneous high current of the AI chip. This technology can effectively reduce the overall cost of the system, improve the stability and reliability of the system, and improve the efficiency of the AI processor in various scenarios. This invented technology provides more efficient and stable training and reasoning capability support for enterprise-level large model platforms such as Baidu Intelligent Cloud Qianfan. At present, Qianfan Large Model has managed 42 domestic and foreign mainstream large models, and provides a complete tool chain for large model development and application, which can help enterprises build efficient and reliable AI applications.
6. Full-link generative intelligent retrieval system
This invention realizes the first integration of search system and large-scale generation technology in the industry. By introducing a full-link credibility improvement strategy, enhanced training with real data, and strict model risk control mechanisms, and adopting AI native architecture design to complete in-depth optimization of the asynchronous model computing architecture, we have successfully broken through the barriers of large models to large-scale users. Various challenges in application scenarios. This invented technology has been implemented in all Baidu search products, further improving the accuracy and reliability of search results, helping to quickly improve the ultimate satisfaction effect in the first place of search, and surpassing international peers.
7. Content generation recommendation technology based on user mental understanding
This invention newly builds a conversational recommendation system, taking advantage of the understanding and generation capabilities of large models: (1) Turning implicit feedback into natural language interaction, the recommendation system can be conversational, making it easier for users to understand; (2) Realizing content recommendation and The combination of content generation integrates pre-recommendation points, interactions during recommendations, and post-recommendation extensions to enhance users’ accompanying consumption experience; (3) Massive high-quality resources generated based on large model capabilities support personalized content generation for thousands of people. This invented technology has been applied in Baidu Feed Online to reach users' deep needs through dialogue, stimulate users' reading interest and exploration efficiency, and increased user time by 10% in the first phase.
8. Data-driven autonomous driving decision-making system
With deep learning technology as the core, this invention promotes the transformation of autonomous driving decision-making systems from rule-driven to data-driven, including interactive decision-making models and their training methods, data production methods based on human drivers and autonomous driving, and an evaluation system based on closed-loop simulation and other parts. This invented technology has been applied on a large scale in the Luobo Kuaipao Robotaxi business. It has absorbed hundreds of millions of frames of road interaction scene data, achieved a decision-making accuracy of 99.5%, achieved more than 90% of online rule substitutions, and effectively supported the unmanned operation of Robotaxi.
9. Large model of biological computing integrating first principles
This invention integrates biological field data and biochemical principles to build a highly innovative large-scale biological computing model and achieves major technological breakthroughs in the fields of compounds and proteins, marking Baidu's international leadership in biological computing. This invention technology has been widely used in small molecule drug discovery, peptide drug design, antibody drug design and other scenarios. It surpasses many traditional methods in accuracy and speed, helping partners find high-value candidate drug molecules in multiple pipelines.
10. Full-stack technology for design, tape-out and measurement and control of high-performance quantum chips
This invention targets the core technology in the closed loop of "design, tape-out, measurement and control" of superconducting quantum chip research and development, aiming to develop high-performance quantum chips with core competitiveness in the industry and provide basic support for the practical application of quantum computing. Through "end-to-end" optimization and integration with quantum software and quantum applications, the research and development of high-performance quantum chips will bring high potential value to fields such as artificial intelligence, materials science, drug research and development, and financial technology, thereby promoting the development of quantum computing. Industrialization.