In this issue, we bring about cutting-edge applications of high-computing AI modules and related content on SoC array servers based on ARM architecture. Surging computing power, innovative architecture, and heterogeneous computing are expected to become the intelligent computing base of the future information society.
▌Performance advantages + AI-driven, accelerated penetration of ARM-based servers
For a long time, various processor chips based on the ARM architecture have been widely used in various communication and electronic devices such as mobile phones, tablet computers, and Internet of Things terminal devices due to their comprehensive characteristics such as low power consumption, high performance, high reliability, and cost advantages. In the field of products, it has greatly promoted the process of informatization and intelligence in human society.
In the field of servers, products based on the X86 architecture have been dominant before. In recent years, with the continuous growth of downstream demand for heterogeneous computing power and intelligent computing power, and the large-scale rise of native Android applications such as cloud games , more and more manufacturers began to apply the ARM architecture to the server field, and launched a series of related products.
Since last year, with the growing demand for intelligent computing power and the huge demand of generative AI for heterogeneous computing power, ARM-based servers have shown unique advantages in emerging application markets such as cloud games and digital humans. , there are also signs of acceleration.
Features of ARM architecture server:
1. Low power consumption: The ARM architecture has the advantage of low power consumption. Compared with the traditional X86 architecture chip, the processor chip it uses has lower power consumption and higher energy efficiency ratio. The ARM server integrated in the IDC architecture can Reduce electricity bills and save energy consumption.
2. High efficiency: The ARM architecture has better multi-core thread-driven performance, and can achieve better parallel processing and task processing capabilities.
3. Low cost: ARM architecture processor chips have lower manufacturing costs than X86 architecture chips. ARM architecture servers are extremely cost-effective and have lower development costs.
4. High reliability: It has better fault tolerance and can provide higher reliability and stability.
It is understood that leading companies such as Amazon, Inspur, Tencent, Baidu, and Ali have launched server products based on the ARM architecture. , medical and health and other fields have a wide range of applications.
According to TrendForce research, in recent years, enterprises' demand for digital transformation such as artificial intelligence and high-performance computing has accelerated, driving the increase in the proportion of cloud adoption. The world's major cloud service providers have successively introduced ARM-based servers to improve service flexibility. It is expected that by 2025, ARM Architecture will reach 22% in data center server penetration .
▌SoC array server based on ARM architecture, an emerging force in the field of intelligent computing power
Based on the ARM architecture, innovatively adopting SoC chips as the source of computing power, the SoC array server built with a flexible array architecture has also gradually entered enterprise-level IDC and various edge computing scenarios. This is a high-density server specially designed for space constraints and energy-saving requirements faced by enterprise-level data centers and edge scenarios. Up to 40, 60, 80 and other customized high-computing modules or boards for server scenarios can build low-cost, high-density, high-concurrency, high-performance computing clusters for customers in various industries.
Each computing module or computing board arranged in the server is a minimum system that can run independently, including CPU, GPU, NPU, storage, network, etc. Relevant SoC array servers can customize a variety of computing power nodes according to customer needs, and their interior adopts modular and hot-swappable design, which can realize non-stop maintenance. In terms of communication, it is equipped with 10G/25G switching nodes, supports SDN automatic network deployment, and has built-in multi-dimensional intelligent management nodes, which can carry out all-round remote operation and maintenance work, effectively reducing operation and maintenance costs.
Taking the cloud game scene as an example, with the global popularity of popular games such as "Yuan Shen" and "Heng Huai", in addition to the transfer of game operation to the mobile terminal, it has also greatly promoted the rapid expansion of the cloud game market. Traditional general-purpose servers have problems such as poor compatibility and high cost in supporting the operation of cloud games, while array servers based on ARM architecture, based on the natural compatibility with the Android ecosystem, avoid the software architecture conversion from the server end to the application end As well as the performance loss during the conversion process, in recent years, it has almost dominated the cloud game scene, and is gradually expanding to digital human, industrial vision, edge AI, cloud XR rendering and other fields.
▌MAG’s high-computing AI module provides surging computing power for SoC array servers
As the first company in the industry to launch high-computing AI module products, MeiG Intelligent has also continued to promote the use of AI module products in servers, robots, AI retail, drones, cloud games, digital humans, cloud desktops, cloud education, and industrial In-depth applications in various fields such as AI detection and cloud XR, so that the AI capabilities of products can truly help the industry.
MeiG Intelligent helps customers to customize and launch SoC array server products, which integrate CPU+GPU+NPU+TPU composite heterogeneous computing power clusters, which can build large-scale intelligent computing power matrix; each computing power node adopts blade+array design, supporting Hot-swappable, easy maintenance; 80GB bandwidth for the whole machine, 1GB bandwidth for each board when fully loaded; built-in BMC multi-functional comprehensive monitoring and visual management system, which can be easily managed remotely.
▲Array server terminal with built-in MeiG intelligent high-computing AI module SNM970
This SoC array server adopts the high-computing AI module SNM970 specially customized by MeiG Intelligent, developed based on Qualcomm QCS8550 (8 Gen2), supports 16GB LPDDR5X + 256GB UFS 4.0 memory , and can configure up to 80 high-computing channels in the server Power AI module , a single module supports Android virtualization inside, and can virtualize multi-channel computing units (such as 80-channel module servers, and a single module can virtualize multiple virtual machines according to downstream computing power requirements, such as virtual In the case of 4 channels, it can support 320 terminals such as mobile phones to run cloud games at the same time), better configure computing power, give full play to the advantages of high computing power, high cost performance, and high energy efficiency ratio, and provide real-time interactive cloud Computing, edge AI cloud computing, cloud rendering and other business scenarios provide the best computing base.
With the explosive growth of demand for computing power in all walks of life and the urgent need for innovative servers in emerging application scenarios, MeiG Smart will also increase its efforts to promote the in-depth application of high computing power AI modules in the server field.
At present, the MeiG Smart team has worked closely with industry-leading SoC array server customers to successively create a deep customized computing power module based on Qualcomm Snapdragon 865/SM8475/QCS8550 three-generation SoC chips for SoC array server scenarios , At the same time achieve packaging compatibility, better help customers to improve computing power and product iterations, and provide better assistance for the subsequent application and promotion of related products in the AIGC field, as well as penetration into the traditional server market.
The China Telecom Terminal Industry Association released the "Technical Specifications for SoC Array Servers Based on ARM Architecture" on April 26, 2023, which clarified the general technical requirements for ARM architecture SoC array servers in the form of group standards. The product standards of the next-generation server are beginning to be discussed, and related products will gradually enter the fast lane of development.