How to deal with the peak traffic calmly?

Introduction: SAE is an application-oriented Serverless PaaS platform that can help users avoid IaaS operation and maintenance, use on-demand, and pay-as-you-go, achieve low-threshold service applications to the cloud, and support multiple languages ​​and high flexibility, perfect fit Entering a higher school online responds to the core demands for rapid horizontal expansion of burst traffic and improvement of system performance on the resource side.

Author: meter margin, Ali cloud solutions architect


Shengxue Online is a brand of Wuhan Shengxue Online Technology Co., Ltd. It is a career service platform with more than 6,000 contracted high schools and more than 1,200 cooperative colleges and universities. It aims to provide education services for high schools and provide admission and employment services for colleges and universities. Parents of students provide education counseling products to enable high school students to go to better universities and college students to find better jobs. They are the masters of college employment services. Shengxue Online has a high school enrollment planning education service system constructed in the form of intramural lectures, off-campus research, platform evaluation, manual reference, etc., and a college enrollment service system with enrollment management system, enrollment team training, planning packaging and printing, and advertising as the main body. A one-stop university employment management service system that solves the problems of university and student employment, and enterprise school recruitment.


Clients’ high school and university career service platforms rely on WeChat mini-programs, which usually have tens of thousands of DAUs, and DAUs will reach hundreds of thousands or even millions before and after the school season. In addition, customers will often cooperate with well-known teachers of various high schools & colleges and educational authorities to conduct live broadcast activities, such as high school entrance examination, college entrance examination experience sharing, and answering questions for students and parents. Therefore, the overall flow of the college entrance online will be relatively large, and there will be irregular flow tides.


In addition, the overall technology stack of the University Online is a single PHP application, which is deployed on ECS. In the context of traffic tides, customers currently cannot achieve rapid horizontal expansion of the application, which leads to performance bottlenecks in the application system during peak traffic and affects user experience. .


Therefore, in the traffic tide scenario, the application system has the ability to deal with the rapid and horizontal expansion of sudden traffic, and improving the performance of the application system on the resource side is the core demand of the online college entrance examination.


What are the performance advantages of Serverless App Engine (SAE) in different scenarios?


SAE is an application-oriented Serverless PaaS platform that can help users avoid IaaS operation and maintenance, use on-demand, and pay-as-you-go, achieve low-threshold service applications to the cloud, and support multiple languages ​​and high flexibility.


1.png


  • Transformation of microservice architecture: Enterprises will face many pain points during the transformation of microservice architecture, such as high technical threshold and maintenance costs for microservice or containerized transformation, high stability risks, product iterations that cannot keep up with business changes, and low R&D efficiency. SAE is ready to use out of the box and supports the upgrade of a full set of microservice architectures such as Spring Cloud/Dubbo/HSF, smooth migration, and improved service delivery efficiency; free operation and maintenance of IaaS and microservice components, and the cloud platform is responsible for stability.


  • Serverless is extremely flexible: For industries such as new retail, mutual entertainment, cultural media, catering/travel, etc., they often face big promotion activities. During the big promotion, the capacity estimation is inaccurate, and the system SLA is risky when there is a sudden traffic; the peaks and valleys are obvious. There is a lot of idle waste. SAE can provide a complete set of high-availability solutions for precise capacity + extreme flexibility + current limiting and downgrading, enabling flexible start and stop and improving resource utilization.


  • Fast enterprise cloud/relocation: For industries such as the Internet, the Internet of Things, blockchain, supply chain, etc., SAE can help companies get through DevOps & basic products & monitoring products & high-availability products in the process of cloud / relocation. One-stop out-of-the-box experience. At the same time, SAE provides fully managed services and high integration of cloud products, which improves the efficiency of business delivery.


SAE helps students to go online to improve the ability of second-level elastic scaling

C1EC1493-AC46-4D03-A3EC-E9F653E5E4DC.png


In order to meet business needs, College Online chose Alibaba Cloud's Serverless App Engine (SAE) as the deployment platform for the application system. Many features of SAE fit the core demands of customers:


  1. O&M-free IaaS : Customers focus on business in research and development, and there are no professional O&M personnel. The O&M-free feature of SAE effectively solves the pain points of online education. Shengxue Online combines cloud efficiency and SAE to automate the release and deployment process, and does not need to pay attention to the technology of the underlying container. The entire SLA is covered by SAE.
  2. Multi-language support : The client is currently a single PHP application, which can be easily deployed to SAE by building it as a mirror image. Through the process of combining cloud effect and SAE, customers only need to submit PHP code to trigger the CICD process, and the PHP application is automatically built as a mirror image and automatically published to SAE.
  3. High resilience : SAE is based on the serverless architecture, and has second-level elastic scaling capabilities through optimization technologies such as mirror acceleration, enabling rapid expansion and contraction of large-scale applications, and rapid expansion during traffic peaks to respond to peak pressures, and to ensure stability.
  4. Cost optimization : According to the usage of CPU and memory, you are billed by the minute. Relying on the ultimate flexibility, the number of function instances and traffic peaks and valleys can be perfectly matched to achieve cost optimization.


After Shengxue Online officially migrated the application system to SAE in early February, it ushered in large-scale teacher-student activities, with tens of thousands of teachers and hundreds of thousands of students, and the overall PV reached more than 1,000w . With the support of SAE, the performance of the system was stable throughout the event, which brought possibilities for more diverse promotional activities in the future.


What value does Alibaba Cloud Serverless Application Engine (SAE) bring to customers?


  1. Stability : Relying on the powerful IaaS resources of Alibaba Cloud, through technologies such as image acceleration and cold start optimization, SAE based on the serverless architecture also has strong horizontal expansion and underlying expansion capabilities when facing large-scale applications, helping customers to deal with large-scale applications calmly. The impact of data volume and large flow.
  2. Reduce costs : Serverless architecture eliminates the need for customers to purchase and manage infrastructure such as servers, reducing operation and maintenance costs. At the same time, the function calculation supports the second-level on-demand charging mode, coupled with the ultimate elastic scalability, so that the cost control has been optimized.
  3. Improve human efficiency : Customers only need to focus on the development of business logic, without distracting to consider the issues on the operation and maintenance side, only need to submit the business code, and the subsequent CICD process is automatically processed by the cloud effect and SAE. In addition, SAE provides monitoring functions for application node dimensions and application interface dimensions, helping students to quickly troubleshoot online problems, greatly improving human efficiency.


Customer testimony


The "Third Teacher Training Class-Campus Online Winter Vacation and School Service Festival" is aimed at launching the "Four Helps and Six Helps" service platform for the online "Four Helps and Six Helps" service platform. It is estimated that 100,000 high school teachers from all over the country will be recruited to participate in the live broadcast of the course training ( Actually reached 150,000+, of which more than 50,000 were added). The success of this event was due to the cooperation of Alibaba Cloud and its service providers in terms of product and technology. We successfully completed the previous SAE+PolarDB (MySQL) environment switch deployment and PTS stress test verification (up to 50) 2C4G nodes can support 8000+ concurrency).


related products

Serverless App Engine (SAE) : Application-oriented Serverless PaaS, 0 threshold + 0 transformation + 0 container foundation can enjoy the technical bonus brought by Serverless + K8s + microservices.


Scan the code to learn more technical dry goods and customer cases:

image.png


Original link: https://developer.aliyun.com/article/782209?

Copyright statement: The content of this article is voluntarily contributed by Alibaba Cloud real-name registered users. The copyright belongs to the original author. The Alibaba Cloud Developer Community does not own its copyright and does not assume corresponding legal responsibilities. For specific rules, please refer to the "Alibaba Cloud Developer Community User Service Agreement" and the "Alibaba Cloud Developer Community Intellectual Property Protection Guidelines". If you find suspected plagiarism in this community, fill in the infringement complaint form to report it. Once verified, the community will immediately delete the suspected infringing content.

Guess you like

Origin blog.csdn.net/alitech2017/article/details/114636878