20 years of "barbaric growth" of Chinese Internet
360 NetOPS 360 Cloud Computing
The heroine's declaration:
Since the introduction of the Internet into China in the mid-1990s, China’s Internet has grown "savagely" for more than 20 years. China Telecom, China Unicom, and China Mobile have formed a tripartite position in the domestic Internet access field. However, all walks of life have their own ways of survival. Today I will share with you a dry goods PPT from the 360 NetOPS team. I think such a good thing must be shared with everyone! (Ordinary people, I don’t tell him)
PS: The rich first-line technology and diversified forms of expression are all in the "HULK first-line technology talk", please pay attention!
Background introduction
The internal IDC network of 360 is very complicated, and as far as the editor knows, it covers hundreds of large and small computer rooms across the country. The construction of the 360 HULK platform is inseparable from the company's strong network support team. It's like a person walking, and he can't run without two strong thighs. Managing this complex IDC network is no easy task. It is very difficult to become a thigh. What's more, the complexity of domestic operators is unimaginable. If you don't understand these rules, sometimes our products don't know how to die. Only by adapting and flexibly using these rules can our products and services maximize their competitiveness. In an era where product experience is king, improving user experience is what we should focus on and do well.
1
Introduction to carrier network basics
Current Status of China Telecom's IP Network Architecture
China Telecom's IP network includes a backbone network and a metropolitan area network. The backbone network is divided into two parallel networks, ChinaNet and CN2, each with an independent public AS number. Metropolitan area network and star IDC each have independent public or private AS numbers.
Backbone network
- The ChinaNet network is positioned as a public information exchange platform, carrying basic Internet access services
- The CN2 network is positioned to carry QoS-required services and China Telecom’s own key services. The network basically covers all cities.
Metropolitan Area Network
- The metropolitan area network uniformly carries various services, including basic Internet access services, services with QOS requirements, and telecom self-operated services. At the same time, it is connected to ChinaNet and CN2.
- IDC uniformly carries various public services and self-operated services, and at the same time, ChinaNet and CN2 are connected
- The MCE network is positioned to carry China Telecom's own key services, such as softswitch, IMS, mobile data value-added services, mobile broadband services, etc. The network is deployed in units of prefectures and cities, and it is interconnected with CN2 nearby.
- The packet domain network is scheduled to carry China Telecom's mobile broadband services and mobile data value-added services, and it will be deployed on a provincial basis
As shown: 
ChinaNet's full name: China Telecom Broadband Internet.
ChinaNet is divided into two layers: backbone network and metropolitan area network.
Bearer business: very few, very simple.
Network scale and structure: very large and complex.
The core and junction layers of some domestic backbone networks cover 47 cities across the country and more than 200 metropolitan area networks.
ChinaNet network status
ChinaNet is composed of core layer and junction layer, achieving a flat structure.
The nine nodes in the core layer (Beijing, Shanghai, Guangzhou, Nanjing, Wuhan, Chengdu, Tianjin, Xi'an, Hangzhou) are fully interconnected, of which Beijing, Shanghai, and Guangzhou are the international access nodes and interconnection nodes;
The tandem layer has two tandem nodes in each province, and two or three core nodes are uplinked. After the access layer equipment of each province is flattened, it is assumed by the core equipment of the metropolitan area network, and directly connected to the backbone tandem or core equipment (some provinces in the north still retain the back-to-back structure of the provincial network core and the backbone);
After the expansion in 2015, the total inter-provincial bandwidth of ChinaNet reached nearly 45T, and the international export bandwidth was 1.3T
as shown in the figure:
China Telecom ChinaNet network backbone topology
The backbone network layer can be divided into three layers: the core layer, the tandem layer and the access layer. In addition, the core layer is also connected with the international access layer and the interconnection layer.
The backbone network is divided into 3 major areas:
Beijing, Shanghai, Guangzhou
The 3 major areas of the backbone network are subdivided into 9 major areas:
Beijing area: Beijing area, Tianjin area, Xi'an area
Shanghai area: Shanghai area, Nanjing area, Hangzhou area
Guangzhou area: Guangzhou area, Wuhan area, Chengdu area core layer
Core layer:
Super core: Beijing, Shanghai, Guangzhou
Normal core: Tianjin, Xi'an, Nanjing, Hangzhou, Wuhan, Chengdu
The Full-Mesh connection between core nodes is responsible for information exchange between provinces, and the super core is also responsible for traffic interaction with other domestic operators and international visits.
Tandem layer:
Landed equipment in northern provinces, and converged equipment in southern provinces. The two sides of each province are connected upwards, respectively connected to a super core and a common core node, and some provinces are connected in three directions.
Access layer:
Provinces that have not yet completed flattening still have access layer equipment at prefectures and cities, which are used to access metropolitan area networks in the province.
ChinaNet domestic interconnection
There are interconnection equipment (E router) in the three super cores of Beijing, Shanghai and Guangzhou. The interconnection equipment (E router) is directly connected to the super core C router.
ChinaNet uses interconnection equipment to interconnect and communicate with some other operators.
ChinaNet domestic interconnection network topology
ChinaNet International Network Interconnection
Interconnection between international networks
In the three super cores of Beijing, Shanghai, and Guangzhou, the international network interconnection equipment (X router) is connected. ChinaNet uses the X router to interconnect and exchange traffic with other operators in the world.
CN2 network business positioning
- Profitable business with SLA guarantee
- A unified core bearer platform that supports voice, data, video, dedicated line and other services at the same time
- Carrying China Telecom's own key profitable services and SLA services with QoS guarantee
- At the beginning of network planning and design, we fully ensure the controllability and manageability of CN2, fully consider the current services at the time, and give due consideration to future applications.
Overseas network
POP nodes have been set up in Hong Kong, Tokyo, Singapore, London, Frankfurt, New York, Washington, San Jose, and Los Angeles to provide international Internet access and Internet interconnection services.
At present, the CN2 international network has been interconnected with some international operators. Among them, the European POP points are interconnected with TeliaSonera, in addition to the Japanese operator NTTCom, and the Hong Kong operator Reach are interconnected, and have certain international access channel guarantees.
High-quality IP services provided by CN2
Using CN2 high-quality network channels, users of international express services can access the international Internet through CN2 channels. Such users can be high-quality users connected through the metropolitan area network or high-quality users connected through CN2. Ordinary customers who access the domain network still access the international Internet through the ChinaNet backbone.
China Telecom International Optical Cable
China's three major operators interconnected
The interconnection bandwidth between the three major operators is relatively small and often congested. Therefore, cross-network access is often particularly slow.
As shown in the figure:
2
"Tips" for small operators
Traffic optimization for small and medium operators
1. The caching platform guides traffic-http and P2P hijacking through traffic mirroring, and hijacking through domain names.
2. Save BGP export or Internet access bandwidth through NAT. Internet access bandwidth is much more expensive than purchased third-party NAT bandwidth.
As shown in the figure:
Traffic Optimization for Small and Medium Operators-NAT
Traffic optimization for small and medium operators-caching
3
BGP network explained
BGP is actually a kind of network protocol, the full name is Border Gateway Protocol. It is mainly used for interconnection between different autonomous systems. OSPF/ISIS and other protocols are all routing protocols.
But it has been given a special meaning in China. BGP stands for high quality.
Formal BGP computer room
Fake BGP computer room
to sum up
After reading it, you will have a general understanding of the Internet access field in China. In the future work, there will be a more comprehensive and in-depth understanding of the optimization of the product's later user experience and the solution of network-related problems.