Distributed, centralized, cloud-native storage technology
Distributed storage software is truly unified storage, enabling the same set of storage systems to provide upper-layer applications with three types of data services: block, file, and object, to meet business needs for structured and unstructured data. Storage requirements, built-in data protection functions, such as: backup, disaster recovery, etc., distributed storage provides a variety of enterprise-level features, including snapshots, thin provisioning, backup, encryption, compression, QoS, etc., to help enterprises easily cope with rapid business changes. The need for flexible and reliable access to information.
Articles of the Architect Technology Alliance
https://mp.weixin.qq.com/s/s1zE7p9BXxFlKXCK71n_KA
Product Features
Cloud enterprise-level unified distributed storage
Resource sharing:
It can undertake various forms of data of users, realize unified storage resource management for users, break hardware lock, data can be balanced in the resource pool, simplify persistent protection design, comprehensive Uncover the potential value of existing data.
Elastic expansion:
As the back-end storage carrier of various cloud platforms and unstructured data and big data platforms, it can achieve horizontal expansion from a few units in a single resource pool to hundreds of units without downtime, with visual management, simple operation and maintenance, and built-in data Protection, adapt to the rapid response needs of user business innovation.
Multi-cloud friendly:
truly unified storage, the same storage system provides three data services of block, file and object for upper-layer applications. And support data protection to a variety of public clouds to improve data accessibility and mobility.
What are stand-alone, centralized, distributed and cloud-native storage?
The history of storage development
From stand-alone to the Internet, storage as the infrastructure, the main development is to build around the goal of building low-cost, high-performance, scalable, easy-to-use, and today, in terms of form, storage is divided into stand-alone storage, centralized storage Storage, distributed storage, cloud storage, cloud native storage.
The basic form of storage at each stage is as follows
Basic form of each stage
Storage data classification & model
Whether stand-alone storage, distributed storage, or cloud storage are based on specific application scenarios, build corresponding storage data models for specified data types
Data classification
data model
Storage type
There are three common storage types: block storage, file storage, and object storage
Block storage
Block-based storage mode, two common storage methods:
• DAS (Direct Attch Storage), directly connected to the host storage method
• SAN (Storage Area Netowrk), high-speed network link host storage method
File storage
Provide file storage services by relying on the network
Object Storage
Built on key-value storage, the core is to separate the data path (data) from the control path (meta), and build a storage system based on an Object-based Storage Device (OSD), and provide external services in the form of RSETful API
Stand-alone storage
Basic Concepts
A stand-alone storage system is an encapsulation of a stand-alone storage engine (the implementation of data structures on persistent media such as mechanical disks and SSDs), and provides external storage services for files, key-values, tables, or relational models.
Storage Engine
The storage engine is the engine of the storage system, which determines the functions and performance that the storage system can provide. The provided functions include:
• Add (Create)
• Read (Retrieve), random read and sequential scan
• Update (Update)
• Delete (The differences between Delete
engines are as follows:
Centralized Storage
Basic Concepts
Centralized storage contains more components in the storage system compared to stand-alone storage. There are also auxiliary equipment such as management equipment.
Reference: Basic Logic Diagram of Centralized Storage
System Composition
• The head, the core component of the entire storage system, usually consists of a controller, front and rear ports,
• The controller, usually two, to achieve mutual backup and high availability, the software in the controller Realize the management of disks, abstract disks into storage resource pools, and then divide them into LUNs for servers to use.
• Front and rear ports, front-end ports provide storage services for servers, and back-end ports are used to expand the capacity of the storage system (connect more storage devices).
• Disk cabinet (Just a Bound Of Disk, JBOD), the disk is hung in a special cabinet outside the server, with independent power supply, heat dissipation, interface, etc., and the internal cable is connected (SCSI), and the rear port of the machine head is mounted uniformly.
Distributed Storage
Basic Concepts
Distributed storage system is to interconnect scattered and independent storage devices through the network, associate the system, and provide storage services as a whole to the outside world.
System Classification
• Distributed File System
• Distributed Key-Value System
• Distributed Table System
• Distributed Database
Design Principles
• Refer to CAP
Cloud Storage
Basic Concepts
Cloud storage, a storage service method in the field of cloud computing, is built on the basis of distributed storage. Above, the upper layer provides storage services through the Internet. In addition to the basic characteristics of distributed storage, it is more flexible and is usually provided by cloud vendors.
Reference product
Cloud-native storage
Basic concept
Cloud-native storage is born out of cloud storage. In addition to the characteristics of cloud storage, all other components in the cloud-native ecosystem must have the same dynamic (public cloud/proprietary cloud/hybrid cloud, etc.) Extended application, S3 API driver, K8S friendly, etc.
Reference example
Rook Rook
, CNCF's first cloud-native storage project, introduces file, block and object storage systems to Kubernetes clusters to run seamlessly with other applications and services that are using storage. In this way, cloud-native clusters can be self-sufficient and portable across public cloud and on-premises deployments. The project was developed to enable enterprises to modernize their data centers for distributed storage systems running on-premises and in public cloud environments through dynamic application orchestration.
Rook Architecure
Ceph Rook integrates with Kubernetes
MinIO
MinIO is a high-performance, software-defined, object storage suite that helps customers build cloud-native data infrastructures. Integration with Kubernetes allows operators to manage storage using the Kubernetes interface, which handles everything from storage provisioning to volume placement.
Reference link
https://mp.weixin.qq.com/s/s1zE7p9BXxFlKXCK71n_KA
https://www.archeros.com/nav/893?bd_vid=12014986870130961076