Distributed Storage Configuration Requirements

In order to meet the storage requirements of the target application, we need a storage server with the following configuration requirements:

1. Storage capacity: 24-bay server hard disk, with a total capacity of not less than xxx TB. We recommend using 24 1.92TB enterprise-level SSD storage disks to ensure high-speed data read and write performance. And the usable capacity of each node should be no less than 90TB to provide enough storage space.

2. Network requirements: We require the storage server to have a high-speed network connection to meet the needs of data transmission. You can choose to use the Infiniband XXX model 100Gbps network card, which supports RDMA technology and can provide low-latency data transmission capabilities. In addition, a Gigabit network is required, including a data port network and a management port network, and supports IPMI remote management. In addition, if you choose to use 10GB 10 Gigabit Ethernet, you need to compare the performance with the IB network equipment to ensure that the requirements are met. At the same time, it is also necessary to support control node and network card redundancy to ensure high availability of the system.

File System Software Requirements

On the storage server, we need to install distributed storage software as a file system to meet the requirements of high performance and high scalability.

1. Software architecture requirements: We need to choose a distributed storage software to realize distributed storage and management of data. This increases the throughput and reliability of the system. Which software to choose depends on actual needs and technical considerations.

2. Software license: We require that the software license be a lifetime license with no time limit for use. At the same time, it is necessary to ensure that it is a non-OEM version, and each server needs to install a set of server software. In addition, we also require at least 100 formal permanent licenses of clients, and offer client license expansion pricing plans.

3. After-sales service: In addition to the software itself, we also need to provide after-sales support and warranty services. This includes 3 years of after-sales support provided by the original factory and integrators, as well as support such as technical training, software construction testing and tuning.

Overall hardware and software requirements

In addition to storage server and file system software, we have the following overall requirements:

1. Performance requirements: The storage server needs to have sufficient performance to meet the needs of actual business. We require that it can support 1000 clients for random reading of image data, and the reading performance should not be lower than 500,000 pictures per second. The random picture data reading performance of each client is no less than 6000 pictures/second. In addition, it is also necessary to support more than 1,000 clients for random reading of image data, with a reading performance of no less than 200,000 pictures/second, and a single client's reading performance of no less than 2,000 pictures/second. These performance indicators need to be met when the image size is 32K, and the random data read performance fluctuation during the data writing process does not exceed 20%. Adjustments and corrections can be made according to actual business conditions during the test.

2. Stability requirements: The storage system needs to ensure 7x24 hours of high-voltage data reading and writing, without abnormal conditions, such as data reading failure, writing failure, data loss, etc. The business terms should stipulate the compensation method when there is a problem with stability, including the compensation ratio for the accumulated service stop time or the number of abnormal performance.

3. Scalability requirements: The storage system needs to support online expansion to meet the system capacity and performance requirements. The allocated file system data cannot be lost during capacity expansion, and specific scalability solutions and linear expansion performance data must be provided, including storage pool capacity scalability, throughput scalability, and network scalability.

4. Data reliability requirements: In order to ensure data security, we recommend adopting a double copy mode to provide hard disk fault tolerance and server fault tolerance. At the same time, it also needs to have network redundancy and fault tolerance to prevent data unavailability caused by network failure.

5. Graphical monitoring: In order to facilitate the management and monitoring of file systems, we require support for remote graphical management interfaces. Through this interface, the file system can be managed and monitored to improve the convenience of operation.

6. Client system requirements: The client system needs to support Ubuntu 14.04, Ubuntu 16.04 and CentOS 7+ operating systems. At the same time, the client software also needs to be upgraded and compatible with the client system.

7. Storage and client network support: The data communication between the storage server and the client needs to use Infiniband network or 10G network to ensure high-speed and stable data transmission.

8. Mounting requirements: The storage system pools storage resources into a single directory, and the client mounts the root directory of the storage server to the local through directory mounting.

9. Quota management: The storage system needs to support quota management for directories to control the usage of storage space.

10. User authority management: The storage system needs to support directory authority management by group and user, and can be connected with the Linux authority system to achieve unified authority control.