After more than 4 months of pre-research, development and testing, FastCFS 5.0 is finally available to everyone. FastCFS 5.0 uses the ibverbs native method to adapt to the RDMA network, which can give full play to the low latency and high throughput characteristics of the RDMA network. Special thanks to @Frank for providing a high-end server in the IB environment for our pre-research; thank you very much @yunqi for patiently answering questions on ibverbs programming; thank you very much @AI Momo public account for providing a very useful chatGPT question and answer service to help me answer questions Got a lot of doubts.
We rented Alibaba Cloud g8 type ECS and used its eRDMA feature. The 4KB random read performance in the fuse scenario improved by 50% compared to the socket method; we directly called fcfs_beachmark of the API (pure user mode), and the performance in non-busy polling mode Compared with the socket mode, the performance is improved by 80%, and the performance in busy polling mode is improved by 110%. We will look for opportunities to conduct performance comparison tests in the IB network environment in the future, and it is expected that the performance improvement will be more obvious.
Whether to enable busy polling, our server is configured in smart mode by default. When the QPS of a connection exceeds the threshold (such as 10240) for N consecutive seconds (such as 3 seconds), busy polling mode is enabled; if it is lower than the threshold for N consecutive seconds, it returns to non-busy polling mode.
Friendly reminder: For configuration examples and instructions, please refer to the configuration file in the conf/full/ subdirectory of the source code.
The bugs fixed in V5.0 are as follows:
[fdir] bugfixed: dentry_create set loaded_flags correctly
[fdir] bugfixed: must use lock for db skiplist
[libfdirstorage] bugfixed: set variable normal_update correctly
[libfsstorage] segment reclaim more robustly
FastCFS 5.0 has passed relatively sufficient testing. Friends with RDMA network environment are welcome to conduct performance testing. It is recommended that users using old versions of FastCFS upgrade to the latest version as soon as possible. If you have any questions or suggestions, you are welcome to submit an issue on gitee. Of course, you can also join the group to communicate.