FastDFS v6.05 mainly enhances and improves the binlog compression function of small file merged storage at the enterprise level. The main improvements are as follows:
1. Regularly generate new trunk binlogs based on memory snapshots to achieve the best compression effect, reduce disk space occupation, and significantly improve data loading speed. It is recommended to come every night;
2. The above trunk binlog compression supports transactions to ensure the correctness of the trunk free space data. Transactions are used to support data recovery after unexpected power failure or downtime (usually data rollback, or data submission may be done, and the system will complete it automatically without manual intervention);
3. Automatically back up trunk binlog at an appropriate time for disaster recovery (there is an upper limit on the number of backups, such as a maximum of 7 copies, and the oldest backup file is deleted using the first-in-first-out method);
4. Trunk space allocation supports alignment (such as 256 or 512 byte alignment), which can effectively prevent excessive trunk fragments and improve trunk space utilization;
5. For multiple contiguous free (free) trunk spaces, it supports merging into a larger free space. Avoid the situation that the total amount of trunk free space is large, but it is still necessary to create a new trunk file to allocate a larger trunk space;
6. When the space of the entire trunk file is free, you can delete the trunk file directly to reduce the space occupied by the disk.
friendly reminder:
1. FastDFS v6.05 only needs to upgrade the server-side program, you need to use libfastcommon V1.43 and above;
2. The configuration items corresponding to the above function points are all in tracker.conf. After modification, you need to restart all tracker servers first, and then restart the storage server. Please refer to the HISTORY file for the guidelines of each configuration item, and refer to the tracker.conf for configuration examples and brief descriptions.
The detailed Changelog is as follows:
Version 6.05 2019-12-25
* fdfs_trackerd and fdfs_storaged print the server version in usage.
you can execute fdfs_trackerd or fdfs_storaged without parameters
to show the server version
* trunk server support compress the trunk binlog periodically,
the config items in tracker.conf: trunk_compress_binlog_interval
and trunk_compress_binlog_time_base
* trunk binlog compression support transaction
* support backup binlog file when truncate trunk binlog,
the config item in tracker.conf: trunk_binlog_max_backups
* support alignment size for trunk space allocation
the config item in tracker.conf: trunk_alloc_alignment_size
* support merge free trunk spaces
the config item in tracker.conf: trunk_free_space_merge
* support delete unused trunk files
the config item in tracker.conf: delete_unused_trunk_files
* fdfs_monitor.c: do NOT call getHostnameByIp
NOTE: you MUST upgrade libfastcommon to V1.43 or later
This article is shared from the WeChat public account - FastDFS Sharing and Exchange (fastdfs100).
If there is any infringement, please contact [email protected] to delete it.
This article participates in the " OSC Yuanchuang Project ", you are welcome to join and share with us.