通过tunasync部署开源镜像站

叙述

tunasync是清华大学TUNA镜像源目前使用的镜像方案，硬盘至少2TB，同步速度与网络带宽、磁盘读写速度有关。

部署

1、安装依赖

[root@mirrors ~]# yum install rsync wget

2、下载tunasync

[root@mirrors ~]# wget https://github.com/tuna/tunasync/releases/download/v0.3.7/tunasync-linux-bin.tar.gz
[root@mirrors ~]# tar xf tunasync-linux-bin.tar.gz
[root@mirrors ~]# mv tunasync /usr/bin/
[root@mirrors ~]# mv tunasynctl /usr/bin/

3、创建仓库目录

[root@mirrors ~]# mkdir -p /data/mirrors

4、创建日志目录

[root@mirrors ~]# mkdir -p /data/logs/tunasync

5、创建tunasync配置文件

[root@mirrors ~]# mkdir /etc/tunasync

6、创建manager.conf配置文件

[root@mirrors ~]# vi /etc/tunasync/manager.conf
debug = false

[server]
addr = "127.0.0.1"
port = 18080
ssl_cert = ""
ssl_key = ""

[files]
db_type = "bolt"
db_file = "/etc/tunasync/manager.db"
ca_cert = ""

manager部分参数说明：
addr：manager服务监听地址
port：manager服务监听端口
ssl_cert和ssl_key：证书配置
db_file：数据库文件位置

7、创建worker.conf配置文件

[root@mirrors ~]# vi /etc/tunasync/worker.conf
[global]
name = "test_worker"
log_dir = "/data/logs/tunasync/{{.Name}}"
mirror_dir = "/data/mirrors"
concurrent = 10
interval = 240

[manager]
api_base = "http://127.0.0.1:18080"
token = ""
ca_cert = ""

[cgroup]
enable = false
base_path = "/sys/fs/cgroup"
group = "tunasync"

[server]
hostname = "localhost"
listen_addr = "127.0.0.1"
listen_port = 6000
ssl_cert = ""
ssl_key = ""

[[mirrors]]
name = "centos"
provider = "rsync"
upstream = "rsync://mirrors.tuna.tsinghua.edu.cn/centos/"
use_ipv6 = false

[[mirrors]]
name = "epel"
provider = "rsync"
upstream = "rsync://mirrors.tuna.tsinghua.edu.cn/epel/"
use_ipv6 = false

worker部分参数说明：
log_dir：tunasync日志路径
mirror_dir：镜像的路径
concurrent：线程数
interval：同步周期，单位分钟
api_base：manager地址
name：镜像名称
upstream：upstream同步地址

8、下载tunasync启动停止脚本

[root@mirrors ~]# wget -P /etc/init.d/ https://raw.githubusercontent.com/whsir/tunasync-bin/master/tunasync-manager
[root@mirrors ~]# wget -P /etc/init.d/ https://raw.githubusercontent.com/whsir/tunasync-bin/master/tunasync-worker
[root@mirrors ~]# chmod +x /etc/init.d/tunasync-manager
[root@mirrors ~]# chmod +x /etc/init.d/tunasync-worker

9、启动服务

[root@mirrors ~]# /etc/init.d/tunasync-manager start
[root@mirrors ~]# /etc/init.d/tunasync-worker start

10、查看同步状态

此处18080为manager的端口

[root@mirrors ~]# tunasynctl list -p 18080 --all

11、添加计划任务

[root@mirrors ~]# */1 * * * * wget -q http://127.0.0.1:18080/jobs -O /data/mirrors/jobs.json

12、配置前端web

[root@mirrors ~]# rpm -ivh http://mirrors.wlnmp.com/centos/wlnmp-release-centos.noarch.rpm
[root@mirrors ~]# yum install wnginx -y

13、配置nginx

[root@mirrors ~]# vi /usr/local/nginx/conf/vhost/demo.conf  

修改后的内容如下

server
    {
        listen 80 default_server;
        server_name _;
    root /data/mirrors;
    location ~ ^/(centos|epel) {
          index  index.html index.htm;
          autoindex on;
          autoindex_exact_size off;
          autoindex_localtime on;
        }


        error_page   500 502 503 504  /50x.html;

        #include enable-php56.conf;
        #include enable-php70.conf;
        #include enable-php71.conf;
        #include enable-php72.conf;
        #include enable-php73.conf;
    #include enable-php74.conf;

        location ~ .*\.(gif|jpg|jpeg|png|bmp|swf)$
        {
            expires      30d;
        }

        location ~ .*\.(js|css)?$
        {
            expires      12h;
        }

        access_log  /data/logs/nginx/demo_access.log;
    error_log /data/logs/nginx/demo_error.log;
    }

14、设置前端web

[root@mirrors ~]# cd /data/mirrors
[root@mirrors ]# wget http://down.whsir.com/downloads/mirrors_web.tar.gz

重启nginx

[root@mirrors ~]# /etc/init.d/nginx restart

15、访问测试
访问URL即可看到内容，由于源很大，同步时间会比较长