1. Download the installation package. When downloading from the official website, you need to register and log in. Follow the instructions. Greenplum official software package download address: https://network.pivotal.io/products/pivotal-gpdb/#/releases/449820/file_groups/2047
As currently greenplum only has rpm installation packages, you need to pay attention to dependency resolution when installing.
2. Cluster deployment, based on centos6.5 version in the development environment.
| ip |
hostname |
role |
| 192.168.1.173 |
worker01 |
master，segment，mirror |
| 192.168.1.174 |
worker02 |
standby，segment，mirror |
| 192.168.1.175 |
worker03 |
segment，mirror |
3. Server parameter configuration (the following operations need to be performed on all machines in the cluster)
3.1: Configure tcp parameters. Modify /etc/sysctl.conf and execute sysctl -p to make the configuration take effect after the modification is completed.
net.ipv4.ip_forward = 0
net.ipv4.conf.default.accept_source_route = 0
kernel.core_uses_pid = 1
kernel.msgmnb = 65536
kernel.msgmax = 65536
kernel.shmmax = 68719476736
kernel.shmall = 4294967296
net.ipv4.tcp_keepalive_time = 1200
net.ipv4.ip_local_port_range = 10240 65535
vm.swappiness=0
net.ipv4.tcp_sack=1
net.ipv4.tcp_timestamps=1
net.ipv4.tcp_window_scaling=1
net.ipv4.tcp_congestion_control=cubic
net.ipv4.tcp_syncookies=1
net.ipv4.tcp_tw_recycle=0
net.ipv4.tcp_max_syn_backlog=65535
net.core.somaxconn=65535
net.core.rmem_max=16777216
net.core.wmem_max=16777216
vm.overcommit_memory=1
fs.file-max = 2097152
fs.nr_open = 2097152
net.core.netdev_max_backlog = 16384
net.ipv4.tcp_mem = 786432 2097152 3145728
net.core.optmem_max=4194304
net.ipv4.tcp_max_tw_buckets = 1048576
net.ipv4.tcp_fin_timeout = 30
net.ipv4.conf.default.rp_filter = 0
net.ipv4.conf.all.rp_filter = 0
net.ipv4.conf.eth0.rp_filter = 0
net.core.rmem_default = 16777216
net.core.wmem_default = 16777216
net.ipv4.tcp_rmem = 4096 87380 16777216
net.ipv4.tcp_wmem = 4096 65536 16777216
net.ipv4.conf.all.arp_filter = 1
net.ipv4.conf.default.arp_filter = 1
vm.max_map_count = 1048575
kernel.shmmni = 4096
kernel.sem= 250 512000 100 2048
kernel.sysrq = 1
kernel.msgmni = 2048
kernel.pid_max=4096000
|
3.2: Modify /etc/security/limits.conf
* soft nofile 65536
* hard nofile 65536
* soft nproc 131072
* hard nproc 131072
|
3.3: Modify the I/O scheduling algorithm
[root@worker01 ~]# echo deadline > /sys/block/vdb/queue/scheduler
[root@worker01 ~]# grubby --update-kernel=ALL --args="transparent_hugepage=never"
|
4. Start installing greenplum
4.1: Add gpadmin user, after setting the password, and configure the password-free login of the cluster under this user.
4.2: Install greenplum under the root user: rpm -ivh greenplum-db-6.0.0-rhel6-x86_64.rpm (this installation operation needs to be performed on all machines in the cluster). After the installation is complete, the software location is located in: /usr/local/ directory.
4.3: Modify the permissions of the installation directory:
[root@worker01 ~]# chown -R gpadmin.gpadmin /usr/local/greenplum-db*
[root@worker01 ~]# chown gpadmin.gpadmin /usr/local #需要在每个节点执行授权
|
4.4: Switch to the gpadmin user and perform the following operations in the user directory:
[gpadmin@worker01 ~]$ vi list # 将集群的所有机器hostname添加到该目录中
worker01
worker02
worker03
|
4.5: Add environment variables
[gpadmin@worker01 ~]$ cat /usr/local/greenplum-db/greenplum_path.sh >>~/.bashrc
[gpadmin@worker01 ~]$ cat >> ~/.bashrc <<EOF
MASTER_DATA_DIRECTORY=/data/master/gpseg-1
export MASTER_DATA_DIRECTORY
EOF
[gpadmin@worker01 ~]$ source ~/.bashrc
|
4.6: Configure password-free login: gpssh-exkeys -f list
4.7: Create a data directory:
[gpadmin@worker01 ~]$ gpssh -f list -e " sudo chown gpadmin.gpadmin /opt/data"
[gpadmin@worker01 ~]$ gpssh -f list -e " mkdir -p /opt/data/{primary,mirror}"
[gpadmin@worker01 ~]$ mkdir -p /opt/data/master # 创建master目录
|
5. Initialize the Greenplum Database system
5.1: Copy a gpinitsystem_config file from the template
[gpadmin@worker01 ~]$ cp $GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config /home/gpadmin/gpinitsystem_config
[gpadmin@worker01 ~]$ chmod 775 gpinitsystem_config
|
5.2: Set all necessary parameters in the copied gpinitsystem_config file
ARRAY_NAME="Greenplum Data Platform"
SEG_PREFIX=gpseg
PORT_BASE=6000
## 数据文件的位置
declare -a DATA_DIRECTORY=(/data/primary)
MASTER_HOSTNAME=worker01
MASTER_DIRECTORY=/data/master
MASTER_PORT=5432
TRUSTED_SHELL=ssh
CHECK_POINT_SEGMENTS=8
ENCODING=UNICODE
MIRROR_PORT_BASE=7000
declare -a MIRROR_DATA_DIRECTORY=(/data/mirror)
|
5.3：初始化数据库：
[gpadmin@worker01 ~]$ gpinitsystem -a -c gpinitsystem_config -h list # 只需要在master角色的机器上执行
|
5.4：初始化完了之后，使用psql登录验证：
[gpadmin@worker01 ~]$ psql -d postgres # 当成功进入数据库后表示安装成功
|
5.5、为master和segment添加mirror进程
1、在所有需要添加mirror的主机，创建存放mirror的数据目录（如果已经创建，忽略此操作）
[gpadmin@worker01 ~]$ mkdir /opt/data/mirror
以下再master操作
2、生成配置文件
[gpadmin@worker01 ~]$ gpaddmirrors -o addmirror
3、添加mirror
[gpadmin@worker01 ~]$ gpaddmirrors -a -i addmirror -v
|
5.6、为master添加standby进程
1、在standy节点上创建master目录
[gpadmin@worker01 ~]$ mkdir /opt/data/master
2、在master上执行
[gpadmin@worker01 ~]$ gpinitstandby -a -s worker02
|