目标:搭建一个jobmanager、两个taskmanager的集群
- 克隆一个flink机器,作为jobmanager,修改配置(直接上传flink压缩包解压即可)
修改masters文件
192.168.133.181::8081
修改slaves文件
192.168.133.182
192.168.133.183
修改flink-conf.yaml
jobmanager.rpc.address: 192.168.133.181
- 再克隆上述配置后的机器两台,修改ip分别为182和183即可
- 配置免密码登录,在jobmanager机器上如下操作
生成密钥,一路回车即可
[root@localhost ~]# ssh-keygen
将源机器生成的公钥拷贝到目的机器的~/.ssh/authorized_keys,测试登录,查看密钥配置是否成功;两台taskmanager做相同配置
[root@localhost ~]# ssh-copy-id -i ~/.ssh/id_rsa.pub [email protected]
[root@localhost ~]# ssh [email protected]
[root@localhost ~]# cat .ssh/authorized_keys
[root@localhost ~]# exit
- 启动集群,在jobmanager上启动即可(注:使用sh启动会造成启动失败)
[root@localhost flink-1.8.0]# ./bin/start-cluster.sh
Starting cluster.
Starting standalonesession daemon on host localhost.localdomain.
Starting taskexecutor daemon on host localhost.localdomain.
Starting taskexecutor daemon on host localhost.localdomain.
[root@localhost flink-1.8.0]# jps
2082 Jps
2031 StandaloneSessionClusterEntrypoint
- 访问http://192.168.133.181:8081
参考资料:https://ci.apache.org/projects/flink/flink-docs-release-1.8/ops/deployment/cluster_setup.html