Flink入门系列3----多机部署standalone集群

目标:搭建一个jobmanager、两个taskmanager的集群

  1. 克隆一个flink机器,作为jobmanager,修改配置(直接上传flink压缩包解压即可)
    修改masters文件
192.168.133.181::8081

修改slaves文件

192.168.133.182
192.168.133.183

修改flink-conf.yaml

jobmanager.rpc.address: 192.168.133.181
  1. 再克隆上述配置后的机器两台,修改ip分别为182和183即可
  2. 配置免密码登录,在jobmanager机器上如下操作
    生成密钥,一路回车即可
[root@localhost ~]# ssh-keygen

将源机器生成的公钥拷贝到目的机器的~/.ssh/authorized_keys,测试登录,查看密钥配置是否成功;两台taskmanager做相同配置

[root@localhost ~]# ssh-copy-id -i ~/.ssh/id_rsa.pub [email protected]
[root@localhost ~]# ssh [email protected]
[root@localhost ~]# cat .ssh/authorized_keys 
[root@localhost ~]# exit
  1. 启动集群,在jobmanager上启动即可(注:使用sh启动会造成启动失败)
[root@localhost flink-1.8.0]# ./bin/start-cluster.sh 
Starting cluster.
Starting standalonesession daemon on host localhost.localdomain.
Starting taskexecutor daemon on host localhost.localdomain.
Starting taskexecutor daemon on host localhost.localdomain.
[root@localhost flink-1.8.0]# jps
2082 Jps
2031 StandaloneSessionClusterEntrypoint
  1. 访问http://192.168.133.181:8081

参考资料:https://ci.apache.org/projects/flink/flink-docs-release-1.8/ops/deployment/cluster_setup.html

猜你喜欢

转载自blog.csdn.net/xichengqc/article/details/92219355