KubeCon: Flink on K8s

目录

  • 集群概况
  • 玩转Flink on Kubernetes

    • WindowJoin
    • SQL

集群概况

BigData Manager简介

BigData on Kubernetes
image

部署过程

image

运维

image

Twinkle(开发者IDE)


玩转Flink on Kubernetes

WindowJoin

简介

Example illustrating a windowed stream join between two data streams.
The example works on two input streams with pairs (name, grade) and (name, salary) respectively. It joins the steams based on "name" within a configurable window. The example uses a built-in sample data generator that generates the steams of pairs at a configurable rate.

  • Source1:name, grade
  • Source2:name, salary
  • Result:name, grade, salary
    image

过程

创建Deployment

image
image

启动job

image
image

查看结果

image
image


SQL

简介

实时热门商品: 每隔5分钟输出最近一小时内点击量最多的前 N 个商品(例子详情,请移步http://wuchong.me/blog/2018/11/07/use-flink-calculate-hot-items/

列名称 说明
用户ID 整数类型,加密后的用户ID
商品ID 整数类型,加密后的商品ID
商品类目ID 整数类型,加密后的商品所属类目ID
行为类型 字符串,枚举类型,包括(‘pv’, ‘buy’, ‘cart’, ‘fav’)
时间戳 行为发生的时间戳,单位秒

image

过程

创建Deployment

image

Job信息

image

猜你喜欢

转载自yq.aliyun.com/articles/706033
k8s
今日推荐