Spark Streaming(2)Old Notes
1. Data Flow
Input Data Stream ——> Spark Streaming ——> batches of input data ——>Spark Engine ——>Batches of Processed Data
Tip:
Last spark can be build by this command
> build/mvn -DskipTests clean package
References:
http://sillycat.iteye.com/blog/2215237
http://uohzoaix.github.io/studies/categories/#spark
spark streaming
http://dataunion.org/15193.html
http://dataunion.org/6308.html
http://colobu.com/2015/01/05/kafka-spark-streaming-integration-summary/
https://spark.apache.org/docs/latest/streaming-programming-guide.html
http://colobu.com/2015/01/05/kafka-spark-streaming-integration-summary/
Spark Streaming(2)Old Notes
猜你喜欢
转载自sillycat.iteye.com/blog/2406572
今日推荐
周排行