Email of the author of the article: [email protected] Address: Huizhou, Guangdong
▲ This chapter’s program
⚪ Flume to master website traffic projects—>Kafka connectivity;
⚪ Master the real-time business system construction of website traffic projects;
1. Flume—>Kafka connectivity
1. Implementation steps
1. Start three servers.
2. Start the Zookeeper cluster.
Execution instructions:
sh /home/software/zookeeper-3.4.8/bin/zkServer.sh start
3. Start the Kafka cluster.
4. Create a Kafka topic.
Execution instructions:
sh kafka-topics.sh --create --zookeeper hadoop01:2181
--replication-factor 1 --partitions 1 --topic fluxdata
5. Start Hadoop.
6. Configure flume and start it.
In the data directory of flume, execute the following command:
../bin/flume-agent -n a1 -c ./ -f ./weblog.conf
-Dflume.root.logger = INFO, console
An example of the weblog.conf configuration file is as follows:
a1.sources = r1