Target
large data development team, large data operations teams, data collection and ETL personnel, data governance and management personnel
Course Outline
The subject matter
Module 1: Nifi principles and architecture
Nifi overview of the features
Nifi principles and architecture
Nifi basic module describes
Nifi Groups, Processor, queue and connector module describes
Nifi toolbar interface demo
Module 2: Nifi Installation and Configuration
Nifi stand-alone installation
Nifi distributed installation
Nifi slaves node configuration
data loss tolerance and ensure the delivery of
low latency and high throughput
dynamic priority
flow can be modified at runtime
Module 3: GUI operation Introduction
Seamless experience design, control and monitoring
processor of create, stop, start, restart, delete and other operations
Module 4: Nifi comes Processors
Processor principles and functions of
Kafka Processor Introduction and practical
JMS Processor Introduction and practical
Hbase, Cassandera, redis Processor presentations and practical
Hdfs Processor, spark Streaming combat
JDBC Processor Introduction and practical
FTP, Http, XML, Json Processor Introduction and combat
Module 5: Creating a data stream Nifi
Create a Send / Receive directory
getFile and putFile Processor create
create copy files received from the transmitter into the
creation Queue Queue
Module 6: Creating Advanced Stream
Custom file name
to add custom properties
to add a regular expression
to achieve filtering rules Path
Module 7: Nifi Security
Create users, groups, roles,
SSL, SSH, HTTPS encryption and authentication
pluggable role-based authentication / authorization
based webUI authentication and authorization of SLA
Module 8: Creating Nifi processor
Achieve a Kafka, JMS to HDFS process design
View the Run Log
View monitor
Module 9: Nifi cluster configuration and management
Add Nifi cluster nodes
delete nodes
Nifi performance optimization
Slaves node load balancing configuration
to develop specific Processor to a specific node node
cluster dynamic load balancing configuration
Module 10: user-defined processor
eclipse project created
to achieve a FilterFileProcessor function
compile & Nifi added to the lib below
to create a user-defined FilterFile processor
Module 11: Nifi combat
Nifi combat use of the Internet
Nifi share in the actual case of a large commercial bank