1-4 安装logstash

下载地址:

  https://www.elastic.co/cn/downloads/logstash
  华为:https://mirrors.huaweicloud.com/

  下载最MovieLens最小测试数据集:https://grouplens.org/datasets/movielens/

新建配置文件logstash.conf:
#修改movielens目录下的logstash.conf文件
#path修改为,你实际的movies.csv路径
input {
file {
path => "/usr/local/logstash-7.5.1/testfile/ml-latest-small/movies.csv"
start_position => "beginning"
sincedb_path => "/dev/null" #表示每次重新加载文件数据
}
}

output {
elasticsearch {
hosts => [ "10.5.250.168:9200" ]
}
}

# Sample Logstash configuration for creating a simple
# Beats -> Logstash -> Elasticsearch pipeline.

#input {
#  beats {
#    port => 5044
#  }
#}
input {
    file {
        path => "/usr/local/logstash-7.5.1/testfile/ml-latest-small/movies.csv"
        start_position => "beginning"
        sincedb_path => "/dev/null"
    }
}

output {
    elasticsearch {
        hosts => [ "10.5.250.168:9200" ]
    }
}
#output {
#  elasticsearch {
#    hosts => ["http://localhost:9200"]
#    index => "%{[@metadata][beat]}-%{[@metadata][version]}-%{+YYYY.MM.dd}"
    #user => "elastic"
    #password => "changeme"
#  }
#}

启动:
  #启动Elasticsearch实例,然后启动 logstash,并制定配置文件导入数据
  bin/logstash -f /usr/local/logstash-7.5.1/config/logstash.conf

  图中表明启动成功

猜你喜欢

转载自www.cnblogs.com/litzhiai/p/12215171.html
1-4