StreamSets 下载安装教程

本教程以 StreamSet 3.4.0 为例

StreamSet有多种安装方式，最简单的一种就是下载压缩包，直接解压即可使用

1、下载StringSet压缩包

StringSet下载地址：https://streamsets.com/opensource/

执行以下语句

$ tar xvzf streamsets-datacollector-core-3.4.0.tgz

2、运行StreamSet

$ streamsets-datacollector-3.4.0/bin/streamset dc

本地浏览器打开：http://localhost:18630/ 默认端口为18630
登录，默认的用户名和密码均为admin

注：启动的时候可能会报open file limit 的问题，解决办法如下：

Mac系统：

$ sudo vim /Library/LaunchDaemons/limit.maxfiles.plist

然后添加如下内容，并重启即可

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
  <plist version="1.0">
    <dict>
      <key>Label</key>
        <string>limit.maxfiles</string>
      <key>ProgramArguments</key>
        <array>
          <string>launchctl</string>
          <string>limit</string>
          <string>maxfiles</string>
          <string>65536</string>
          <string>65536</string>
        </array>
      <key>RunAtLoad</key>
        <true/>
      <key>ServiceIPC</key>
        <false/>
    </dict>
  </plist>

Linux系统

（1）暂时性修改，只对当前终端有效

$ ulimit -HSn 65536

（2）将ulimit -HSn 65536 写到/etc/profile中，因为每次登录终端时，都会自动执行/etc/profile

（3）永久生效

修改配置文件：/etc/security/limits.conf ，在文件后添加如下内容，并重启

* soft nofile 65536
* hard nofile 65536

3、主界面介绍

登录界面

主界面

Number	Name	Description
1	Pipeline Creation Help Bar	Indicates that the origin is missing and offers a list of origins to choose from. If the Pipeline Creation Help Bar does not display, you might have disabled it. To enable it, in the top right corner of the Data Collector window, click the Help > Settings. Clear the Hide Pipeline Creation Help Bar option.
2	Issues icon	Click to display the list of pipeline issues found by implicit validation.
3	Stage library panel	Displays a list of available origins by default.
4	Stage menu	Changes the stages that display in the stage library. Displays all stages by default.
5	Properties panel / Preview panel / Monitor panel	When you configure a pipeline, the Properties panel displays the properties of the pipeline or selected stage. You can resize, minimize and maximize the panel. When you preview data, the Preview panel displays the input and output data for the selected stage or group of stages. When you monitor a running pipeline, the Monitor panel displays real-time metrics and statistics. Note: Some icons and options might not display in the UI. The items that display are based on the task that you are performing and roles assigned to your user account.
	Stage Library icon	Toggles the display of the Stage Library panel.

参考:：

1： https://streamsets.com/documentation/datacollector/latest/help/index.html#datacollector/UserGuide/Installation/Installing_the_DC.html#task_bt1_zcp_kq

2：https://streamsets.com/opensource/

StreamSets 下载安装教程

猜你喜欢