Problems and solutions encountered in the use of Streamsets

1, when adding an external jar package being given streamsets

Loading interface does not come out stageLibrary, background log error:

 java.net.UnknownHostException: archives.streamsets.com

Internet looking for similar problems, but did not give a solution: https://issues.streamsets.com/browse/SDC-10236?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aworklog-tabpanel

I am here careful investigation log and found the following information:

 INFO  ClassLoaderStageLibraryTask - Reading from Repository Manifest URL:
 http://archives.streamsets.com/datacollector/3.7.1/tarball/repository.manifest.json

Solution:

Copy the link into your browser is accessible, but for a long time to get out the results with the curl command on the host, ping the host name is also a response will be, but still ping through, and finally configure the host name and ip mapping solve problem.

2, StreamSets error log

2019-04-29 14:34:01,070 [user:*?] [pipeline:-] [runner:] [thread:runner-pool-2-thread-38] [stage:] ERROR SupportBundleManager - Support bundle upload failed:
com.amazonaws.SdkClientException: Unable to execute HTTP request: s3.us-west-2.amazonaws.com
        。。。
Caused by: java.net.UnknownHostException: s3.us-west-2.amazonaws.com
        at java.net.InetAddress.getAllByName0(InetAddress.java:1280)
。。。

NOTE: This error does not affect the process execution StreamSets

Solution:

Streamsets error is due to be deployed within the network can not access the host s3.us-west-2.amazonaws.com, you can modify the configuration

1, modify the configuration file
sdc.properties

Uncomment if you need to disable the facility for automatic support bundle upload.
bundle.upload.enabled=false

After configuration should be reported the following error, in fact, does not affect the normal operation of the task, you do not want to see it can be solved by 2 methods:

java.io.IOException: Uploading support bundles was disabled by administrator.

https://ask.streamsets.com/question/649/how-do-i-adjust-the-log-level-for-a-single-class-or-package-in-sdc/
2, modify the log configuration file or change in the interface: configuration / Logs / Config the Log
sdc-log4j.properties

log4j.logger.com.streamsets.datacollector.bundles.SupportBundleManager=INFO

3, StreamSets push Directory directory data given to Kafka

Solution:

Directory modify components Buffer Limit, the default is 128M, modify the size determined by the extent of the file size.

4, after finished streamsets, do not support the Chinese name of the component

Solution:

From the previous regular [0-9A-Za-z _ \\ s] + modify ^ [\ u4e00- \ u9fa5_a-zA-Z0-9] + $, this regular support Chinese, numbers, underscores, letters

Support spaces, -, _ regular correct wording is: ^ [\ u4e00- \ u9fa5_a-zA-Z0-9 \\ s -_] + $

Note that when you modify the referenced project api version JAR problem with streamsets-datacollector-api's