1, when adding an external jar package being given streamsets
Loading interface does not come out stageLibrary, background log error:
java.net.UnknownHostException: archives.streamsets.com
Internet looking for similar problems, but did not give a solution: https://issues.streamsets.com/browse/SDC-10236?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aworklog-tabpanel
I am here careful investigation log and found the following information:
INFO ClassLoaderStageLibraryTask - Reading from Repository Manifest URL:
http://archives.streamsets.com/datacollector/3.7.1/tarball/repository.manifest.json
Solution:
Copy the link into your browser is accessible, but for a long time to get out the results with the curl command on the host, ping the host name is also a response will be, but still ping through, and finally configure the host name and ip mapping solve problem.
2, StreamSets error log
2019-04-29 14:34:01,070 [user:*?] [pipeline:-] [runner:] [thread:runner-pool-2-thread-38] [stage:] ERROR SupportBundleManager - Support bundle upload failed:
com.amazonaws.SdkClientException: Unable to execute HTTP request: s3.us-west-2.amazonaws.com
。。。
Caused by: java.net.UnknownHostException: s3.us-west-2.amazonaws.com
at java.net.InetAddress.getAllByName0(InetAddress.java:1280)
。。。
NOTE: This error does not affect the process execution StreamSets
Solution:
Streamsets error is due to be deployed within the network can not access the host s3.us-west-2.amazonaws.com, you can modify the configuration
1, modify the configuration file
sdc.properties
Uncomment if you need to disable the facility for automatic support bundle upload.
bundle.upload.enabled=false
After configuration should be reported the following error, in fact, does not affect the normal operation of the task, you do not want to see it can be solved by 2 methods:
java.io.IOException: Uploading support bundles was disabled by administrator.
https://ask.streamsets.com/question/649/how-do-i-adjust-the-log-level-for-a-single-class-or-package-in-sdc/
2, modify the log configuration file or change in the interface: configuration / Logs / Config the Log
sdc-log4j.properties
log4j.logger.com.streamsets.datacollector.bundles.SupportBundleManager=INFO
3, StreamSets push Directory directory data given to Kafka
Solution:
Directory modify components Buffer Limit, the default is 128M, modify the size determined by the extent of the file size.
4, after finished streamsets, do not support the Chinese name of the component
Solution:
From the previous regular [0-9A-Za-z _ \\ s] + modify ^ [\ u4e00- \ u9fa5_a-zA-Z0-9] + $, this regular support Chinese, numbers, underscores, letters
Support spaces, -, _ regular correct wording is: ^ [\ u4e00- \ u9fa5_a-zA-Z0-9 \\ s -_] + $
Note that when you modify the referenced project api version JAR problem with streamsets-datacollector-api's