Back-end components after component sharing - open source ELT platform airbyte

Back-end components after component sharing - open source ELT platform airbyte

background

Recently, we are exploring various common components and tools on the front-end, back-end, and system side, and reorganize some of the common components to form a standardized component topic, which will later include some commonly used components in various languages. Welcome everyone to continue to pay attention.

Component Basic Information

• Component: airbyte
• Open source agreement: View license
• Official website: airbyte.com

content

In this section, we share airbyte, an open source ELT platform .

Airbyte's mission is to make data integration pipelines a commodity.

• A maintenance-free connector you can use in minutes. Just validate your sources and repositories and get the right connector for your schema and API changes.
• Building new connectors becomes trivial. By providing scheduling and orchestration, we make it very easy to add the new connectors you need in the language of your choice.
• Designed to cover the long tail and needs of connectors. Benefit from the community's proven connectors and adapt them to your specific needs.
• Your data stays in your cloud. Take full control of your data and the cost of data transfer.
• Since Airbyte is self-hosted, there is no need for security compliance processes.
• No more volume-based pricing like cloud-based solutions offer.

feature

• Built for Extensibility: Adapt existing connectors or easily build new ones to your needs.
• Optional normalization schema: fully customizable, starting with raw data or some suggestions for normalized data.
• Complete Scheduler: Automate your replication with the frequency you need.
• Real-time monitoring: We log all errors in detail to help you understand.
• Incremental Updates: Automatic replication is based on incremental updates to reduce your data transfer costs.
• Manual full refresh: Sometimes you need to resync all your data to start over.
• Debugging autonomy: Modify and debug pipelines as needed without waiting.

The specific usage is as follows:
1. docker installation

git clone https://github.com/airbytehq/airbyte.git
cd airbyte
docker-compose up

Now visit http://localhost:8000

For specific usage, please refer to the README

This article declares:

88x31.png

Creative Commons License
This work is licensed by CN Hua Shao under the Creative Commons Attribution-Noncommercial 4.0 International License.