This repo contains examples of airbyte components that can be used for data transformation and custom connectors.
Extract/load/transform (ELT) is the process of extracting data from one or multiple sources and loading it into a target data warehouse. Instead of transforming the data before it’s written, ELT takes advantage of the target system to do the data transformation
Airbyte is an open-source data integration platform that syncs data from applications, APIs & databases to data warehouses, lakes, and other destinations.
Data Engineering - Build custom connectors in hours and get them maintained through Airbyte
Data Analytics - Centralize all your data with Airbyte's long tail of pre-built connectors
Data Science - Consolidated all your data sources in your data lake for your algorithms
Engineering - Leverage Airbyte's API and CLI to build your data systems or products
Airbyte can be deployed with docker
AWS EC2 - Setup Airbyte with EC2 instance
DBT - Leverage Data Build Tool to customize data transformations
Custom Connector - Write your custom connector with Airbyte CDK