Skip to content
This repository has been archived by the owner on Feb 21, 2024. It is now read-only.

Commit

Permalink
Add notes: Kafka: The definitive guide
Browse files Browse the repository at this point in the history
- Chapter 9: Building Data Pipelines
  • Loading branch information
lealceldeiro committed Jan 3, 2024
1 parent ae6d5b5 commit ed584a2
Showing 1 changed file with 15 additions and 0 deletions.
15 changes: 15 additions & 0 deletions KafkaTheDefinitiveGuide/Chapter9/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
# CHAPTER 9: Building Data Pipelines

The main value Kafka provides to data pipelines is its ability to serve as a very large, reliable buffer between various
stages in the pipeline.

## Run Kafka Connect

`bin/connect-distributed.sh config/connect-distributed.properties`

The [Debezium Project](https://debezium.io/) provides a collection of high-quality, open source, change capture
connectors for a variety of databases.

Kafka can be looked at as a platform that can handle data integration (with Connect), application integration (with
producers and consumers), and stream processing. Kafka could be a viable replacement for an ETL tool that only
integrates data stores.

0 comments on commit ed584a2

Please sign in to comment.