liangbc-space / databus Public

Notifications You must be signed in to change notification settings
Fork 1
Star 16

通过canal服务监听mysql的binlog增量日志，实现数据异构并实时同步到elasticsearch

16 stars 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 39 Commits
conf		conf
logs		logs
models		models
mysql-elasticsearch		mysql-elasticsearch
system		system
utils		utils
.gitignore		.gitignore
README.md		README.md
go.mod		go.mod
go.sum		go.sum
main.go		main.go
个人配置.zip		个人配置.zip

Repository files navigation

mysql(binlog)监听同步数据到elasticsearch

服务依赖

注意：考虑效率问题，以下中间件最好安装在mysql和elasticsearch的同一个局域网内安装，否则可能会因为网路请求问题导致性能降低

安装java jdk 须大于1.8版本
安装zookeeper 版本无特殊要求，不要太低
安装kafka 版本无特殊要求，不要太低
安装canal服务端最新版1.4.4

    https://github.com/alibaba/canal/wiki/Canal-Kafka-RocketMQ-QuickStart

    https://github.com/alibaba/canal/wiki/aliyun-RDS-QuickStart

配置canal、kafka、zookeeper

About

通过canal服务监听mysql的binlog增量日志，实现数据异构并实时同步到elasticsearch

Report repository

Releases

No releases published

Packages

No packages published

Languages

Go 100.0%