Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

如何配置从mysql 到kudu的同步 #12

Open
crazycarry opened this issue Jan 17, 2019 · 1 comment
Open

如何配置从mysql 到kudu的同步 #12

crazycarry opened this issue Jan 17, 2019 · 1 comment
Labels
question Further information is requested

Comments

@crazycarry
Copy link

如何配置从mysql 到kudu的同步,看到文档中提及

@zhangkewei
Copy link
Collaborator

zhangkewei commented Jan 17, 2019

如何配置从Mysql到kudu的同步

以下配置文件格式适用配置管理后台"同步管理->高级任务配置(原菜单名:本地任务)->新增"
如果是本地任务配置文件需要增加前缀"porter.task[任务下标,从0开始]"

taskId=任务ID
nodeId=节点ID
consumer.consumerName=CanalFetch
consumer.converter=canalRow
consumer.source.sourceType=CANAL
consumer.includes=数据库名.表名,数据库名.表名
consumer.source.filter=过滤表名正则
consumer.source.database=数据库名字
consumer.source.password=密码
consumer.source.address=ip:3306
consumer.source.username=用户名

loader.loaderName=KUDU_NATIVE
loader.source.sourceType=KUDU
loader.source.servers=kudu地址,支持以逗号分隔的集群地址
loader.source. workerCount=工作线程数,默认10

mapper[0].schema=源端schema,目标端数据库schema(mysql就是数据库名)
mapper[0].table=源表名,目标端表名
mapper[0].column.源表字段名=目标端表字段名

mapper[0].forceMatched=false

具体参考KuduConfig.java和KUDUClient.java

@zhangkewei zhangkewei added the question Further information is requested label Jan 17, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants