canal 配置 多个监听 推送到不同mq
canal整合rabbitmq 见上篇
如果想监听不同库 不同表到不同队列如何操作
1. vim canal.properties
canal.destinations = route1,route2
设置目的地为多个 对应的目录是conf下的对应名字的目录
2 复制example 为新的
cp -r example route1
cp -r example route2
chmod -R 777 route1
chmod -R 777 route2
rm -rf example/
3 cd route1 设置监听表为test库的uesr表
vim instance.properties
canal.instance.filter.regex=test.user
canal.mq.topic=route1
4 cd route2
vim instance.properties
canal.instance.filter.regex=test.tests
canal.mq.topic=route2
表过滤规则 规定要监听那些库 那些表
canal.instance.filter.regex
mysql 数据解析关注的表，Perl正则表达式.多个正则之间以逗号(,)分隔，转义符需要双斜杠(\\)
常见例子：
1. 所有表：.* or .*\\..*
2. canal schema下所有表： canal\\..*
3. canal下的以canal打头的表：canal\\.canal.*
4. canal schema下的一张表：canal.test1
5. 多个规则组合使用：canal\\..*,mysql.test1,mysql.test2 (逗号分隔)
注意：此过滤条件只针对row模式的数据有效(ps. mixed/statement因为不解析sql，所以无法准确提取tableName进行过滤)
5 手动建立队列 绑定 到交换机,用定义的route1 和route2
分别更改两个表数据
结果两个队列都分别收到数据
{"data":[{"id":"1","name":"3234234","age":"10","sex":"1","created_at":"2010-09-09 11:11:11","updated_at":"2020-08-15 00:56:53"}],"database":"test","es":1597424213000,"id":2,"isDdl":false,"mysqlType":{"id":"int(11)","name":"varchar(255)","age":"int(11)","sex":"int(255)","created_at":"timestamp","updated_at":"timestamp"},"old":[{"name":"sdsf","updated_at":"2020-08-15 00:39:33"}],"pkNames":["id"],"sql":"","sqlType":{"id":4,"name":12,"age":4,"sex":4,"created_at":93,"updated_at":93},"table":"user","ts":1597424213307,"type":"UPDATE"}
|
{"data":[{"id":"2","name":"sdsdf","age":"10","sex":"1","created_at":"2010-09-09 11:11:11","updated_at":"2020-08-15 00:57:29"}],"database":"test","es":1597424249000,"id":3,"isDdl":false,"mysqlType":{"id":"int(11)","name":"varchar(255)","age":"int(11)","sex":"int(255)","created_at":"timestamp","updated_at":"timestamp"},"old":[{"name":"wersdf","updated_at":"2020-07-25 09:27:35"}],"pkNames":["id"],"sql":"","sqlType":{"id":4,"name":12,"age":4,"sex":4,"created_at":93,"updated_at":93},"table":"tests","ts":1597424249772,"type":"UPDATE"}
|
参考 https://blog.csdn.net/hyx1990/article/details/52524115
