摘要: 环境:kafka:kafka_2.13-3.1.0jdk:1.8部署方式:3个节点组成的kafka集群 1.下载介质包 wget https://maven.aliyun.com/repository/public/io/debezium/debezium-connector-mysql/1.9.7 阅读全文
posted @ 2026-09-28 15:41 slnngk 阅读(3) 评论(0) 推荐(0)
摘要: 环境:OS:ubuntu 26.04mysql:8.0.45 1.mysql介质下载cd /softwget https://downloads.mysql.com/archives/get/p/23/file/mysql-8.0.45-linux-glibc2.17-x86_64.tar.xz 2 阅读全文
posted @ 2026-09-23 10:31 slnngk 阅读(5) 评论(0) 推荐(0)
摘要: 环境:OS:Centos 7oracle:19.3.0.0mysql:5.7 说明:a.只能同步dml,ddl无法同步 1.下载相应的jar包cd /opt/flink-1.20.5/lib #JDBC sink 3.3.0-1.20wget https://maven.aliyun.com/rep 阅读全文
posted @ 2026-09-22 17:59 slnngk 阅读(6) 评论(0) 推荐(0)
摘要: 环境:os:ubuntu 26kafka-ui:v1.5.0 1.镜像下载地址docker pull ghcr.io/kafbat/kafka-ui:v1.5.0 ##放到自己的私人镜像下docker tag 7cda86a33344 registry.cn-shenzhen.aliyuncs.co 阅读全文
posted @ 2026-09-21 16:43 slnngk 阅读(6) 评论(0) 推荐(0)
摘要: 环境:OS:Centos 7kafka:2.13-3.1.0kafka-console-ui:1.1.1 1.介质下载cd /softwget https://github.com/xxd763795151/kafka-console-ui/releases/download/v1.1.1/kafk 阅读全文
posted @ 2026-09-21 15:36 slnngk 阅读(5) 评论(0) 推荐(0)
摘要: 环境:OS:ubuntu 26flink cdc:flink-cdc-3.6.0-1.20flink:flink-1.20.5目的:同步mysql下的库db_admin下所有的表到kafka说明:a.mysql源端的表都必须有主键b.必须启动flink,flink cdc的版本需要与flink版本保 阅读全文
posted @ 2026-09-21 11:23 slnngk 阅读(11) 评论(0) 推荐(0)
摘要: 1.官网文档地址 https://nightlies.apache.org/flink/flink-cdc-docs-release-3.6/zh/ 阅读全文
posted @ 2026-09-20 11:14 slnngk 阅读(6) 评论(0) 推荐(0)
摘要: 环境:OS:ubuntu 26flink:1.20.5 1.查看java环境root@dify:/opt/maxwell-1.40.2# java -versionopenjdk version "11.0.32" 2026-07-21OpenJDK Runtime Environment (bui 阅读全文
posted @ 2026-09-18 18:01 slnngk 阅读(8) 评论(0) 推荐(0)
摘要: 环境:mysql:8.0dinky:1.2.5-flink1.20 1.准备安装目录mkdir -p /home/middle/dinky 2.配置文件 vi /home/middle/dinky/docker-compose.yml services: dinky-mysql: image: re 阅读全文
posted @ 2026-09-18 14:03 slnngk 阅读(17) 评论(0) 推荐(0)
摘要: 1.查看都有那些job root@dify:/tmp# /opt/flink/bin/flink list Waiting for response... Running/Restarting Jobs 17.09.2026 17:03:07 : a2689159036cf56ccb8d07f81b 阅读全文
posted @ 2026-09-17 17:32 slnngk 阅读(9) 评论(0) 推荐(0)
摘要: 环境:OS:ubuntu 26mongodb:5.0.28flink:1.20说明:MongoDB必须是副本集模式 1.下载安装包root@dify:/opt/flink/lib# cd /opt/flink/libwget https://repo1.maven.org/maven2/org/ap 阅读全文
posted @ 2026-09-17 16:24 slnngk 阅读(8) 评论(0) 推荐(0)
摘要: 环境:OS:uubuntu 26flink:1.20mysql:5.7 1.准备flink-sql文件vi /opt/flink/flinksql/mysql2mysql.sql root@dify:/opt/flink/flinksql# more mysql2mysql.sql -- 开启Che 阅读全文
posted @ 2026-09-17 10:46 slnngk 阅读(7) 评论(0) 推荐(0)
摘要: 环境:OS:ubuntu 26flink:1.20原理是读取mysql binlog同步,flink只能同步dml语句 不能同步ddl语句 1.下载依赖包cd /opt/flink/libwget https://repo1.maven.org/maven2/org/apache/flink/fli 阅读全文
posted @ 2026-09-16 17:41 slnngk 阅读(9) 评论(0) 推荐(0)
摘要: 环境:OS:Centos 7flink:1.20同步说明:使用maxwell同步msql数据到kafka,然后再使用flink消费kafka的数据到另外一个mysql实例 1. 下载jar包cd /opt/flink/lib# Kafka SQL连接器wget https://maven.aliyu 阅读全文
posted @ 2026-09-16 15:39 slnngk 阅读(9) 评论(0) 推荐(0)
摘要: 环境:OS:ubuntu 26flink:1.20.0jdk:11部署模式:单机 1.查看java环境root@dify:/opt/maxwell-1.40.2# java -versionopenjdk version "11.0.32" 2026-07-21OpenJDK Runtime Env 阅读全文
posted @ 2026-09-16 15:00 slnngk 阅读(9) 评论(0) 推荐(0)
摘要: 环境: OS:Centos 7 my2sql:v2 说明:使用my2sql必须连接到解析binlog所在的实例 1.下载# raw 原始文件下载cd /softwget https://raw.githubusercontent.com/liuhr/my2sql/master/releases/ce 阅读全文
posted @ 2026-09-16 09:36 slnngk 阅读(7) 评论(0) 推荐(0)
摘要: 环境:Os:Centos 7maxwell:v1.40.2jdk:21mysql:5.7 说明:v1.29.2之后的版本需要jdk11以上 1.下载安装介质[root@host113 /]# cd /soft[root@host113 soft]#wget https://github.com/ze 阅读全文
posted @ 2026-09-14 10:15 slnngk 阅读(11) 评论(0) 推荐(0)
摘要: 环境:OS:Centos 7LightRAG:v1.5.4部署方式:docker compose 1.下载介质下载地址如下:https://github.com/HKUDS/LightRAG/tree/v1.5.4 2.解压安装root@dify:/soft# cd /softroot@dify:/ 阅读全文
posted @ 2026-09-09 15:54 slnngk 阅读(17) 评论(0) 推荐(0)
摘要: 环境:OS:Centos 7neo4j:5.26.30 1.创建外挂目录 mkdir -p /data/middle/neo4j/datamkdir -p /data/middle/neo4j/logsmkdir -p /data/middle/neo4j/confmkdir -p /data/mi 阅读全文
posted @ 2026-09-08 09:08 slnngk 阅读(14) 评论(0) 推荐(0)
摘要: 环境:OS:Centos 7mongodb:8.0.28 1.创建部署目录mkdir -p /opt/mongodbmkdir -p /opt/mongodb/datamkdir -p /opt/mongodb/configmkdir -p /opt/mongodb/log 修改外挂的日志文件目录权 阅读全文
posted @ 2026-09-07 14:27 slnngk 阅读(14) 评论(0) 推荐(0)
摘要: 1.查看当前的版本[root@localhost soft]# rpm -qa|grep clickhouseclickhouse-common-static-24.8.11.5-1.x86_64clickhouse-client-24.8.11.5-1.x86_64clickhouse-backu 阅读全文
posted @ 2026-09-07 09:40 slnngk 阅读(12) 评论(0) 推荐(0)
摘要: wget https://packages.clickhouse.com/deb/pool/main/c/clickhouse/clickhouse-client_25.12.11.4_amd64.debwget https://packages.clickhouse.com/deb/pool/ma 阅读全文
posted @ 2026-09-04 13:50 slnngk 阅读(10) 评论(0) 推荐(0)
摘要: 说明: a.旧集群是kafka:2.13-3.1.0的版本,新集群是kafka:2.13-3.9.2的版本,两个集群都是zk模式 b.新集群:192.168.1.14:9092,192.168.1.113:9092,192.168.1.231:9092 旧集群:192.168.1.134:9092, 阅读全文
posted @ 2026-09-03 15:52 slnngk 阅读(4) 评论(0) 推荐(0)
摘要: 环境:Os:Centos 7kafka:2.13-3.9.2IP 服务192.168.1.14 zookeeper+kafka-broker192.168.1.113 zookeeper+kafka-broker192.168.1.231 zookeeper+kafka-broker 介质下载地址h 阅读全文
posted @ 2026-09-03 15:48 slnngk 阅读(17) 评论(0) 推荐(0)
摘要: 环境:Os:Centos 7kafka:2.13-3.1.0IP 服务 192.168.1.134 zookeeper+kafka-broker192.168.1.135 zookeeper+kafka-broker192.168.1.136 zookeeper+kafka-broker 介质下载地 阅读全文
posted @ 2026-09-01 11:38 slnngk 阅读(15) 评论(0) 推荐(0)