安装下载与用例测试，请参考：https://www.cnblogs.com/xibuhaohao/articles/19068912
1. 配置作业文件（核心核心）
2. 配置前准备：连接器与数据库驱动
2.1 连接器查看
确保 connectors/ 目录下存在 connector-jdbc
[root@zb-yunweitest-mysql-204-201 config]# cd ../connectors/ [root@zb-yunweitest-mysql-204-201 connectors]# pwd /data/dba/seatunnel/apache-seatunnel-2.3.8/connectors [root@zb-yunweitest-mysql-204-201 connectors]# ll total 230M drwxr-xr-x 2 root root 4.0K Sep 1 20:33 . drwxr-xr-x 10 root root 192 Nov 9 2023 .. -rw-r--r-- 1 root root 30M Sep 1 20:31 connector-cdc-mongodb-2.3.8.jar -rw-r--r-- 1 root root 31M Sep 1 20:28 connector-cdc-mysql-2.3.8.jar -rw-r--r-- 1 root root 48M Sep 1 20:32 connector-cdc-oracle-2.3.8.jar -rw-r--r-- 1 root root 29M Sep 1 20:31 connector-cdc-postgres-2.3.8.jar -rw-r--r-- 1 root root 30M Sep 1 20:32 connector-clickhouse-2.3.8.jar -rw-r--r-- 1 root root 192K Nov 9 2023 connector-console-2.3.8.jar -rw-r--r-- 1 root root 12M Sep 1 20:33 connector-doris-2.3.8.jar -rw-r--r-- 1 root root 5.4M Sep 1 20:32 connector-elasticsearch-2.3.8.jar -rw-r--r-- 1 root root 328K Nov 9 2023 connector-fake-2.3.8.jar -rw-r--r-- 1 root root 1002K Sep 1 20:28 connector-jdbc-2.3.8.jar -rw-r--r-- 1 root root 32M Sep 1 20:33 connector-kafka-2.3.8.jar -rw-r--r-- 1 root root 2.5M Sep 1 20:33 connector-mongodb-2.3.8.jar -rw-r--r-- 1 root root 7.0K Nov 9 2023 plugin-mapping.properties -rw-r--r-- 1 root root 12M Nov 9 2023 seatunnel-transforms-v2-2.3.8.jar [root@zb-yunweitest-mysql-204-201 connectors]#
2.2 放置 MySQL JDBC 数据库驱动
注意：seatunnel-2.3.8 依赖的MySQL驱动为 8.0及以上：mysql-connector-java-8.0.30.jar
2.2.1 下载 MySQL JDBC 驱动 8.0.30
https://mvnrepository.com/artifact/mysql/mysql-connector-java
3 配置 MySQL→MySQL作业文件
说明：满足 Exactly-Once + 自动生成 SQL
[root@zb-yunweitest-mysql-204-201 job]# pwd /data/dba/seatunnel/apache-seatunnel-2.3.8/job [root@zb-yunweitest-mysql-204-201 job]# cat mysql-to-mysql-jdbc.conf env { parallelism = 2 # 任务并行度，与 source 保持一致，可根据数据量调整（如 4/8） job.mode = "BATCH" # 批处理模式（与 source 数据读取模式匹配） } source { Jdbc { url = "jdbc:mysql://172.21.204.200:3306/db50000000?serverTimezone=Asia/Shanghai" # 补充时区参数（避免 MySQL 8.0+ 报错） driver = "com.mysql.cj.jdbc.Driver" connection_check_timeout_sec = 100 user = "root" password = "HkZiWdDba159+-*%" # 注意：source 中 query 和 table_path 二选一（query 优先级更高，保留 query 即可） query = "select * from db50000000.ods_goods_goods_sku_rt" # table_path = "db50000000.ods_goods_goods_sku_rt" # 注释：避免与 query 冲突 } } transform { # 若源表与目标表字段名/类型完全一致，无需额外 transform；若有差异，可添加字段映射（示例如下） # 示例：若源表字段 "sku_code" 需映射到目标表 "sku_id"，添加以下配置： # Sql { # sql = "select *, sku_code as sku_id from source" # source 为默认输入表名 # } } sink { Jdbc { # 1. 基础连接参数（必填） url = "jdbc:mysql://172.21.204.201:3306/db_all?serverTimezone=Asia/Shanghai&rewriteBatchedStatements=true" # - serverTimezone：MySQL 8.0+ 强制要求，需与源库时区一致（如 Asia/Beijing） # - rewriteBatchedStatements：开启 MySQL 批量写入优化（提升 5-10 倍效率） driver = "com.mysql.cj.jdbc.Driver" # 与 source 驱动一致，适配 MySQL 8.0+ user = "root" password = "HkZiWdDba159+-*%" # 与源库 credentials 一致（若目标库密码不同需修改） # 2. 自动生成 SQL 配置（核心：无需手写 INSERT 语句） generate_sink_sql = true # 开启自动生成 SQL（必选，满足需求） database = "db_all" # 目标数据库名（必选，与 url 中 db 一致） table = "ods_goods_goods_sku_rt" # 目标表名（必选，与需求一致） schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST" # 目标表不存在时自动创建（可选，适合初始化） # 3. Exactly-Once 语义配置（核心：保证数据不重复、不丢失） is_exactly_once = true # 开启 Exactly-Once（必选） xa_data_source_class_name = "com.mysql.cj.jdbc.MysqlXADataSource" # MySQL 专属 XA 数据源（必选，实现事务） transaction_timeout_sec = 60 # 事务超时时间（可选，默认 -1 永不超时，建议设 60-300s） # 4. 数据一致性与效率优化参数（可选但重要） primary_keys = ["id"] # 目标表主键（必选！Exactly-Once/UPDATE 依赖主键匹配，需替换为实际主键） # 若主键为复合主键，格式：primary_keys = ["sku_id", "store_id"] batch_size = 5000 # 批量写入阈值（默认 1000，调大提升效率，需根据内存调整） max_retries = 3 # 写入失败重试次数（默认 0，建议设 3 次，处理网络波动） retry_interval = 1000 # 重试间隔（单位：毫秒，默认 1000，避免频繁重试压垮数据库） # 5. 字段适配参数（可选，根据字段差异配置） field_ide = "ORIGINAL" # 字段名大小写处理（ORIGINAL/LOWERCASE/UPPERCASE，默认 ORIGINAL，需与目标表一致） # column_map = { "source_sku_code": "target_sku_id" } # 字段名映射（若源表与目标表字段名不同，无需 transform 时可用） } }
4 运行作业
注意：运行模式是 Zeta 还是 Spark/Flink
[root@zb-yunweitest-mysql-204-201 apache-seatunnel-2.3.8]# ./bin/seatunnel.sh --config ./job/mysql-to-mysql-jdbc.conf -e local 2025-09-02 10:52:33,678 WARN [ommandArgs$MasterTypeValidator] [main] - ****************************************************************************************** -e and --deploy-mode deprecated in 2.3.1, please use -m and --master instead of it ****************************************************************************************** 2025-09-02 10:52:33,715 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Loading configuration '/data/dba/seatunnel/apache-seatunnel-2.3.8/config/seatunnel.yaml' from System property 'seatunnel.config' 2025-09-02 10:52:33,715 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Using configuration file at /data/dba/seatunnel/apache-seatunnel-2.3.8/config/seatunnel.yaml 2025-09-02 10:52:33,718 INFO [o.a.s.e.c.c.SeaTunnelConfig ] [main] - seatunnel.home is /data/dba/seatunnel/apache-seatunnel-2.3.8 2025-09-02 10:52:33,831 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Loading configuration '/data/dba/seatunnel/apache-seatunnel-2.3.8/config/hazelcast.yaml' from System property 'hazelcast.config' 2025-09-02 10:52:33,831 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Using configuration file at /data/dba/seatunnel/apache-seatunnel-2.3.8/config/hazelcast.yaml 2025-09-02 10:52:34,208 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Loading configuration '/data/dba/seatunnel/apache-seatunnel-2.3.8/config/hazelcast-client.yaml' from System property 'hazelcast.client.config' 2025-09-02 10:52:34,208 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Using configuration file at /data/dba/seatunnel/apache-seatunnel-2.3.8/config/hazelcast-client.yaml 2025-09-02 10:52:34,268 WARN [c.h.i.AddressPicker ] [main] - [LOCAL] [seatunnel-636710] [5.1] You configured your member address as host name. Please be aware of that your dns can be spoofed. Make sure that your dns configurations are correct. 2025-09-02 10:52:34,268 INFO [c.h.i.AddressPicker ] [main] - [LOCAL] [seatunnel-636710] [5.1] Resolving domain name 'localhost' to address(es): [127.0.0.1] 2025-09-02 10:52:34,269 INFO [c.h.i.AddressPicker ] [main] - [LOCAL] [seatunnel-636710] [5.1] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [localhost/127.0.0.1] 2025-09-02 10:52:34,295 INFO [o.a.s.e.s.SeaTunnelServer ] [main] - SeaTunnel server start... 2025-09-02 10:52:34,297 INFO [c.h.system ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Based on Hazelcast IMDG version: 5.1.0 (20220228 - 21f20e7) 2025-09-02 10:52:34,297 INFO [c.h.system ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Cluster name: seatunnel-636710 2025-09-02 10:52:34,298 INFO [c.h.system ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] _____ _____ _ / ___| |_ _| | | \ `--. ___ __ _ | | _ _ _ __ _ __ ___ | | `--. \ / _ \ / _` | | | | | | || '_ \ | '_ \ / _ \| | /\__/ /| __/| (_| | | | | |_| || | | || | | || __/| | \____/ \___| \__,_| \_/ \__,_||_| |_||_| |_| \___||_| 2025-09-02 10:52:34,298 INFO [c.h.system ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Copyright © 2021-2022 The Apache Software Foundation. Apache SeaTunnel, SeaTunnel, and its feather logo are trademarks of The Apache Software Foundation. 2025-09-02 10:52:34,298 INFO [c.h.system ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Integrity Checker is disabled. Fail-fast on corrupted executables will not be performed. To enable integrity checker do one of the following: - Change member config using Java API: config.setIntegrityCheckerEnabled(true); - Change XML/YAML configuration property: Set hazelcast.integrity-checker.enabled to true - Add system property: -Dhz.integritychecker.enabled=true (for Hazelcast embedded, works only when loading config via Config.load) - Add environment variable: HZ_INTEGRITYCHECKER_ENABLED=true (recommended when running container image. For Hazelcast embedded, works only when loading config via Config.load) 2025-09-02 10:52:34,300 INFO [c.h.system ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] The Jet engine is disabled. To enable the Jet engine on the members, do one of the following: - Change member config using Java API: config.getJetConfig().setEnabled(true) - Change XML/YAML configuration property: Set hazelcast.jet.enabled to true - Add system property: -Dhz.jet.enabled=true (for Hazelcast embedded, works only when loading config via Config.load) - Add environment variable: HZ_JET_ENABLED=true (recommended when running container image. For Hazelcast embedded, works only when loading config via Config.load) 2025-09-02 10:52:34,805 INFO [c.h.s.security ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Enable DEBUG/FINE log level for log category com.hazelcast.system.security or use -Dhazelcast.security.recommendations system property to see 🔒 security recommendations and the status of current config. 2025-09-02 10:52:34,883 INFO [o.a.s.e.s.SeaTunnelNodeContext] [main] - Using LiteNodeDropOutTcpIpJoiner TCP/IP discovery 2025-09-02 10:52:34,885 WARN [c.h.c.CPSubsystem ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] CP Subsystem is not enabled. CP data structures will operate in UNSAFE mode! Please note that UNSAFE mode will not provide strong consistency guarantees. 2025-09-02 10:52:35,081 INFO [.c.c.DefaultClassLoaderService] [main] - start classloader service 2025-09-02 10:52:35,088 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Loading configuration '/data/dba/seatunnel/apache-seatunnel-2.3.8/config/seatunnel.yaml' from System property 'seatunnel.config' 2025-09-02 10:52:35,088 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Using configuration file at /data/dba/seatunnel/apache-seatunnel-2.3.8/config/seatunnel.yaml 2025-09-02 10:52:35,092 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Loading configuration '/data/dba/seatunnel/apache-seatunnel-2.3.8/config/hazelcast.yaml' from System property 'hazelcast.config' 2025-09-02 10:52:35,093 INFO [c.h.i.c.AbstractConfigLocator ] [main] - Using configuration file at /data/dba/seatunnel/apache-seatunnel-2.3.8/config/hazelcast.yaml 2025-09-02 10:52:35,105 WARN [o.a.s.e.s.TaskExecutionService] [pool-3-thread-1] - [localhost]:5801 [seatunnel-636710] [5.1] The Node is not ready yet, Node state STARTING,looking forward to the next scheduling 2025-09-02 10:52:35,105 INFO [o.a.s.e.s.TaskExecutionService] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Created new BusWork : 1170173753 2025-09-02 10:52:35,117 WARN [a.s.e.s.s.s.DefaultSlotService] [hz.main.seaTunnel.slotService.thread] - failed send heartbeat to resource manager, will retry later. this address: [localhost]:5801 2025-09-02 10:52:35,121 INFO [o.a.s.e.s.CoordinatorService ] [pool-6-thread-1] - [localhost]:5801 [seatunnel-636710] [5.1] *********************************************** CoordinatorService Thread Pool Status *********************************************** activeCount : 0 corePoolSize : 0 maximumPoolSize : 2147483647 poolSize : 0 completedTaskCount : 0 taskCount : 0 *********************************************** 2025-09-02 10:52:35,161 INFO [c.h.i.d.Diagnostics ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments. 2025-09-02 10:52:35,170 INFO [c.h.c.LifecycleService ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5801 is STARTING 2025-09-02 10:52:35,214 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-11] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5810 is added to the blacklist. 2025-09-02 10:52:35,214 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-12] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5808 is added to the blacklist. 2025-09-02 10:52:35,214 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-6] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5813 is added to the blacklist. 2025-09-02 10:52:35,214 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-13] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5829 is added to the blacklist. 2025-09-02 10:52:35,214 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-1] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5827 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-4] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5825 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-11] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5826 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-13] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5824 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-1] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5814 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-4] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5812 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-6] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5818 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-11] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5816 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-13] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5807 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-4] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5805 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-6] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5811 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-1] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5809 is added to the blacklist. 2025-09-02 10:52:35,214 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-8] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5817 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-5] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5815 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-11] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5830 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-13] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5828 is added to the blacklist. 2025-09-02 10:52:35,215 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-3] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5823 is added to the blacklist. 2025-09-02 10:52:35,216 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-4] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5803 is added to the blacklist. 2025-09-02 10:52:35,216 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-9] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5806 is added to the blacklist. 2025-09-02 10:52:35,216 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-2] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5821 is added to the blacklist. 2025-09-02 10:52:35,216 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-15] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5822 is added to the blacklist. 2025-09-02 10:52:35,216 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-16] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5820 is added to the blacklist. 2025-09-02 10:52:35,216 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-10] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5804 is added to the blacklist. 2025-09-02 10:52:35,216 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-14] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5802 is added to the blacklist. 2025-09-02 10:52:35,216 INFO [e.s.LiteNodeDropOutTcpIpJoiner] [hz.main.cached.thread-7] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5819 is added to the blacklist. 2025-09-02 10:52:36,209 INFO [c.h.i.c.ClusterService ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Members {size:1, ver:1} [ Member [localhost]:5801 - a93dd8b5-1a1c-44e7-a65e-3f1f65146d0b this master ] 2025-09-02 10:52:36,220 INFO [c.h.c.LifecycleService ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5801 is STARTED 2025-09-02 10:52:36,220 INFO [o.a.s.e.s.CoordinatorService ] [pool-5-thread-1] - [localhost]:5801 [seatunnel-636710] [5.1] This node become a new active master node, begin init coordinator service 2025-09-02 10:52:36,302 INFO [.c.i.s.ClientInvocationService] [main] - hz.client_1 [seatunnel-636710] [5.1] Running with 2 response threads, dynamic=true 2025-09-02 10:52:36,315 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-636710] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is STARTING 2025-09-02 10:52:36,316 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-636710] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is STARTED 2025-09-02 10:52:36,321 INFO [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-636710] [5.1] Trying to connect to cluster: seatunnel-636710 2025-09-02 10:52:36,323 INFO [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-636710] [5.1] Trying to connect to [localhost]:5801 2025-09-02 10:52:36,337 INFO [.p.t.AuthenticationMessageTask] [hz.main.priority-generic-operation.thread-0] - [localhost]:5801 [seatunnel-636710] [5.1] Received auth from Connection[id=1, /127.0.0.1:5801->/127.0.0.1:1293, qualifier=null, endpoint=[127.0.0.1]:1293, remoteUuid=ec792b67-210b-424d-b6e1-f723be23d776, alive=true, connectionType=JVM, planeIndex=-1], successfully authenticated, clientUuid: ec792b67-210b-424d-b6e1-f723be23d776, client name: hz.client_1, client version: 5.1 2025-09-02 10:52:36,340 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-636710] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_CONNECTED 2025-09-02 10:52:36,340 INFO [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-636710] [5.1] Authenticated with server [localhost]:5801:a93dd8b5-1a1c-44e7-a65e-3f1f65146d0b, server version: 5.1, local address: /127.0.0.1:1293 2025-09-02 10:52:36,341 INFO [c.h.i.d.Diagnostics ] [main] - hz.client_1 [seatunnel-636710] [5.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments. 2025-09-02 10:52:36,347 INFO [c.h.c.i.s.ClientClusterService] [hz.client_1.event-9] - hz.client_1 [seatunnel-636710] [5.1] Members [1] { Member [localhost]:5801 - a93dd8b5-1a1c-44e7-a65e-3f1f65146d0b } 2025-09-02 10:52:36,366 INFO [.c.i.s.ClientStatisticsService] [main] - Client statistics is enabled with period 5 seconds. 2025-09-02 10:52:36,431 INFO [o.a.s.e.s.CoordinatorService ] [pool-5-thread-1] - [localhost]:5801 [seatunnel-636710] [5.1] Loaded event handlers: [org.apache.seatunnel.api.event.LoggingEventHandler@439c44d3] 2025-09-02 10:52:36,448 INFO [.h.i.p.i.PartitionStateManager] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] Initializing cluster partition table arrangement... 2025-09-02 10:52:36,454 INFO [o.a.s.c.s.u.ConfigBuilder ] [main] - Loading config file from path: ./job/mysql-to-mysql-jdbc.conf 2025-09-02 10:52:36,570 INFO [o.a.s.c.s.u.ConfigShadeUtils ] [main] - Load config shade spi: [base64] 2025-09-02 10:52:36,611 INFO [o.a.s.c.s.u.ConfigBuilder ] [main] - Parsed config file: { "transform" : [], "sink" : [ { "primary_keys" : [ "id" ], "batch_size" : 5000, "max_retries" : 3, "schema_save_mode" : "CREATE_SCHEMA_WHEN_NOT_EXIST", "field_ide" : "ORIGINAL", "plugin_name" : "Jdbc", "url" : "jdbc:mysql://172.21.204.201:3306/db_all?serverTimezone=Asia/Shanghai&rewriteBatchedStatements=true", "is_exactly_once" : true, "password" : "******", "database" : "db_all", "xa_data_source_class_name" : "com.mysql.cj.jdbc.MysqlXADataSource", "driver" : "com.mysql.cj.jdbc.Driver", "transaction_timeout_sec" : 60, "retry_interval" : 1000, "generate_sink_sql" : true, "user" : "root", "table" : "ods_goods_goods_sku_rt" } ], "source" : [ { "password" : "******", "driver" : "com.mysql.cj.jdbc.Driver", "query" : "select * from db50000000.ods_goods_goods_sku_rt", "connection_check_timeout_sec" : 100, "plugin_name" : "Jdbc", "user" : "root", "url" : "jdbc:mysql://172.21.204.200:3306/db50000000?serverTimezone=Asia/Shanghai" } ], "env" : { "job.mode" : "BATCH", "parallelism" : 2 } } 2025-09-02 10:52:36,618 INFO [p.MultipleTableJobConfigParser] [main] - add common jar in plugins :[] 2025-09-02 10:52:36,628 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Load SeaTunnelSink Plugin from /data/dba/seatunnel/apache-seatunnel-2.3.8/connectors 2025-09-02 10:52:36,630 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='Jdbc'} at: file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar 2025-09-02 10:52:36,631 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Jdbc'} at: file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar 2025-09-02 10:52:36,634 INFO [p.MultipleTableJobConfigParser] [main] - start generating all sources. 2025-09-02 10:52:37,076 INFO [o.a.s.c.s.j.u.JdbcCatalogUtils] [main] - Loading catalog tables for catalog : class org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.mysql.MySqlCatalog 2025-09-02 10:52:37,076 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [main] - Catalog MySQL established connection to jdbc:mysql://172.21.204.200:3306/db50000000?serverTimezone=Asia/Shanghai 2025-09-02 10:52:37,098 INFO [o.a.s.c.s.j.u.JdbcCatalogUtils] [main] - Loaded 1 catalog tables for catalog : class org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.mysql.MySqlCatalog 2025-09-02 10:52:37,099 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [main] - Catalog MySQL closing 2025-09-02 10:52:37,100 INFO [o.a.s.a.t.f.FactoryUtil ] [main] - get the CatalogTable from source Jdbc: jdbc_catalog.db50000000.ods_goods_goods_sku_rt 2025-09-02 10:52:37,112 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Load SeaTunnelSource Plugin from /data/dba/seatunnel/apache-seatunnel-2.3.8/connectors 2025-09-02 10:52:37,117 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='Jdbc'} at: file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar 2025-09-02 10:52:37,119 INFO [p.MultipleTableJobConfigParser] [main] - start generating all transforms. 2025-09-02 10:52:37,119 INFO [p.MultipleTableJobConfigParser] [main] - start generating all sinks. 2025-09-02 10:52:37,122 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Load SeaTunnelSink Plugin from /data/dba/seatunnel/apache-seatunnel-2.3.8/connectors 2025-09-02 10:52:37,123 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Jdbc'} at: file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar 2025-09-02 10:52:37,134 INFO [o.a.s.a.t.f.FactoryUtil ] [main] - Create sink 'Jdbc' with upstream input catalog-table[database: db50000000, schema: null, table: ods_goods_goods_sku_rt] 2025-09-02 10:52:37,201 INFO [o.a.s.e.c.j.ClientJobProxy ] [main] - Start submit job, job id: 1015091849632677889, with plugin jar [file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar] 2025-09-02 10:52:37,213 INFO [.e.s.r.AbstractResourceManager] [hz.main.client.thread-4] - Init ResourceManager 2025-09-02 10:52:37,213 INFO [.e.s.r.AbstractResourceManager] [hz.main.client.thread-4] - initWorker... 2025-09-02 10:52:37,214 INFO [.e.s.r.AbstractResourceManager] [hz.main.client.thread-4] - init live nodes: [[localhost]:5801] 2025-09-02 10:52:37,215 INFO [.e.s.r.AbstractResourceManager] [ForkJoinPool.commonPool-worker-1] - received new worker register: [localhost]:5801 2025-09-02 10:52:37,215 INFO [.e.s.r.AbstractResourceManager] [hz.main.client.thread-4] - registerWorker: {[localhost]:5801=WorkerProfile(address=[localhost]:5801, profile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=477626368}}, unassignedResource=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=477626368}}, dynamicSlot=true, assignedSlots=[], unassignedSlots=[], attributes={})} 2025-09-02 10:52:37,237 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-0] - in batch mode, the 'checkpoint.interval' configuration of env is missing, so checkpoint will be disabled 2025-09-02 10:52:37,237 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-0] - Init JobMaster for Job SeaTunnel_Job (1015091849632677889) 2025-09-02 10:52:37,237 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889) needed jar urls [file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar] 2025-09-02 10:52:37,238 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-0] - Create classloader for job 1015091849632677889 with jars [file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar] 2025-09-02 10:52:37,311 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [seatunnel-coordinator-service-0] - Catalog MySQL established connection to jdbc:mysql://172.21.204.201:3306/db_all?serverTimezone=Asia/Shanghai&rewriteBatchedStatements=true 2025-09-02 10:52:37,312 INFO [a.s.a.s.SaveModeExecuteWrapper] [seatunnel-coordinator-service-0] - Executing save mode for table: db_all.ods_goods_goods_sku_rt, with SchemaSaveMode: CREATE_SCHEMA_WHEN_NOT_EXIST, DataSaveMode: APPEND_DATA using Catalog: MySQL 2025-09-02 10:52:37,315 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [seatunnel-coordinator-service-0] - Catalog MySQL closing 2025-09-02 10:52:37,394 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-0] - Release classloader for job 1015091849632677889 with jars [file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar] 2025-09-02 10:52:37,613 WARN [o.a.h.u.NativeCodeLoader ] [seatunnel-coordinator-service-0] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2025-09-02 10:52:37,751 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-0] - Create CheckpointCoordinator for job(1@1015091849632677889) with plan(CheckpointPlan(pipelineId=1, pipelineSubtasks=[TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3}, taskID=40000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}, taskID=60000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}, taskID=70000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}, taskID=60001, index=1}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}, taskID=70001, index=1}], startingSubtasks=[TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}], pipelineActions={ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-Jdbc])=2, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-Jdbc-MultiTableSink])=2}, subtaskActions={TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3}, taskID=40000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-Jdbc-MultiTableSink]), -1)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}, taskID=60000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-Jdbc]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}, taskID=60001, index=1}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-Jdbc]), 1)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}, taskID=70000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-Jdbc-MultiTableSink]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-Jdbc]), -1)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}, taskID=70001, index=1}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-Jdbc-MultiTableSink]), 1)]})) 2025-09-02 10:52:37,752 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - The task Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (1/2)] is in state CREATED when init state future 2025-09-02 10:52:37,753 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - The task Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (2/2)] is in state CREATED when init state future 2025-09-02 10:52:37,754 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - The task Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SplitEnumerator (1/1)] is in state CREATED when init state future 2025-09-02 10:52:37,754 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - The task Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Jdbc-MultiTableSink]-AggregatedCommitterTask (1/1)] is in state CREATED when init state future 2025-09-02 10:52:37,756 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889) state process is start 2025-09-02 10:52:37,756 INFO [o.a.s.e.c.j.ClientJobProxy ] [main] - Submit job finished, job id: 1015091849632677889, job name: SeaTunnel_Job 2025-09-02 10:52:37,758 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889) turned from state CREATED to SCHEDULED. 2025-09-02 10:52:37,759 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)] state process is start 2025-09-02 10:52:37,762 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)] turned from state CREATED to SCHEDULED. 2025-09-02 10:52:37,775 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)] turned from state SCHEDULED to DEPLOYING. 2025-09-02 10:52:37,776 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SplitEnumerator (1/1)] state process is start 2025-09-02 10:52:37,778 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SplitEnumerator (1/1)] turned from state CREATED to DEPLOYING. 2025-09-02 10:52:37,785 WARN [o.a.s.e.c.j.JobMetricsRunner ] [job-metrics-runner-1015091849632677889] - Failed to get job metrics summary, it maybe first-run 2025-09-02 10:52:37,786 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] received deploying task executionId [1015091855248850945] 2025-09-02 10:52:37,787 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-0] - Create classloader for job 1015091849632677889 with jars [file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar] 2025-09-02 10:52:37,798 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying task TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}, executionId [1015091855248850945] 2025-09-02 10:52:37,799 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying TaskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1} init success 2025-09-02 10:52:37,804 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying TaskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1} success 2025-09-02 10:52:37,805 INFO [.s.t.SourceSplitEnumeratorTask] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - starting seatunnel source split enumerator task, source name: pipeline-1 [Source[0]-Jdbc] 2025-09-02 10:52:37,808 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SplitEnumerator (1/1)] turned from state DEPLOYING to RUNNING. 2025-09-02 10:52:37,808 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SplitEnumerator (1/1)] current state equals target state: RUNNING, skip 2025-09-02 10:52:37,809 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Jdbc-MultiTableSink]-AggregatedCommitterTask (1/1)] state process is start 2025-09-02 10:52:37,810 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Jdbc-MultiTableSink]-AggregatedCommitterTask (1/1)] turned from state CREATED to DEPLOYING. 2025-09-02 10:52:37,819 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] received deploying task executionId [1015091855248916481] 2025-09-02 10:52:37,820 INFO [o.a.s.c.s.j.s.ChunkSplitter ] [hz.main.seaTunnel.task.thread-2] - Switch to dynamic chunk splitter 2025-09-02 10:52:37,867 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying task TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3}, executionId [1015091855248916481] 2025-09-02 10:52:37,867 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying TaskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3} init success 2025-09-02 10:52:37,868 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying TaskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3} success 2025-09-02 10:52:37,870 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Jdbc-MultiTableSink]-AggregatedCommitterTask (1/1)] turned from state DEPLOYING to RUNNING. 2025-09-02 10:52:37,871 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Jdbc-MultiTableSink]-AggregatedCommitterTask (1/1)] current state equals target state: RUNNING, skip 2025-09-02 10:52:37,872 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (1/2)] state process is start 2025-09-02 10:52:37,874 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (1/2)] turned from state CREATED to DEPLOYING. 2025-09-02 10:52:37,884 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] received deploying task executionId [1015091855248982017] 2025-09-02 10:52:37,887 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying task TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}, executionId [1015091855248982017] 2025-09-02 10:52:37,888 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying TaskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000} init success 2025-09-02 10:52:37,892 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying TaskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000} success 2025-09-02 10:52:37,893 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (1/2)] turned from state DEPLOYING to RUNNING. 2025-09-02 10:52:37,893 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (1/2)] current state equals target state: RUNNING, skip 2025-09-02 10:52:37,894 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (2/2)] state process is start 2025-09-02 10:52:37,895 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (2/2)] turned from state CREATED to DEPLOYING. 2025-09-02 10:52:37,897 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] received deploying task executionId [1015091855249047553] 2025-09-02 10:52:37,898 INFO [s.e.s.t.TransformSeaTunnelTask] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}] - starting seatunnel transform task, index 0 2025-09-02 10:52:37,900 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying task TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}, executionId [1015091855249047553] 2025-09-02 10:52:37,900 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying TaskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001} init success 2025-09-02 10:52:38,009 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-0] - [localhost]:5801 [seatunnel-636710] [5.1] deploying TaskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001} success 2025-09-02 10:52:38,010 INFO [o.a.s.c.s.j.s.ChunkSplitter ] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}] - Switch to dynamic chunk splitter 2025-09-02 10:52:38,010 INFO [o.a.s.c.s.j.s.ChunkSplitter ] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}] - Switch to dynamic chunk splitter 2025-09-02 10:52:38,011 INFO [s.e.s.t.TransformSeaTunnelTask] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}] - starting seatunnel transform task, index 1 2025-09-02 10:52:38,014 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (2/2)] turned from state DEPLOYING to RUNNING. 2025-09-02 10:52:38,015 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (2/2)] current state equals target state: RUNNING, skip 2025-09-02 10:52:38,019 INFO [.a.s.e.s.t.SourceSeaTunnelTask] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}] - starting seatunnel source task, index 0 2025-09-02 10:52:38,019 INFO [.a.s.e.s.t.SourceSeaTunnelTask] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}] - starting seatunnel source task, index 1 2025-09-02 10:52:38,023 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)] turned from state DEPLOYING to RUNNING. 2025-09-02 10:52:38,024 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-0] - Job SeaTunnel_Job (1015091849632677889) turned from state SCHEDULED to RUNNING. 2025-09-02 10:52:38,025 INFO [a.s.a.s.m.MultiTableSinkWriter] [hz.main.seaTunnel.task.thread-8] - init multi table sink writer, queue size: 1 2025-09-02 10:52:38,025 INFO [a.s.a.s.m.MultiTableSinkWriter] [hz.main.seaTunnel.task.thread-9] - init multi table sink writer, queue size: 1 2025-09-02 10:52:38,133 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-30] - log event: ReaderOpenEvent(createdTime=1756781558132, jobId=1015091849632677889, eventType=LIFECYCLE_READER_OPEN) 2025-09-02 10:52:38,133 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-30] - log event: ReaderOpenEvent(createdTime=1756781558132, jobId=1015091849632677889, eventType=LIFECYCLE_READER_OPEN) 2025-09-02 10:52:38,134 INFO [.s.t.SourceSplitEnumeratorTask] [hz.main.seaTunnel.task.thread-8] - received reader register, readerID: TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}, taskID=60000, index=0} 2025-09-02 10:52:38,134 INFO [.s.t.SourceSplitEnumeratorTask] [hz.main.seaTunnel.task.thread-3] - received reader register, readerID: TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}, taskID=60001, index=1} 2025-09-02 10:52:38,134 INFO [.j.s.JdbcSourceSplitEnumerator] [hz.main.seaTunnel.task.thread-8] - Register reader 0 to JdbcSourceSplitEnumerator. 2025-09-02 10:52:38,134 INFO [.j.s.JdbcSourceSplitEnumerator] [hz.main.seaTunnel.task.thread-3] - Register reader 1 to JdbcSourceSplitEnumerator. 2025-09-02 10:52:38,143 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - checkpoint is disabled, because in batch mode and 'checkpoint.interval' of env is missing. 2025-09-02 10:52:38,143 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-2] - checkpoint is disabled, because in batch mode and 'checkpoint.interval' of env is missing. 2025-09-02 10:52:38,214 INFO [.s.t.SourceSplitEnumeratorTask] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - received enough reader, starting enumerator... 2025-09-02 10:52:38,214 INFO [.j.s.JdbcSourceSplitEnumerator] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - Starting split enumerator. 2025-09-02 10:52:38,214 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-45] - log event: EnumeratorOpenEvent(createdTime=1756781558214, jobId=1015091849632677889, eventType=LIFECYCLE_ENUMERATOR_OPEN) 2025-09-02 10:52:38,215 INFO [.j.s.JdbcSourceSplitEnumerator] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - Splitting table db50000000.ods_goods_goods_sku_rt. 2025-09-02 10:52:38,215 INFO [o.a.s.c.s.j.s.ChunkSplitter ] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - Start splitting table db50000000.ods_goods_goods_sku_rt into chunks... 2025-09-02 10:52:38,216 WARN [o.a.s.c.s.j.s.ChunkSplitter ] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - No split key found for table db50000000.ods_goods_goods_sku_rt 2025-09-02 10:52:38,217 INFO [o.a.s.c.s.j.s.ChunkSplitter ] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - Split table db50000000.ods_goods_goods_sku_rt into 1 chunks, time cost: 2ms. 2025-09-02 10:52:38,217 INFO [.j.s.JdbcSourceSplitEnumerator] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - Split table db50000000.ods_goods_goods_sku_rt into 1 splits. 2025-09-02 10:52:38,221 INFO [.j.s.JdbcSourceSplitEnumerator] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - No more splits to assign. Sending NoMoreSplitsEvent to reader [0, 1]. 2025-09-02 10:52:38,235 INFO [o.a.s.c.s.j.s.JdbcSourceReader] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}] - Closed the bounded jdbc source 2025-09-02 10:52:38,321 INFO [.e.FieldNamedPreparedStatement] [st-multi-table-sink-writer-1] - PrepareStatement sql is: INSERT INTO `db_all`.`ods_goods_goods_sku_rt` (`id`, `sort`, `tenant_id`, `cooperator_id`, `spu_code`, `sku_code`, `sku_name`, `barcode`, `goods_no`, `spec_val_one_code`, `spec_val_one_name`, `spec_val_two_code`, `spec_val_two_name`, `market_price`, `refer_price`, `member_price`, `purchase_price`, `ceiling_price`, `floor_price`, `dispatch_price`, `wholesale_price`, `sku_state`, `spec_pic_url`, `external_sku_code`, `relate_spu_code`, `min_purch_nums`, `package_flag`, `edit_time`, `create_user_code`, `create_user_name`, `create_time`, `update_user_code`, `update_user_name`, `update_time`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) ON DUPLICATE KEY UPDATE `id`=VALUES(`id`), `sort`=VALUES(`sort`), `tenant_id`=VALUES(`tenant_id`), `cooperator_id`=VALUES(`cooperator_id`), `spu_code`=VALUES(`spu_code`), `sku_code`=VALUES(`sku_code`), `sku_name`=VALUES(`sku_name`), `barcode`=VALUES(`barcode`), `goods_no`=VALUES(`goods_no`), `spec_val_one_code`=VALUES(`spec_val_one_code`), `spec_val_one_name`=VALUES(`spec_val_one_name`), `spec_val_two_code`=VALUES(`spec_val_two_code`), `spec_val_two_name`=VALUES(`spec_val_two_name`), `market_price`=VALUES(`market_price`), `refer_price`=VALUES(`refer_price`), `member_price`=VALUES(`member_price`), `purchase_price`=VALUES(`purchase_price`), `ceiling_price`=VALUES(`ceiling_price`), `floor_price`=VALUES(`floor_price`), `dispatch_price`=VALUES(`dispatch_price`), `wholesale_price`=VALUES(`wholesale_price`), `sku_state`=VALUES(`sku_state`), `spec_pic_url`=VALUES(`spec_pic_url`), `external_sku_code`=VALUES(`external_sku_code`), `relate_spu_code`=VALUES(`relate_spu_code`), `min_purch_nums`=VALUES(`min_purch_nums`), `package_flag`=VALUES(`package_flag`), `edit_time`=VALUES(`edit_time`), `create_user_code`=VALUES(`create_user_code`), `create_user_name`=VALUES(`create_user_name`), `create_time`=VALUES(`create_time`), `update_user_code`=VALUES(`update_user_code`), `update_user_name`=VALUES(`update_user_name`), `update_time`=VALUES(`update_time`) 2025-09-02 10:52:38,326 INFO [.e.FieldNamedPreparedStatement] [st-multi-table-sink-writer-1] - PrepareStatement sql is: DELETE FROM `db_all`.`ods_goods_goods_sku_rt` WHERE `id` = ? 2025-09-02 10:53:10,474 INFO [o.a.s.c.s.j.s.JdbcSourceReader] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}] - Closed the bounded jdbc source 2025-09-02 10:53:10,563 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - wait checkpoint completed: 9223372036854775807 2025-09-02 10:53:10,589 INFO [.e.FieldNamedPreparedStatement] [st-multi-table-sink-writer-1] - PrepareStatement sql is: INSERT INTO `db_all`.`ods_goods_goods_sku_rt` (`id`, `sort`, `tenant_id`, `cooperator_id`, `spu_code`, `sku_code`, `sku_name`, `barcode`, `goods_no`, `spec_val_one_code`, `spec_val_one_name`, `spec_val_two_code`, `spec_val_two_name`, `market_price`, `refer_price`, `member_price`, `purchase_price`, `ceiling_price`, `floor_price`, `dispatch_price`, `wholesale_price`, `sku_state`, `spec_pic_url`, `external_sku_code`, `relate_spu_code`, `min_purch_nums`, `package_flag`, `edit_time`, `create_user_code`, `create_user_name`, `create_time`, `update_user_code`, `update_user_name`, `update_time`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) ON DUPLICATE KEY UPDATE `id`=VALUES(`id`), `sort`=VALUES(`sort`), `tenant_id`=VALUES(`tenant_id`), `cooperator_id`=VALUES(`cooperator_id`), `spu_code`=VALUES(`spu_code`), `sku_code`=VALUES(`sku_code`), `sku_name`=VALUES(`sku_name`), `barcode`=VALUES(`barcode`), `goods_no`=VALUES(`goods_no`), `spec_val_one_code`=VALUES(`spec_val_one_code`), `spec_val_one_name`=VALUES(`spec_val_one_name`), `spec_val_two_code`=VALUES(`spec_val_two_code`), `spec_val_two_name`=VALUES(`spec_val_two_name`), `market_price`=VALUES(`market_price`), `refer_price`=VALUES(`refer_price`), `member_price`=VALUES(`member_price`), `purchase_price`=VALUES(`purchase_price`), `ceiling_price`=VALUES(`ceiling_price`), `floor_price`=VALUES(`floor_price`), `dispatch_price`=VALUES(`dispatch_price`), `wholesale_price`=VALUES(`wholesale_price`), `sku_state`=VALUES(`sku_state`), `spec_pic_url`=VALUES(`spec_pic_url`), `external_sku_code`=VALUES(`external_sku_code`), `relate_spu_code`=VALUES(`relate_spu_code`), `min_purch_nums`=VALUES(`min_purch_nums`), `package_flag`=VALUES(`package_flag`), `edit_time`=VALUES(`edit_time`), `create_user_code`=VALUES(`create_user_code`), `create_user_name`=VALUES(`create_user_name`), `create_time`=VALUES(`create_time`), `update_user_code`=VALUES(`update_user_code`), `update_user_name`=VALUES(`update_user_name`), `update_time`=VALUES(`update_time`) 2025-09-02 10:53:10,590 INFO [.e.FieldNamedPreparedStatement] [st-multi-table-sink-writer-1] - PrepareStatement sql is: DELETE FROM `db_all`.`ods_goods_goods_sku_rt` WHERE `id` = ? 2025-09-02 10:53:11,425 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - pending checkpoint(9223372036854775807/1@1015091849632677889) notify finished! 2025-09-02 10:53:11,425 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - start notify checkpoint completed, job id: 1015091849632677889, pipeline id: 1, checkpoint id:9223372036854775807 2025-09-02 10:53:11,429 INFO [.s.JdbcSinkAggregatedCommitter] [hz.main.generic-operation.thread-20] - commit xid: [XidInfo(xid=201:3130313530393138343936333236373738383900000000000000000000000000000000003eb8570899010000:3e348add, attempts=0), XidInfo(xid=201:313031353039313834393633323637373838390000000000000000000000000001000000363a570899010000:0fbf5db4, attempts=0)] 2025-09-02 10:53:11,429 INFO [o.a.s.c.s.j.i.x.XaGroupOpsImpl] [hz.main.generic-operation.thread-20] - commit 2 transactions 2025-09-02 10:53:11,429 INFO [o.a.s.c.s.j.i.x.XaGroupOpsImpl] [hz.main.generic-operation.thread-20] - committing 201:3130313530393138343936333236373738383900000000000000000000000000000000003eb8570899010000:3e348add transaction 2025-09-02 10:53:11,433 INFO [o.a.s.c.s.j.i.x.XaGroupOpsImpl] [hz.main.generic-operation.thread-20] - committing 201:313031353039313834393633323637373838390000000000000000000000000001000000363a570899010000:0fbf5db4 transaction 2025-09-02 10:53:11,436 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - start clean pending checkpoint cause CheckpointCoordinator completed. 2025-09-02 10:53:11,438 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - Turn checkpoint_state_1015091849632677889_1 state from null to FINISHED 2025-09-02 10:53:11,457 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel-636710] [5.1] taskDone, taskId = 20000, taskGroup = TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1} 2025-09-02 10:53:11,458 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-26] - log event: EnumeratorCloseEvent(createdTime=1756781591457, jobId=1015091849632677889, eventType=LIFECYCLE_ENUMERATOR_CLOSE) 2025-09-02 10:53:11,458 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}] - [localhost]:5801 [seatunnel-636710] [5.1] taskDone, taskId = 60000, taskGroup = TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000} 2025-09-02 10:53:11,458 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-27] - log event: ReaderCloseEvent(createdTime=1756781591458, jobId=1015091849632677889, eventType=LIFECYCLE_READER_CLOSE) 2025-09-02 10:53:11,459 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3}] - [localhost]:5801 [seatunnel-636710] [5.1] taskDone, taskId = 40000, taskGroup = TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3} 2025-09-02 10:53:11,462 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel-636710] [5.1] taskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1} complete with FINISHED 2025-09-02 10:53:11,463 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-4] - [localhost]:5801 [seatunnel-636710] [5.1] Task TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1} complete with state FINISHED 2025-09-02 10:53:11,463 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-4] - [localhost]:5801 [seatunnel-636710] [5.1] Received task end from execution TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=1}, state FINISHED 2025-09-02 10:53:11,464 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3}] - [localhost]:5801 [seatunnel-636710] [5.1] taskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3} complete with FINISHED 2025-09-02 10:53:11,464 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-1] - [localhost]:5801 [seatunnel-636710] [5.1] Task TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3} complete with state FINISHED 2025-09-02 10:53:11,465 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-1] - [localhost]:5801 [seatunnel-636710] [5.1] Received task end from execution TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=3}, state FINISHED 2025-09-02 10:53:11,465 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-4] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SplitEnumerator (1/1)] turned from state RUNNING to FINISHED. 2025-09-02 10:53:11,465 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-4] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SplitEnumerator (1/1)] state process is stopped 2025-09-02 10:53:11,466 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SplitEnumerator (1/1)] future complete with state FINISHED 2025-09-02 10:53:11,466 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-1] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Jdbc-MultiTableSink]-AggregatedCommitterTask (1/1)] turned from state RUNNING to FINISHED. 2025-09-02 10:53:11,466 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-1] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Jdbc-MultiTableSink]-AggregatedCommitterTask (1/1)] state process is stopped 2025-09-02 10:53:11,466 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Jdbc-MultiTableSink]-AggregatedCommitterTask (1/1)] future complete with state FINISHED 2025-09-02 10:53:11,476 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-30] - log event: ReaderCloseEvent(createdTime=1756781591476, jobId=1015091849632677889, eventType=LIFECYCLE_READER_CLOSE) 2025-09-02 10:53:11,476 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}] - [localhost]:5801 [seatunnel-636710] [5.1] taskDone, taskId = 60001, taskGroup = TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001} 2025-09-02 10:53:11,508 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}] - [localhost]:5801 [seatunnel-636710] [5.1] taskDone, taskId = 70000, taskGroup = TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000} 2025-09-02 10:53:11,508 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-28] - log event: WriterCloseEvent(createdTime=1756781591508, jobId=1015091849632677889, eventType=LIFECYCLE_WRITER_CLOSE) 2025-09-02 10:53:11,508 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-28] - log event: WriterCloseEvent(createdTime=1756781591508, jobId=1015091849632677889, eventType=LIFECYCLE_WRITER_CLOSE) 2025-09-02 10:53:11,511 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}] - [localhost]:5801 [seatunnel-636710] [5.1] taskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000} complete with FINISHED 2025-09-02 10:53:11,511 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-6] - [localhost]:5801 [seatunnel-636710] [5.1] Task TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000} complete with state FINISHED 2025-09-02 10:53:11,511 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-6] - [localhost]:5801 [seatunnel-636710] [5.1] Received task end from execution TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000}, state FINISHED 2025-09-02 10:53:11,512 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-6] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (1/2)] turned from state RUNNING to FINISHED. 2025-09-02 10:53:11,512 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-6] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (1/2)] state process is stopped 2025-09-02 10:53:11,512 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (1/2)] future complete with state FINISHED 2025-09-02 10:53:11,513 INFO [o.a.s.e.s.m.JobMaster ] [hz.main.seaTunnel.task.thread-6] - release the task group resource TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50000} 2025-09-02 10:53:11,514 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-29] - received slot release request, jobID: 1015091849632677889, slot: SlotProfile{worker=[localhost]:5801, slotID=3, ownerJobID=1015091849632677889, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='d4ff3f9f-0e16-4596-b61e-80802480e0ea'} 2025-09-02 10:53:11,527 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}] - [localhost]:5801 [seatunnel-636710] [5.1] taskDone, taskId = 70001, taskGroup = TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001} 2025-09-02 10:53:11,528 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-31] - log event: WriterCloseEvent(createdTime=1756781591527, jobId=1015091849632677889, eventType=LIFECYCLE_WRITER_CLOSE) 2025-09-02 10:53:11,528 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}] - Release classloader for job 1015091849632677889 with jars [file:/data/dba/seatunnel/apache-seatunnel-2.3.8/connectors/connector-jdbc-2.3.8.jar] 2025-09-02 10:53:11,528 INFO [o.a.s.a.e.LoggingEventHandler ] [hz.main.generic-operation.thread-31] - log event: WriterCloseEvent(createdTime=1756781591527, jobId=1015091849632677889, eventType=LIFECYCLE_WRITER_CLOSE) 2025-09-02 10:53:11,543 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}] - recycle classloader for thread BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001} 2025-09-02 10:53:11,545 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}] - [localhost]:5801 [seatunnel-636710] [5.1] taskGroup TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001} complete with FINISHED 2025-09-02 10:53:11,546 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-6] - [localhost]:5801 [seatunnel-636710] [5.1] Task TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001} complete with state FINISHED 2025-09-02 10:53:11,546 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-6] - [localhost]:5801 [seatunnel-636710] [5.1] Received task end from execution TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001}, state FINISHED 2025-09-02 10:53:11,547 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-6] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (2/2)] turned from state RUNNING to FINISHED. 2025-09-02 10:53:11,547 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-6] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (2/2)] state process is stopped 2025-09-02 10:53:11,547 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc]-SourceTask (2/2)] future complete with state FINISHED 2025-09-02 10:53:11,547 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)] will end with state FINISHED 2025-09-02 10:53:11,548 INFO [o.a.s.e.s.m.JobMaster ] [hz.main.seaTunnel.task.thread-6] - release the task group resource TaskGroupLocation{jobId=1015091849632677889, pipelineId=1, taskGroupId=50001} 2025-09-02 10:53:11,548 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-32] - received slot release request, jobID: 1015091849632677889, slot: SlotProfile{worker=[localhost]:5801, slotID=4, ownerJobID=1015091849632677889, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='d4ff3f9f-0e16-4596-b61e-80802480e0ea'} 2025-09-02 10:53:11,549 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)] turned from state RUNNING to FINISHED. 2025-09-02 10:53:11,579 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-3] - release the pipeline Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)] resource 2025-09-02 10:53:11,580 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-38] - received slot release request, jobID: 1015091849632677889, slot: SlotProfile{worker=[localhost]:5801, slotID=2, ownerJobID=1015091849632677889, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='d4ff3f9f-0e16-4596-b61e-80802480e0ea'} 2025-09-02 10:53:11,580 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-39] - received slot release request, jobID: 1015091849632677889, slot: SlotProfile{worker=[localhost]:5801, slotID=1, ownerJobID=1015091849632677889, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='d4ff3f9f-0e16-4596-b61e-80802480e0ea'} 2025-09-02 10:53:11,581 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)] state process is stop 2025-09-02 10:53:11,581 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-2] - Job SeaTunnel_Job (1015091849632677889), Pipeline: [(1/1)] future complete with state FINISHED 2025-09-02 10:53:11,582 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-2] - Job SeaTunnel_Job (1015091849632677889) turned from state RUNNING to FINISHED. 2025-09-02 10:53:11,582 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-2] - Job SeaTunnel_Job (1015091849632677889) state process is stop 2025-09-02 10:53:11,599 INFO [o.a.s.e.c.j.ClientJobProxy ] [main] - Job (1015091849632677889) end with state FINISHED 2025-09-02 10:53:11,641 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - *********************************************** Job Statistic Information *********************************************** Start Time : 2025-09-02 10:52:36 End Time : 2025-09-02 10:53:11 Total Time(s) : 35 Total Read Count : 154285 Total Write Count : 154285 Total Failed Count : 0 *********************************************** 2025-09-02 10:53:11,641 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-636710] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTTING_DOWN 2025-09-02 10:53:11,643 INFO [c.h.i.s.t.TcpServerConnection ] [hz.main.IO.thread-in-1] - [localhost]:5801 [seatunnel-636710] [5.1] Connection[id=1, /127.0.0.1:5801->/127.0.0.1:1293, qualifier=null, endpoint=[127.0.0.1]:1293, remoteUuid=ec792b67-210b-424d-b6e1-f723be23d776, alive=false, connectionType=JVM, planeIndex=-1] closed. Reason: Connection closed by the other side 2025-09-02 10:53:11,643 INFO [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-636710] [5.1] Removed connection to endpoint: [localhost]:5801:a93dd8b5-1a1c-44e7-a65e-3f1f65146d0b, connection: ClientConnection{alive=false, connectionId=1, channel=NioChannel{/127.0.0.1:1293->localhost/127.0.0.1:5801}, remoteAddress=[localhost]:5801, lastReadTime=2025-09-02 10:53:11.634, lastWriteTime=2025-09-02 10:53:11.599, closedTime=2025-09-02 10:53:11.642, connected server version=5.1} 2025-09-02 10:53:11,644 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-636710] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_DISCONNECTED 2025-09-02 10:53:11,645 INFO [c.h.c.i.ClientEndpointManager ] [hz.main.event-4] - [localhost]:5801 [seatunnel-636710] [5.1] Destroying ClientEndpoint{connection=Connection[id=1, /127.0.0.1:5801->/127.0.0.1:1293, qualifier=null, endpoint=[127.0.0.1]:1293, remoteUuid=ec792b67-210b-424d-b6e1-f723be23d776, alive=false, connectionType=JVM, planeIndex=-1], clientUuid=ec792b67-210b-424d-b6e1-f723be23d776, clientName=hz.client_1, authenticated=true, clientVersion=5.1, creationTime=1756781556334, latest clientAttributes=lastStatisticsCollectionTime=1756781591366,enterprise=false,clientType=JVM,clientVersion=5.1,clusterConnectionTimestamp=1756781556324,clientAddress=127.0.0.1,clientName=hz.client_1,credentials.principal=null,os.committedVirtualMemorySize=6586052608,os.freePhysicalMemorySize=10702077952,os.freeSwapSpaceSize=10737414144,os.maxFileDescriptorCount=102400,os.openFileDescriptorCount=59,os.processCpuTime=68920000000,os.systemLoadAverage=1.21,os.totalPhysicalMemorySize=16641896448,os.totalSwapSpaceSize=10737414144,runtime.availableProcessors=8,runtime.freeMemory=144248408,runtime.maxMemory=482869248,runtime.totalMemory=482869248,runtime.uptime=38290,runtime.usedMemory=338623160, labels=[]} 2025-09-02 10:53:11,646 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-636710] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTDOWN 2025-09-02 10:53:11,647 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - Closed SeaTunnel client...... 2025-09-02 10:53:11,647 INFO [c.h.c.LifecycleService ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5801 is SHUTTING_DOWN 2025-09-02 10:53:11,650 INFO [c.h.i.p.i.MigrationManager ] [hz.main.cached.thread-15] - [localhost]:5801 [seatunnel-636710] [5.1] Shutdown request of Member [localhost]:5801 - a93dd8b5-1a1c-44e7-a65e-3f1f65146d0b this master is handled 2025-09-02 10:53:11,657 INFO [c.h.i.i.Node ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Shutting down connection manager... 2025-09-02 10:53:11,659 INFO [c.h.i.i.Node ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Shutting down node engine... 2025-09-02 10:53:11,671 INFO [.c.c.DefaultClassLoaderService] [main] - close classloader service 2025-09-02 10:53:11,671 INFO [o.a.s.e.s.EventService ] [event-forwarder-0] - Event forward thread interrupted 2025-09-02 10:53:11,679 INFO [c.h.i.i.NodeExtension ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Destroying node NodeExtension. 2025-09-02 10:53:11,679 INFO [c.h.i.i.Node ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] Hazelcast Shutdown is completed in 29 ms. 2025-09-02 10:53:11,680 INFO [c.h.c.LifecycleService ] [main] - [localhost]:5801 [seatunnel-636710] [5.1] [localhost]:5801 is SHUTDOWN 2025-09-02 10:53:11,680 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - Closed HazelcastInstance ...... 2025-09-02 10:53:11,680 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - Closed metrics executor service ...... 2025-09-02 10:53:11,682 INFO [s.c.s.s.c.ClientExecuteCommand] [ForkJoinPool.commonPool-worker-1] - run shutdown hook because get close signal [root@zb-yunweitest-mysql-204-201 apache-seatunnel-2.3.8]#
posted on
浙公网安备 33010602011771号