下载地址: https://github.com/alibaba/DataX
参考文档 :https://github.com/alibaba/DataX/blob/master/userGuid.md
工具部署
下载后解压至本地某个目录,进入bin目录,即可运行同步作业:
$ python bin/datax.py job/{YOUR_JOB.json}
自检脚本:
python bin/datax.py job/job.json
同步SR 到 MySQL 示例:
cat > job/sr2mysql.json << EOF
{
"job": {
"setting": {
"speed": {
"channel": 5
},
"errorLimit": {
"record": 0,
"percentage": 0.02
}
},
"content": [
{
"reader": {
"name": "mysqlreader",
"parameter": {
"username": "root",
"password": "ARD19b0Becdee13",
"column": ["name"],
"connection": [
{
"jdbcUrl": [
"jdbc:mysql://10.9.93.132:9030/bbb3?useUnicode=true&characterEncoding=utf-8"
],
"table": [
"detailDemo"
]
}
]
}
},
"writer": {
"name": "mysqlwriter",
"parameter": {
"writeMode": "insert",
"username": "arch_wt",
"password": "2uID@8SNF2OhGecg",
"column": ["name"],
"connection": [
{
"jdbcUrl": "jdbc:mysql://lanuatrpa.internal.cn-south-1.mysql.rds.myhuaweicloud.com:6033/bbb3?useUnicode=true&characterEncoding=utf-8",
"table": [
"detailDemo"
]
}
]
}
}
}
]
}
}
EOF
执行任务:
python bin/datax.py job/sr2mysql.json