随笔分类 -  DataXDataWorks

DataxWeb 设置运行错误
摘要：2021-09-09 09:21:15 [JobThread.run-130] <br> datax-web job execute start <br> Param: 2021-09-09 09:21:15 [BuildCommand.buildDataXParam-100] Command pa 阅读全文
posted @ 2021-09-09 09:40 DarJeely 阅读(2198) 评论(0) 推荐(0)
Datax mysql 8.x elasticsearch 7.x 测试成功json样例
摘要：{ "job": { "setting": { "speed": { "channel": 1, "batchSize":1000 } }, "content": [ { "reader": { "name": "mysqlreader", "parameter": { "username": "r 阅读全文
posted @ 2021-09-08 14:53 DarJeely 阅读(205) 评论(0) 推荐(0)
testmysqltoelasticsearch76.json 未测试，仅参考
摘要：{ "job": { "setting": { "speed": { "channel": 32, "batchSize":4096 } }, "content": [ { "reader": { "name": "mysqlreader", "parameter": { "splitPk": "L 阅读全文
posted @ 2021-09-08 14:51 DarJeely 阅读(27) 评论(0) 推荐(0)
testmysqltoelasticsearch75.json 未测试，仅参考
摘要：{ "job": { "setting": { "speed": { "channel": 32, "batchSize":4096 } }, "content": [ { "reader": { "name": "mysqlreader", "parameter": { "splitPk": "L 阅读全文
posted @ 2021-09-08 14:50 DarJeely 阅读(31) 评论(0) 推荐(0)
testorcletoelasticsearch73.json 微测试，仅参考
摘要：{ "job": { "setting": { "speed": { "channel": 3, "byte": 1048576 }, "errorLimit": { "record": 0, "percentage": 0.02 } }, "content": [ { "reader": { "n 阅读全文
posted @ 2021-09-08 14:49 DarJeely 阅读(22) 评论(0) 推荐(0)
testmysqltoelasticsearch74.json 未测试，仅参考
摘要：{ "job": { "setting": { "speed": { "channel": 1 } }, "content": [ { "reader": { ... }, "writer": { "name": "elasticsearchwriter", "parameter": { "endp 阅读全文
posted @ 2021-09-08 14:49 DarJeely 阅读(24) 评论(0) 推荐(0)
testmysqltoelasticsearch72.json 微测试，仅参考
摘要：{ "job": { "setting": { "speed": { "channel":1 } }, "content": [ { "reader": { "name": "mysqlreader", "parameter": { "username": "user", "password": " 阅读全文
posted @ 2021-09-08 14:48 DarJeely 阅读(20) 评论(0) 推荐(0)
testmysqltoelasticsearch71.json 未测试，仅参考
摘要：{ "job": { "setting": { "speed": { "channel": 2 } }, "content": [ { "reader": { "name": "mysqlreader", "parameter": { "username": "datax", "password": 阅读全文
posted @ 2021-09-08 14:47 DarJeely 阅读(26) 评论(0) 推荐(0)
Datax mysql8.x to mysql8.x json测试样例
摘要：{ "job": { "setting": { "speed": { "channel": 1 } }, "content": [ { "reader": { "name": "mysqlreader", "parameter": { "username": "root", "password": 阅读全文
posted @ 2021-09-08 14:46 DarJeely 阅读(102) 评论(0) 推荐(0)
Datax streamreader json测试样例
摘要：{ "job": { "content": [ { "reader": { "name": "streamreader", "parameter": { "sliceRecordCount": 10, "column": [ { "type": "String", "value": "helle D 阅读全文
posted @ 2021-09-08 14:45 DarJeely 阅读(535) 评论(0) 推荐(0)
阿里DataX支持mysql8.X 改造记录
摘要：1、从mysql8 往elasticsearch 7导入数据时，报错。 2、经查询，官方datax仅支持my5.x，以下为改造适配mysql 8.x 资料记录。 DataX支持mysql8.X https://blog.csdn.net/qq_41852045/article/details/108 阅读全文
posted @ 2021-09-08 14:09 DarJeely 阅读(633) 评论(0) 推荐(0)
阿里DatatX mysql8往 Elasticsearch 7 插入时间数据 时区引发的问题
摘要：1、mysql 读取错误指定serverTimezone=UTC jdbc:mysql://192.168.8.248:3306/sourcedb?useUnicode=true&characterEncoding=UTF-8&useSSL=false&serverTimezone=UTC" 2、改 阅读全文
posted @ 2021-09-08 14:04 DarJeely 阅读(490) 评论(0) 推荐(0)
datax 编译打包命令
摘要：mvn -U clean package assembly:assembly -Dmaven.test.skip=true 阅读全文
posted @ 2021-09-06 11:47 DarJeely 阅读(136) 评论(0) 推荐(0)
datax oscarwriter 错误
摘要： 阅读全文
posted @ 2021-09-06 11:25 DarJeely 阅读(87) 评论(0) 推荐(0)