sqoop调度数据问题记录
1)数据由一行变成两行,导致输出到Hive表数据缺失。
处理:在源头上处理下字段内容,将空格,\n等一些特殊字符处理掉
TRIM(BOTH FROM replace(o.refund_reason,'\n','')) as refund_reason
1)数据由一行变成两行,导致输出到Hive表数据缺失。
处理:在源头上处理下字段内容,将空格,\n等一些特殊字符处理掉
TRIM(BOTH FROM replace(o.refund_reason,'\n','')) as refund_reason