Flink - 随笔分类 - Xiaohu_BigData

Flink1.18 Sink - 自定义sink

摘要：package com.xiaohu.sink; import org.apache.flink.configuration.Configuration; import org.apache.flink.streaming.api.datastream.DataStreamSource; impor 阅读全文

posted @ 2025-02-26 20:45 Xiaohu_BigData 阅读(128) 评论(0) 推荐(0)

Flink1.18 Sink - 精确一次ExactlyOnce到JDBC 使用新依赖【因返回值是sinkFunction, 故目前只支持addSink使用, 1.18版本不支持sinkTo】

摘要：package com.xiaohu.sink; import com.mysql.cj.jdbc.MysqlXADataSource; import org.apache.flink.api.common.functions.MapFunction; import org.apache.flink 阅读全文

posted @ 2025-02-26 20:45 Xiaohu_BigData 阅读(66) 评论(0) 推荐(0)

Flink1.18 Sink - 到JDBC 使用新依赖【因返回值是sinkFunction, 故目前只支持addSink使用, 1.18版本不支持sinkTo】

摘要：自行修改对应数据库参数和配置 package com.xiaohu.sink; import org.apache.flink.api.common.functions.MapFunction; import org.apache.flink.connector.jdbc.JdbcConnectio 阅读全文

posted @ 2025-02-26 20:44 Xiaohu_BigData 阅读(131) 评论(0) 推荐(0)

Flink1.18 Sink - 到Kafka自定义序列化类新版本写法sinkTo的使用

摘要：package com.xiaohu.sink; import org.apache.flink.api.common.serialization.SimpleStringSchema; import org.apache.flink.connector.base.DeliveryGuarantee 阅读全文

posted @ 2025-02-26 20:42 Xiaohu_BigData 阅读(63) 评论(0) 推荐(0)

Flink1.18 Sink - 到Kafka 新版本写法sinkTo的使用

摘要：package com.xiaohu.sink; import com.xiaohu.bean.WaterSensor; import org.apache.flink.api.common.functions.MapFunction; import org.apache.flink.api.com 阅读全文

posted @ 2025-02-26 20:42 Xiaohu_BigData 阅读(154) 评论(0) 推荐(0)

Flink1.18 Sink - 到文件新版本写法sinkToFile

摘要：package com.xiaohu.sink; import org.apache.flink.api.common.eventtime.WatermarkStrategy; import org.apache.flink.api.common.serialization.SimpleString 阅读全文

posted @ 2025-02-26 20:40 Xiaohu_BigData 阅读(70) 评论(0) 推荐(0)

Flink1.18 Transfrom - 合流【Connect 两个流数据进行关联】

摘要：package com.xiaohu.transfrom.streamtranform; import org.apache.flink.api.java.tuple.Tuple2; import org.apache.flink.api.java.tuple.Tuple3; import org. 阅读全文

posted @ 2025-02-26 20:37 Xiaohu_BigData 阅读(50) 评论(0) 推荐(0)

Flink1.18 Transfrom - 合流【Connect, 并行度为1的情况】

摘要：package com.xiaohu.transfrom.streamtranform; import org.apache.flink.streaming.api.datastream.ConnectedStreams; import org.apache.flink.streaming.api. 阅读全文

posted @ 2025-02-26 20:36 Xiaohu_BigData 阅读(21) 评论(0) 推荐(0)

Flink1.18 Transfrom - 合流【Union】

摘要：package com.xiaohu.transfrom.streamtranform; import org.apache.flink.streaming.api.datastream.DataStream; import org.apache.flink.streaming.api.datast 阅读全文

posted @ 2025-02-26 20:35 Xiaohu_BigData 阅读(10) 评论(0) 推荐(0)

Flink1.18 Transfrom - 分流【侧输出流 ProcessFunction】

摘要：package com.xiaohu.transfrom.streamtranform; import com.xiaohu.bean.WaterSensor; import com.xiaohu.transfrom.MyPartitioner; import org.apache.flink.ap 阅读全文

posted @ 2025-02-26 20:35 Xiaohu_BigData 阅读(34) 评论(0) 推荐(0)

Flink1.18 Transfrom - 分流【Filter】

摘要：package com.xiaohu.transfrom.streamtranform; import com.xiaohu.transfrom.MyPartitioner; import org.apache.flink.api.java.functions.KeySelector; import 阅读全文

posted @ 2025-02-26 20:33 Xiaohu_BigData 阅读(13) 评论(0) 推荐(0)

Flink1.18 Transfrom - CustomPartition自定义分区器

摘要：自定义分区类，实现Partitioner接口 package com.xiaohu.transfrom; import org.apache.flink.api.common.functions.Partitioner; public class MyPartitioner implements P 阅读全文

posted @ 2025-02-26 20:32 Xiaohu_BigData 阅读(52) 评论(0) 推荐(0)

Flink1.18 Transfrom - 分区器【7种现成】

摘要：package com.xiaohu.transfrom; import org.apache.flink.configuration.Configuration; import org.apache.flink.streaming.api.datastream.DataStreamSource; 阅读全文

posted @ 2025-02-26 20:31 Xiaohu_BigData 阅读(20) 评论(0) 推荐(0)

Flink1.18 Transfrom - Reduce

摘要：package com.xiaohu.transfrom; import com.xiaohu.bean.WaterSensor; import org.apache.flink.api.common.functions.ReduceFunction; import org.apache.flink 阅读全文

posted @ 2025-02-26 20:30 Xiaohu_BigData 阅读(13) 评论(0) 推荐(0)

Flink1.18 Transfrom - SimpleAggregate简单聚合算子

摘要：package com.xiaohu.transfrom; import com.xiaohu.bean.WaterSensor; import org.apache.flink.api.java.functions.KeySelector; import org.apache.flink.stre 阅读全文

posted @ 2025-02-26 20:29 Xiaohu_BigData 阅读(21) 评论(0) 推荐(0)

Flink1.18 Transfrom - RichFunction

摘要：package com.xiaohu.transfrom; import com.xiaohu.bean.WaterSensor; import org.apache.flink.api.common.functions.RichFilterFunction; import org.apache.f 阅读全文

posted @ 2025-02-26 20:28 Xiaohu_BigData 阅读(19) 评论(0) 推荐(0)

Flink1.18 Transfrom - KeyBy

摘要：package com.xiaohu.transfrom; import com.xiaohu.bean.WaterSensor; import org.apache.flink.api.java.functions.KeySelector; import org.apache.flink.stre 阅读全文

posted @ 2025-02-26 20:28 Xiaohu_BigData 阅读(23) 评论(0) 推荐(0)

Flink1.18 Transfrom - Filter

摘要：package com.xiaohu.transfrom; import com.xiaohu.bean.WaterSensor; import org.apache.flink.api.common.functions.FilterFunction; import org.apache.flink 阅读全文

posted @ 2025-02-26 20:27 Xiaohu_BigData 阅读(20) 评论(0) 推荐(0)

Flink1.18 Transfrom - flatMap

摘要：package com.xiaohu.transfrom; import com.xiaohu.bean.WaterSensor; import org.apache.flink.api.common.functions.FlatMapFunction; import org.apache.flin 阅读全文

posted @ 2025-02-26 20:26 Xiaohu_BigData 阅读(11) 评论(0) 推荐(0)

Flink1.18 Transfrom - Map

摘要：package com.xiaohu.transfrom; import com.xiaohu.bean.WaterSensor; import com.xiaohu.implclass.MyMapFunction1; import org.apache.flink.api.common.event 阅读全文

posted @ 2025-02-26 20:25 Xiaohu_BigData 阅读(9) 评论(0) 推荐(0)

Xiaohu_BigData

随笔分类 - Flink

公告