随笔分类 -  Flink 1.10 流处理

Flink处理--异步IO
摘要：async import com.alibaba.fastjson.JSONObject; import org.apache.commons.io.IOUtils; import org.apache.flink.configuration.Configuration; import org.ap 阅读全文
posted @ 2021-12-03 00:56 空归
Flink 流处理-- 小技巧
摘要：01 //3. 将读取出来的json字符串转换为ItcastDataObj SingleOutputStreamOperator<ItcastDataObj> vehicleDataStream = source.map( new MapFunction<String, ItcastDataObj> 阅读全文
posted @ 2021-12-03 00:51 空归
工具类
摘要：ConfigLoader import org.slf4j.Logger; import org.slf4j.LoggerFactory; import java.io.IOException; import java.io.InputStream; import java.util.Propert 阅读全文
posted @ 2021-12-03 00:46 空归
Flink流处理-pom文件
摘要：整体pom.xml <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instan 阅读全文
posted @ 2021-11-08 01:04 空归
Flink流处理的resources文件
摘要：conf.properties # mysql configuration jdbc.driver=com.mysql.jdbc.Driver jdbc.url=jdbc:mysql://node03:3306/vehicle_networking?characterEncoding=utf8&us 阅读全文
posted @ 2021-11-08 01:01 空归
Flink流处理-Function之(flatmap, map, window)
摘要：flatmap package pers.aishuang.flink.streaming.function.flatmap; import org.apache.flink.streaming.api.functions.co.RichCoFlatMapFunction; import org.a 阅读全文
posted @ 2021-11-08 00:58 空归
Flink流处理-Entity之Model
摘要：DataPartObj package pers.aishuang.flink.streaming.entity; import lombok.AllArgsConstructor; import lombok.Data; import lombok.NoArgsConstructor; /** * 阅读全文
posted @ 2021-11-08 00:54 空归
Flink流处理-Sink之Mysql
摘要：ElectricFenceMysqlSink package pers.aishuang.flink.streaming.sink.mysql; import com.ibm.icu.text.SimpleDateFormat; import org.apache.flink.api.java.ut 阅读全文
posted @ 2021-11-08 00:51 空归
Flink流处理-Sink之HBase
摘要：TripDriveToHBaseSink package pers.aishuang.flink.streaming.sink.hbase; import org.apache.flink.api.java.utils.ParameterTool; import org.apache.flink.c 阅读全文
posted @ 2021-11-08 00:50 空归
Flink流处理-Source之Mysql
摘要：MysqlEletricFenceResultSource package pers.aishuang.flink.streaming.source.mysql; import org.apache.flink.api.java.utils.ParameterTool; import org.apa 阅读全文
posted @ 2021-11-08 00:46 空归
Flink流处理-Task之ElectricFenceTask
摘要：ElectricFenceTask package pers.aishuang.flink.streaming.task; import com.mysql.jdbc.StringUtils; import org.apache.flink.api.common.serialization.Simp 阅读全文
posted @ 2021-11-08 00:41 空归
Flink流处理-Task之TripDriveTask
摘要：Task之TripDriveTask package pers.aishuang.flink.streaming.task; import org.apache.commons.lang.StringUtils; import org.apache.flink.api.common.serializ 阅读全文
posted @ 2021-11-08 00:40 空归
Flink流处理-Task之OnlineStatisticsTask
摘要：OnlineStatisticsTask package pers.aishuang.flink.streaming.task; import org.apache.commons.lang.StringUtils; import org.apache.flink.api.common.serial 阅读全文
posted @ 2021-11-08 00:39 空归
Flink流处理-Task之KafkaSourceDataTask
摘要：KafkaSourceDataTask package pers.aishuang.flink.streaming.task; import org.apache.flink.api.common.functions.MapFunction; import org.apache.flink.api. 阅读全文
posted @ 2021-11-08 00:38 空归
Flink流处理-Task之BaseTask
摘要：BaseTask package pers.aishuang.flink.streaming.task; import org.apache.flink.api.common.restartstrategy.RestartStrategies; import org.apache.flink.api 阅读全文
posted @ 2021-11-08 00:36 空归
Flink流处理-Flink集成Kafka
摘要：FlinkKafkaConsumer package pers.aishuang.producer; import org.apache.flink.api.common.serialization.SimpleStringSchema; import org.apache.flink.stream 阅读全文
posted @ 2021-11-08 00:18 空归