|NO.Z.00049|——————————|BigDataEnd|——|Hadoop&实时数仓.V29|——|项目.v29|需求三:数据处理&增量统计广告.V3|——|编程实现|

一、编程实现:每隔5秒统计最近1小时内广告的点击量$增量统计
### --- 编程实现:工具类一:SourceKafka

package myutils

import java.util.Properties
import org.apache.flink.api.common.serialization.SimpleStringSchema
import org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

class SourceKafka {
  def getKafkaSource(topicName: String) : FlinkKafkaConsumer[String] = {
    val props = new Properties()
    props.setProperty("bootstrap.servers","hadoop01:9092,hadoop02:9092,hadoop03:9092");//3,4
    props.setProperty("group.id","consumer-group")
    props.setProperty("key.deserializer","org.apache.kafka.common.serialization.StringDeserializer")
    props.setProperty("value.deserializer","org.apache.kafka.common.serialization.StringDeserializer")
    props.setProperty("auto.offset.reset","la")

    new FlinkKafkaConsumer[String](topicName, new SimpleStringSchema(),props);
  }
}
二、编程实现:样例类
### --- 编程实现:样例类一:CountByProductAd

package modes

case class CountByProductAd(windowEnd:String,productId:String,cont:Long)
### --- 编程实现:样例类二:AdClick

package modes

case class AdClick(area: String, uid:String ,productId: String,timestamp:Long)

 
 
 
 
 
 
 
 
 

Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart
                                                                                                                                                   ——W.S.Landor

 

 

posted on 2022-04-16 14:05  yanqi_vip  阅读(22)  评论(0)    收藏  举报

导航