| | | |

2020年5月2日

摘要： 1 package com.ds 2 3 import org.apache.spark.sql.{Dataset, SparkSession} 4 5 object DataSet { 6 7 def main(args: Array[String]): Unit = { 8 val spark: 阅读全文

posted @ 2020-05-02 10:15 八旗格格的家阅读(143) 评论(0) 推荐(0)

spark_sql_DataFromMysql_InferringSchema_SparkSqlSchema_SparkSqlToMysql_SparkStreaming_Flume_Poll

摘要： 1 package com.spark_sql 2 3 import java.util.Properties 4 import org.apache.spark.sql.{DataFrame, SparkSession} 5 6 object DataFromMysql { 7 def main( 阅读全文

posted @ 2020-05-02 10:13 八旗格格的家阅读(150) 评论(0) 推荐(0)

StreamFromKafka

摘要： 1 package com.demo.SparkStreamingKafka_Receiver_checkpoint 2 3 import org.apache.kafka.clients.consumer.ConsumerRecord 4 import org.apache.kafka.commo 阅读全文

posted @ 2020-05-02 10:08 八旗格格的家阅读(178) 评论(0) 推荐(0)

SparkStreaming_Flume_Poll

摘要： 1 package com.SparkStreaming_Flume_Poll 2 3 import java.net.InetSocketAddress 4 import org.apache.spark.storage.StorageLevel 5 import org.apache.spark 阅读全文

posted @ 2020-05-02 10:06 八旗格格的家阅读(152) 评论(0) 推荐(0)

北京市 country

摘要： 1 package com.demo 2 3 import org.apache.spark.sql.SQLContext 4 import org.apache.spark.{SparkConf, SparkContext} 5 6 object Country { 7 def main(args 阅读全文

posted @ 2020-05-02 10:05 八旗格格的家阅读(173) 评论(0) 推荐(0)