2017年7月19日
spark--transform算子--union
摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object T_union { System.setProperty("hadoop.home.dir","F:\ 阅读全文
posted @ 2017-07-19 10:08 书灯 阅读(9) 评论(0) 推荐(0)
spark--transform算子--sortByKey
摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object T_sortByKey { System.setProperty("hadoop.home.dir", 阅读全文
posted @ 2017-07-19 10:05 书灯 阅读(8) 评论(0) 推荐(0)
spark--transform算子--sample
摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object T_sample { System.setProperty("hadoop.home.dir","F: 阅读全文
posted @ 2017-07-19 09:49 书灯 阅读(5) 评论(0) 推荐(0)
spark--transform算子--repartition
摘要： import org.apache.spark.{SparkConf, SparkContext} import scala.collection.mutable.ArrayBuffer /** * Created by liupeng on 2017/6/16. */ object T_repar 阅读全文
posted @ 2017-07-19 09:39 书灯 阅读(15) 评论(0) 推荐(0)
spark--transform算子--reduceByKey
摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object T_reduceByKey { System.setProperty("hadoop.home.dir 阅读全文
posted @ 2017-07-19 09:06 书灯 阅读(5) 评论(0) 推荐(0)