书灯 - 博客园

2017年7月19日

摘要： import org.apache.spark.{SparkConf, SparkContext} import scala.collection.mutable.ArrayBuffer /** * Created by liupeng on 2017/6/16. */ object T_repar 阅读全文

posted @ 2017-07-19 09:39 书灯阅读(15) 评论(0) 推荐(0)

spark--transform算子--reduceByKey

摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object T_reduceByKey { System.setProperty("hadoop.home.dir 阅读全文

posted @ 2017-07-19 09:06 书灯阅读(5) 评论(0) 推荐(0)

2017年7月18日

spark--transform算子--parallelized

摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/15. */ object T_parallelized { System.setProperty("hadoop.home.di 阅读全文

posted @ 2017-07-18 21:56 书灯阅读(18) 评论(0) 推荐(0)

spark--transform算子--mapPartitionsWithIndex

摘要： import org.apache.spark.{SparkConf, SparkContext} import scala.collection.mutable.ArrayBuffer /** * Created by liupeng on 2017/6/15. */ object T_mapPa 阅读全文

posted @ 2017-07-18 21:52 书灯阅读(21) 评论(0) 推荐(0)

spark--transform算子--mapPartitions

摘要： import org.apache.spark.{SparkConf, SparkContext} import scala.collection.immutable.HashMap import scala.collection.mutable.ArrayBuffer /** * Created 阅读全文

posted @ 2017-07-18 21:46 书灯阅读(15) 评论(0) 推荐(0)

spark--transform算子--map

摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/15. */ object T_map { System.setProperty("hadoop.home.dir","F:\\h 阅读全文

posted @ 2017-07-18 21:43 书灯阅读(3) 评论(0) 推荐(0)

spark--transform算子--join

摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object T_join { System.setProperty("hadoop.home.dir","F:\\ 阅读全文

posted @ 2017-07-18 21:38 书灯阅读(8) 评论(0) 推荐(0)

spark--transform算子--intersection

摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object T_intersection { System.setProperty("hadoop.home.di 阅读全文

posted @ 2017-07-18 21:24 书灯阅读(4) 评论(0) 推荐(0)

spark--transform算子--groupByKey

摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object T_groupByKey { System.setProperty("hadoop.home.dir" 阅读全文

posted @ 2017-07-18 11:42 书灯阅读(8) 评论(0) 推荐(0)

spark--transform算子--flatMap

摘要： import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object T_flatMap { System.setProperty("hadoop.home.dir","F 阅读全文

posted @ 2017-07-18 11:41 书灯阅读(11) 评论(0) 推荐(0)

书灯

公告