2020 年 12月 29 日随笔档案 - 船长博客

2020年12月29日

摘要： scala> val df = sc.parallelize(Seq( (0,"cat26",30.9), (1,"cat67",28.5), (2,"cat56",39.6), (3,"cat8",35.6))).toDF("Hour", "Category", "Value") scala> d 阅读全文

posted @ 2020-12-29 20:22 船长博客阅读(350) 评论(0) 推荐(0)

Spark 取前几行,先sort再limit

摘要： scala> val df = sc.parallelize(Seq( | (0,"cat26",30.9), | (1,"cat67",28.5), | (2,"cat56",39.6), | (3,"cat8",35.6))).toDF("Hour", "Category", "Value") 阅读全文

posted @ 2020-12-29 20:20 船长博客阅读(1209) 评论(0) 推荐(1)

Spark DataFrame选取多列

摘要： val df = sc.parallelize(Seq( (0,"cat26",30.9), (1,"cat67",28.5), (2,"cat56",39.6), (3,"cat8",35.6))).toDF("Hour", "Category", "Value") //或者从文件读取成List 阅读全文

posted @ 2020-12-29 20:14 船长博客阅读(2129) 评论(0) 推荐(1)

公告