随笔分类 -  大数据 / pyspark

摘要:pyspark学习官网:https://spark.apache.org/docs/latest/api/python/index.html 一.环境搭建 参考官网:https://spark.apache.org/docs/latest/api/python/user_guide/python_p 阅读全文
posted @ 2023-08-03 23:33 冰底熊 阅读(415) 评论(0) 推荐(0)
摘要:from pyspark import SparkConf,SparkContext from pyspark.sql import SparkSession import json def make_data(line): data = json.loads(line) h = data.get( 阅读全文
posted @ 2021-09-17 07:30 冰底熊