09 2021 档案

centOS7 安装python3.6.5 与 pyCharm搭建pyspark开发环境
摘要：Linux版本：centos7.4 一、安装python3先安装Python3的依赖包 yum install epel-release yum -y install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel re 阅读全文
posted @ 2021-09-30 18:57 举个栗子，举个锤子 阅读(447) 评论(0) 推荐(0)
成功案例--Spark-2.3.0源码make-distribution.sh打包编译或Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-tags_2.11
摘要：[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-tags_2.11: Execution scala-c 阅读全文
posted @ 2021-09-28 22:04 举个栗子，举个锤子 阅读(1823) 评论(0) 推荐(0)
Hadoop & Spark 各组件以及机制图解
摘要：MapReduce on YARN: MapReduce has undergone a complete overhaul in hadoop-0.23 and we now have, what we call, MapReduce 2.0 (MRv2) or YARN. The fundame 阅读全文
posted @ 2021-09-15 18:02 举个栗子，举个锤子 阅读(165) 评论(0) 推荐(0)