CDH执行spark任务

1、cdh执行spark任务(直接在yarn执行)

spark2-submit \
--master yarn \
--num-executors 1 \
--executor-cores 1 \
--executor-memory 1G \
--class org.apache.spark.examples.SparkPi \
/opt/cloudera/parcels/SPARK2/lib/spark2/examples/jars/spark-examples_2.11-2.2.0.cloudera2.jar

 

posted @ 2020-11-12 18:01  小白啊小白，Fighting  阅读(1336)  评论(0)    收藏  举报