开启Spark history server

配置 spark-defaults.conf

spark.eventLog.enabled             true
spark.eventLog.dir                 file:///home/spark-2.1.1-bin-hadoop2.7/history_log
spark.history.update.interval      1
spark.history.retainedApplications 50
spark.history.ui.port              18080

 然后启动

sbin/start-history-server.sh /home/spark-2.1.1-bin-hadoop2.7/history_log

 

posted @ 2018-11-09 16:05  编程柚子  阅读(925)  评论(0)    收藏  举报