spark - tasks is bigger than spark.driver.maxResultSize

 

  • set by SparkConf: conf.set("spark.driver.maxResultSize", "3g")
  • set by spark-defaults.conf: spark.driver.maxResultSize 3g
  • set when calling spark-submit: --conf spark.driver.maxResultSize=3g
posted @ 2018-04-03 23:05  chenzechao  阅读(551)  评论(0)    收藏  举报