【1】 Expected only partition pruning predicates
解决方案:设置spark.sql.hive.metastorePartitionPruning=false

【2】 Error in query: Detected cartesian product for INNER join between logical plans
Project-Join condition is missing or trivial.
Use the CROSS JOIN syntax to allow cartesian products between these relations

   解决方案:设置spark.sql.crossJoin.enabled=true

   可以在scala代码中添加 sqlC.sql("set spark.sql.crossJoin.enabled=true")

  可以在Spark句群中配置;

 

posted on 2019-05-17 10:45  脆皮软心  阅读(488)  评论(0编辑  收藏  举报