12 2021 档案

[bugs] spark 报错：java.lang.IllegalArgumentException: Compression codec com.hadoop.compression.lzo.LzoCodec not found.
摘要：原因 spark缺少lzo包 参考 https://www.cnblogs.com/sunbr/p/14860364.html 阅读全文
posted @ 2021-12-31 06:33 cxc1357 阅读(252) 评论(0) 推荐(0)
[Python] Anoconda
摘要：参考 创建虚拟环境 https://www.cnblogs.com/haoyiyang/p/11309701.html https://blog.csdn.net/qq_41727666/article/details/83958957 更改 Python 版本 https://www.jiansh 阅读全文
posted @ 2021-12-30 23:43 cxc1357 阅读(55) 评论(0) 推荐(0)
[bug] spark-shell 报错： javax.jdo.JDOFatalInternalException: Error creating transactional connection factory
摘要：原因 缺少mysql连接库 参考 https://blog.csdn.net/weixin_46086427/article/details/107473106 https://blog.csdn.net/weixin_46086427/article/details/107474193 阅读全文
posted @ 2021-12-30 18:42 cxc1357 阅读(377) 评论(0) 推荐(0)
[bug] TypeError: namedtuple() missing 3 required keyword-only arguments: 'verbose', 'rename', and 'module'
摘要：参考 https://blog.csdn.net/gdkyxy2013/article/details/80164773 https://blog.csdn.net/u010916338/article/details/106108266/ 阅读全文
posted @ 2021-12-30 16:02 cxc1357 阅读(368) 评论(0) 推荐(0)
[bug] 每次都要执行source ~/.bash_profile
摘要：参考 https://blog.csdn.net/science_Lee/article/details/79214127 https://blog.51cto.com/u_15072917/3561287 阅读全文
posted @ 2021-12-30 14:44 cxc1357 阅读(61) 评论(0) 推荐(0)
[bug] Hive：Number of reduce tasks is set to 0 since there‘s no reduce operator
摘要：原因 没有开启yarn 参考 https://blog.csdn.net/werewolf2/article/details/109155093 阅读全文
posted @ 2021-12-20 13:38 cxc1357 阅读(1027) 评论(0) 推荐(0)
[bug] hive：FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
摘要：原因 元数据配置错误 参考 https://www.cnblogs.com/flyingcr/p/10326883.html 阅读全文
posted @ 2021-12-20 11:15 cxc1357 阅读(62) 评论(0) 推荐(0)