01 2021 档案

ReduceByKey和groupByKey部分源码区别
摘要：reduceByKey源码 def reduceByKey(partitioner: Partitioner, func: (V, V) => V): RDD[(K, V)] = self.withScope { combineByKeyWithClassTag[V]((v: V) => v, fu 阅读全文
posted @ 2021-01-24 09:24 不吃饭的猪 阅读(67) 评论(1) 推荐(0)
Bulk load学习总结以及异常处理
摘要：Bulk load学习总结以及异常处理异常:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException): No lease on /bank/output/_t 阅读全文
posted @ 2021-01-10 00:58 不吃饭的猪 阅读(1526) 评论(0) 推荐(0)