摘要:
create table abc(A int,B int) Select A,count(B) as total from ABC group by A Select A,count(B) as total1 from ABC where B > 30 group by A Select A,cou 阅读全文
摘要:
1.Sqoop Could not load db driver class: com.mysql.jdbc.Driver 缺少mysql jar 解决办法: 上传mysql的jar包,移动到sqoop的lib目录下 mv mysql-connector-java-5.1.47.jar /opt/c 阅读全文
摘要:
1.foreach val list = new ArrayBuffer() myRdd.foreach(record => { list += record }) 2.foreachPartition val list = new ArrayBuffer rdd.foreachPartition( 阅读全文
摘要:
报错信息: System memory 259522560 must be at least 471859200. Please increase heap size using the --driver-mem spark连接hadoop集群 解决方法: 这主要是运行内存的问题,所以我们在运行的时 阅读全文