随笔分类 -  Spark

spark_运行spark-shell报错_javax.jdo.JDOFatalDataStoreException: Unable to open a test connection to the given database.
摘要：error: Caused by: javax.jdo.JDOFatalDataStoreException: Unable to open a test connection to the given database. JDBC url = jdbc:mysql://sd-9c1f-2eac:3 阅读全文
posted @ 2017-03-15 11:33 天天好心情啊 阅读(5455) 评论(0) 推荐(0)
spark_load csv to hive via hivecontext
摘要：//prepare csv //Processing and inserting data in hive without schema //permission issues as user hive // org.apache.hadoop.hive.ql.metadata.HiveExcept 阅读全文
posted @ 2017-03-15 11:18 天天好心情啊 阅读(947) 评论(0) 推荐(0)
spark_spark连接hive config
摘要：1 环境 hadoop2.7.3 apache-hive-2.1.1-bin spark-2.1.0-bin-hadoop2.6 jdk1.8 2 配置文件 在hive-site.xml中配置mysql数据库连接。 cp apache-hive-2.1.1-bin/conf/hive-site.xm 阅读全文
posted @ 2017-03-14 17:52 天天好心情啊 阅读(826) 评论(0) 推荐(0)
build spark
摘要：Error : Failed to find Spark jars directory (/home/pl62716/spark-2.2.0-SNAPSHOT/assembly/target/scala-2.10/jars).You need to build Spark with the targ 阅读全文
posted @ 2017-02-27 09:41 天天好心情啊 阅读(1518) 评论(0) 推荐(0)