08 2018 档案

hive-连接查询
摘要：内连接查询hive> select * from customer as c , orderInfo as o where c.id = o.cid;11 tom1 1 cc price1 1112 tom2 2... 阅读全文
posted @ 2018-08-28 17:21 crr121 阅读(384) 评论(0) 推荐(0)
idea从github克隆代码"clone failed could not read from remote repository"
摘要：我所做的：在本地生成公钥和私钥，然后将公钥复制到github中的ssh keys$ ssh-keygen -t rsa -C "username"#the username is the account of your github $ cat ~/.ssh/id_r... 阅读全文
posted @ 2018-08-23 11:58 crr121 阅读(948) 评论(0) 推荐(0)
IndentationError: unexpected indent
摘要：jupyter notebook 执行命令的时候报错：IndentationError: unexpected indent （意外的缩进）resolution：去掉空格 阅读全文
posted @ 2018-08-22 10:15 crr121 阅读(720) 评论(0) 推荐(0)
jupyter notebook 中打开ipynb文件时报错 NameError: name 'true' is not defined
摘要：在jupyter notebook 中打开ipynb文件时报错：File "e:\python36\lib\site-packages\traitlets\config\loader.py", line 457, in load_config self._re... 阅读全文
posted @ 2018-08-20 19:28 crr121 阅读(3927) 评论(0) 推荐(0)
TypeError: Only length-1 arrays can be converted to Python scalars
摘要：#p1Vect也是一个向量 p1Vect = math.log(p1Num / p1Denom) p0Vect = math.log(p0Num / p0Denom)报错如下：TypeError: Only length-1 arrays can be ... 阅读全文
posted @ 2018-08-19 11:26 crr121 阅读(1391) 评论(0) 推荐(0)
hive创建桶表
摘要：创建桶表hive> create table house_1(id int,name string,age int) clustered by (id) into 3 buckets row format delimited fields terminated by ... 阅读全文
posted @ 2018-08-19 11:26 crr121 阅读(466) 评论(0) 推荐(0)
hive创建表-加载表数据-创建分区表
摘要：创建表（条件之间不能有逗号 fields terminated by ',' 字段之间以逗号分隔）0: jdbc:hive2://localhost:10000/cr> create table if not exists teacher(id int,name s... 阅读全文
posted @ 2018-08-19 11:26 crr121 阅读(1713) 评论(0) 推荐(0)
beeline连接数据库报错Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/cr: java.n
摘要：beeline> !connect jdbc:hive2://localhost:10000/crConnecting to jdbc:hive2://localhost:10000/crEnter username for jdbc:hive2://localhos... 阅读全文
posted @ 2018-08-19 11:26 crr121 阅读(8335) 评论(0) 推荐(0)
hive的访问：通过JDBC远程连接hive数据仓库
摘要：hive的访问：终端访问 远程访问终端访问：安装hive，利用shell脚本访问 不可并发访问远程访问：通过JDBC连接数据仓库 支持并发访问启动hiveserver2服务：查看该命令可知hiveserver2,等价于hive --service hiveserve... 阅读全文
posted @ 2018-08-19 11:26 crr121 阅读(956) 评论(0) 推荐(0)
beeline执行insert命令时报错Permission denied: user=anonymous, access=EXECUTE, inode="/tmp/hadoop-yarn":xiao
摘要：0: jdbc:hive2://localhost:10000/cr> insert into student values(4,'sunny');WARNING: Hive-on-MR is deprecated in Hive 2 and may not be a... 阅读全文
posted @ 2018-08-19 11:26 crr121 阅读(2062) 评论(0) 推荐(0)
hive初始化元数据 Access denied for user 'xiaoqiu'@'%' to database 'hive_metastore'
摘要：[xiaoqiu@s150 /soft/hive/conf]$ schematool -initSchema -dbType mysqlSLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found bi... 阅读全文
posted @ 2018-08-19 11:25 crr121 阅读(511) 评论(0) 推荐(0)
ERROR 1133 (42000): Can't find any matching row in the user table
摘要：当执行下面的命令时出现上述errorMariaDB [(none)]> grant all privileges on hive_meta.* to 'xiaoqiu'@'%';ERROR 1133 (42000): Can't find any matching r... 阅读全文
posted @ 2018-08-19 11:25 crr121 阅读(1677) 评论(0) 推荐(0)
MySQL新建用户无法登录
摘要：Access denied for user xiaoqiu@localhost (using password :NO) resolution:删除匿名用户（mysql.user表中user为空的用户）delete from user where mysql.us... 阅读全文
posted @ 2018-08-19 11:25 crr121 阅读(225) 评论(0) 推荐(0)
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
摘要：2018-08-06T13:40:10,699 ERROR [41e6cbb7-d859-4b90-8375-c9808c786abc main] metastore.RetryingHMSHandler: Retrying HMSHandler after 2000... 阅读全文
posted @ 2018-08-19 11:24 crr121 阅读(444) 评论(0) 推荐(0)
java.net.ConnectException: Call From s150/192.168.109.150 to s153:8020 failed on connection
摘要：java.net.ConnectException: Call From s150/192.168.109.150 to s153:8020 failed on connection exception: java.net.ConnectException: Conn... 阅读全文
posted @ 2018-08-19 11:24 crr121 阅读(626) 评论(0) 推荐(0)
hive执行insert语句时报错
摘要：错误提示如下：FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTaskMapReduce Jobs Launched:Stage-Stage-1:... 阅读全文
posted @ 2018-08-19 11:24 crr121 阅读(732) 评论(0) 推荐(0)
利用mapper实现表的连接
摘要：现在有两张表customer和order，需要通过customerid实现customer和order的连接mapperpackage com.cr.JoinMap;import org.apache.hadoop.conf.Configuration;import ... 阅读全文
posted @ 2018-08-19 11:24 crr121 阅读(290) 评论(0) 推荐(0)
reduce端的连接实现
摘要：背景：现在有两张表：customer、order，他们有个共同的cid,需要通过cid实现两张表的连接，并且通过cid进行分组排序思路：首先通过mapper从context里面获取到文件切片，从文件切片中得到路径，从而判断是customer.txt,还是order.t... 阅读全文
posted @ 2018-08-19 11:24 crr121 阅读(193) 评论(0) 推荐(0)
Failed to stop mariadb.service: Interactive authentication required.
摘要：换成root用户就可以了[root@s150 /home/xiaoqiu]# systemctl stop mariadb.service 阅读全文
posted @ 2018-08-19 11:24 crr121 阅读(2244) 评论(0) 推荐(0)
ERROR 1045 (28000): Access denied for user 'admin'@'localhost' (using password: YES)
摘要： 阅读全文
posted @ 2018-08-19 11:23 crr121 阅读(109) 评论(0) 推荐(0)
Underlying cause: java.sql.SQLException : Access denied for user 'root'@'s150' (using password: YES)
摘要：hive初始化元数据的时候出错，该root用户没有权限[xiaoqiu@s150 /soft/hive/conf]$ schematool -initSchema -dbType mysqlSLF4J: Class path contains multiple SLF... 阅读全文
posted @ 2018-08-19 11:23 crr121 阅读(1618) 评论(0) 推荐(0)
java.net.ConnectException: Call From s150/192.168.109.150 to s150:8020 failed on connection excepti
摘要：启动hive遇到连接的问题：Exception in thread "main" java.lang.RuntimeException: java.net.ConnectException: Call From s150/192.168.109.150 to s150... 阅读全文
posted @ 2018-08-19 11:23 crr121 阅读(1466) 评论(0) 推荐(0)
启动hive出现 org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyExceptio
摘要：启动hive出现standbyexception:Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoo... 阅读全文
posted @ 2018-08-19 11:22 crr121 阅读(2369) 评论(0) 推荐(0)
hive learing_1
摘要：1、什么是hivehive是基于Hadoop的一种数据库仓库工具，将结构化数据映射为一张数据表，并提供SQL查询，分析等功能2、hive的特点将数据结构（shema）存储在数据库中，数据存储在HDFS中 适用于联机分析处理（OLAP:on-line analytic ... 阅读全文
posted @ 2018-08-19 11:22 crr121 阅读(117) 评论(0) 推荐(0)
在hive中执行sql语句：SemanticException org.apache.hadoop.hive.ql.metadata.HiveException:
摘要：hive> show databases;FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to... 阅读全文
posted @ 2018-08-19 11:22 crr121 阅读(12384) 评论(0) 推荐(1)