大数据集群之Cloudera Manager部署HUE

　　　　　　　　　　　　　　　　　　　　大数据集群之Cloudera Manager部署HUE

一、添加HUE服务

1、进入CM服务安装向导

2、选择需要安装的Hue服务

    点击继续的时候，提示安装hive和oozie这些同时依赖yarn(MR2 Included)

    注：/var/lib/hadoop-yarn/yarn-nm-recovery/yarn-nm-state/LOCK: Permission denied
    在安装yarn过程中，启动的时候可能会提示这个错误，
    ll /var/lib|grep hadoop-yarn 会发现是000权限。
    chmod 755 /var/lib/hadoop-yarn #各节点都需要操作
    然后重启试就OK了

 

3、为hue选择依赖环境

 

4、为hue分配角色

[root@hexindai-c12-126 ~]# yum -y install httpd mod_ssl #需要注意的是，在Load Balancer节点上需要安装HUE的依赖包。否则Load Balancer启动将失败

5、数据库设置

6、hue服务安装完毕

 

 7、在CM可以看到Hue服务

 

 

二、HUE中导入测试数据

1、点击HUE服务

2、点击HUE的WEB登录界面

hue的Load Balancer启动不了有下以错误提示：

+ perl -pi -e 's#{{HUE_HOME}}#/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue#g' /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/httpd.conf /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/hue.conf /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/supervisor.conf
Can't open /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/supervisor.conf: Permission denied, <> line 274.
+ perl -pi -e 's#{{CLOUDERA_HTTPD_CONF_DIR}}#/run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER#g' /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/httpd.conf /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/hue.conf /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/supervisor.conf
Can't open /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/supervisor.conf: Permission denied, <> line 274.
+ perl -pi -e 's#{{CLOUDERA_HTTPD_LOG_DIR}}#/var/log/hue-httpd#g' /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/httpd.conf /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/hue.conf /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/supervisor.conf
Can't open /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/supervisor.conf: Permission denied, <> line 274.
+ perl -pi -e 's#{{CLOUDERA_HTTPD_MODULE_DIR}}#/usr/lib64/httpd/modules#g' /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/httpd.conf /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/hue.conf /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/supervisor.conf
Can't open /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/supervisor.conf: Permission denied, <> line 274.
+ replace_conf_dir
+ echo CONF_DIR=/run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER
+ echo CMF_CONF_DIR=/etc/cloudera-scm-agent
+ EXCLUDE_CMF_FILES=('cloudera-config.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' 'config.zip' 'proc.json' '*.log' '*.keytab' '*jceks')
++ printf '! -name %s ' cloudera-config.sh hue.sh impala.sh sqoop.sh supervisor.conf config.zip proc.json '*.log' '*.keytab' '*jceks'
+ find /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER -type f '!' -path '/run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/logs/*' '!' -name cloudera-config.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name config.zip '!' -name proc.json '!' -name '*.log' '!' -name '*.keytab' '!' -name '*jceks' -exec perl -pi -e 's#{{CMF_CONF_DIR}}#/run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER#g' '{}' ';'
+ [[ ! -d /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/run ]]
+ CLOUDERA_HTTPD_CONF=/run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/httpd.conf
+ CLOUDERA_HUE_CONF=/run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/hue.conf
+ perl -pi -e 's#{{CLOUDERA_HTTPD_SSL_SCRIPT_DIR}}#/usr/lib64/cmf/service/common#g' /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/hue.conf
+ /usr/sbin/httpd -f /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/httpd.conf -t
httpd: Could not open configuration file /run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/httpd.conf: Permission denied
+ '[' 1 '!=' 0 ']'
+ echo '/run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/httpd.conf is invalid'
/run/cloudera-scm-agent/process/216-hue-HUE_LOAD_BALANCER/httpd.conf is invalid
+ exit 1

该错误提示的解决方法：

　　　yum -y install httpd mod_ssl  #若已经安装还是有相应的提示执行可看一下selinux相关

　　　　[root@hexindai-c12-126 ~]# egrep -v '^#|^$' /etc/sysconfig/selinux  
　　　　SELINUX=disabled
　　　　SELINUXTYPE=targeted

　　　　[root@hexindai-c12-126 ~]# getenforce
　　　　Enforcing
　　　　[root@hexindai-c12-126 ~]# setenforce 0
　　　　[root@hexindai-c12-126 ~]# getenforce  
　　　　Permissive

然后重启服务就OK了。

3、自定义Hue的默认用户名和密码

4、登录Hue界面

5、点击当前hdfs用户，选中"Hue Administration"

6、点击"Step2 Examples"，点击"hive"关键字，可以安装相应的测试数据

  chmod 755 /var/lib/hadoop-httpfs
  chown -R httpfs.httpfs /var/lib/hadoop-httpfs/  
#给目录权限后，重启httpfs就OK了

我们看到setup2:

 

 7、等待安装完成

 

8、查看相应的测试数据

 9、登录hive查看发现有相应的测试数据

 

 

 

https://www.cnblogs.com/yinzhengjie/p/10940648.html