随笔分类 -  hadoop

spark支持kerberos配置
只有注册用户登录后才能阅读该文。

posted @ 2015-03-20 11:07 SYSTEM ADMINISTRATION

编译hadoop
摘要:基于操作系统CentOS 6.4 basic server版,编译hadoop版本2.5.21. 下载hadoop源代码包$ wget http://mirrors.cnnic.cn/apache/hadoop/common/hadoop-2.5.2/hadoop-2.5.2-src.tar.gz2... 阅读全文

posted @ 2015-01-12 13:46 SYSTEM ADMINISTRATION

启用ntp服务
摘要:1. 主服务器 修改配置vi /etc/ntp.conf restrict 192.168.2.0 mask 255.255.255.0 nomodify notrap #允许别的服务器同步 server 0.centos.pool.ntp.org iburst #主服务器自己的同步源 启动服务 s 阅读全文

posted @ 2014-09-17 17:19 SYSTEM ADMINISTRATION

安装hadoop
摘要:生成yum源cd/var/ftp/pub/cdh/5createrepo --update .从节点yum clean all配置yum库/etc/yum.repos.d# cat /etc/yum.repos.d/cloudera-cdh.repo [hadoop]name=hadoopbaseu... 阅读全文

posted @ 2014-07-29 16:33 SYSTEM ADMINISTRATION

安装cloudera
摘要:1. 查看selinux状态$ /usr/sbin/getenforceEnforcing$ /usr/sbin/sestatusSELinux status: enabledSELinuxfs mount: /selinuxCurren... 阅读全文

posted @ 2014-07-24 13:09 SYSTEM ADMINISTRATION

hive的元数据存储在mysql后,报错的解决方法!
摘要:http://www.cnblogs.com/Blueren/archive/2011/06/29/Sir_001.htmlhttp://blog.csdn.net/cindy9902/article/details/6215769 阅读全文

posted @ 2013-05-06 19:32 SYSTEM ADMINISTRATION

hive安装设置
摘要:注意点:1. 创建hive-site.xml文件(根据hive-default.xml.template) <name>javax.jdo.option.ConnectionURL</name> <name>javax.jdo.option.ConnectionDriverName</name><name>javax.jdo.option.ConnectionUserName</name><name>javax.jdo.option.ConnectionPassword</name> <nam 阅读全文

posted @ 2013-05-06 16:54 SYSTEM ADMINISTRATION

导航