[大数据入门]实战练习 安装Cloudera-Hadoop集群

实验环境规划

	Hostname	IP	OS	Roles
Machine 0	elephant	192.168.124.131
Machine 1	tiger	192.168.124.132
Machine 2	horse	192.168.124.133
Machine 3	monkey	192.168.124.134
Machine 4	lion	192.168.124.135

 

 

 

 

 

虚拟机软件

vagrant
virtualbox

　

修改/etc/hosts

192.168.124.131  elephant
192.168.124.132  tiger 
192.168.124.133  horse 
192.168.124.134  monkey 
192.168.124.137  lion

 

配置yum源

 

通过下面的文档查看repo信息

Cloudera Manager Version and Download Information

获取包来源

cd  /etc/yum.repos.d

wget https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/cloudera-manager.repo

 

安装 JDK

yum install -y oracle-j2sdk*

echo -e 'export JAVA_HOME=/usr/java/default' >> /etc/profile
alternatives --install /usr/bin/java  java /usr/java/jdk1.7.0_67-cloudera/bin/java 200
alternatives --set java /usr/java/jdk1.7.0_67-cloudera/bin/java
alternatives --install  /usr/bin/javac javac /usr/java/jdk1.7.0_67-cloudera/bin/javac 200
alternatives --set javac /usr/java/jdk1.7.0_67-cloudera/bin/javac

　　

设置数据库

数据库的指定，

默认的数据库，配置方法如下

    1.  确认安装数据库包

    2.  启动服务   service cloudera-scm-server-db start

[root@elephant x86_64]# service cloudera-scm-server-db start
The files belonging to this database system will be owned by user "cloudera-scm".
This user must also own the server process.

The database cluster will be initialized with locale en_US.UTF8.
The default text search configuration will be set to "english".

fixing permissions on existing directory /var/lib/cloudera-scm-server-db/data ... ok
creating subdirectories ... ok
selecting default max_connections ... 100
selecting default shared_buffers ... 32MB
creating configuration files ... ok
creating template1 database in /var/lib/cloudera-scm-server-db/data/base/1 ... ok
initializing pg_authid ... ok
setting password ... ok
initializing dependencies ... ok
creating system views ... ok
loading system objects' descriptions ... ok
creating conversions ... ok
creating dictionaries ... ok
setting privileges on built-in objects ... ok
creating information schema ... ok
vacuuming database template1 ... ok
copying template1 to template0 ... ok
copying template1 to postgres ... ok

Success. You can now start the database server using:

    postgres -D /var/lib/cloudera-scm-server-db/data
or
    pg_ctl -D /var/lib/cloudera-scm-server-db/data -l logfile start

Adding configs
Creating SCM configuration file: /etc/cloudera-scm-server/db.properties
waiting for server to start.... done
server started
CREATE ROLE
CREATE DATABASE
Created db properties file /etc/cloudera-scm-server/db.properties
Creating DB amon for role ACTIVITYMONITOR
CREATE ROLE
CREATE DATABASE
Created DB for role ACTIVITYMONITOR
Creating DB rman for role REPORTSMANAGER
CREATE ROLE
CREATE DATABASE
Created DB for role REPORTSMANAGER
Creating DB nav for role NAVIGATOR
CREATE ROLE
CREATE DATABASE
Created DB for role NAVIGATOR
Creating DB navms for role NAVIGATORMETASERVER
CREATE ROLE
CREATE DATABASE
Created DB for role NAVIGATORMETASERVER
Enabled remote connections
waiting for server to shut down.... done
server stopped
DB initialization done.
waiting for server to start.... done
server started

　　

使用mysql数据库，配置方法如下：

https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.13.0/