Hadoop2.6 伪分布式安装

1.下载解压

下载hadoop，（最新版本为2.6）解压到/usr/local/hadoop2.6

2.设置环境变量

1.1在.bashrc中设置hadoop相关的环境变量

export HADOOP_HOME=/usr/local/hadoop2.6

export PATH=$HADOOP_HOME/bin:$PATH

1.2.hadoop-env.sh中把JAVA_HOME指向JDK安装根目录，如下

# The java implementation to use.

export JAVA_HOME=/usr/java/jdk1.8

1.3.yarn-env.sh中把JAVA_HOME指向JDK安装根目录，如下

# some Java parameters

export JAVA_HOME=/usr/java/jdk1.8

3.Hadoop伪分布式配置

1.1core-site.xml

/usr/local/hadoop/etc/hadoop/core-site.xml

<configuration>

<property>

<name>hadoop.tmp.dir</name>

<value>/usr/local/hadoop/tmp</value>

<description>Abase for other temporary directories.</description>

</property>

<property>

<name>fs.defaultFS</name>

<value>hdfs://localhost:9000</value>

</property>

</configuration>

 

1.2yarn-site.xml

/usr/local/hadoop/etc/hadoop/yarn-site.xml

<configuration>

<property>

<name>mapreduce.framework.name</name>

<value>yarn</value>

</property>

 

<property>

<name>yarn.nodemanager.aux-services</name>

<value>mapreduce_shuffle</value>

</property>

</configuration>

 

1.3hdfs-site.xml

/usr/local/hadoop/etc/hadoop/hdfs-site.xml

<configuration>

<property>

<name>dfs.replication</name>

<value>1</value>

</property>

<property>

<name>dfs.namenode.name.dir</name>

<value>file:/usr/local/hadoop/dfs/name</value>

</property>

<property>

<name>dfs.datanode.data.dir</name>

<value>file:/usr/local/hadoop/dfs/data</value>

</property>

<property> //这个属性节点是为了防止后面eclopse存在拒绝读写设置的

<name>dfs.permissions</name>

<value>false</value>

</property>

</configuration>

 

4建立SSH无密码登录本机

1. 产生公私密钥

ssh-keygen –t dsa –P '' –f ~/.ssh/id_dsa

1. 复制公钥

cd ~/.ssh

id_dsa.pub >> authorized_keys

1. 单机回环ssh免密码登陆测试

ssh localhost

1. 参考资料

1. http://blog.csdn.net/ggz631047367/article/details/42426391
2. http://blog.csdn.net/ggz631047367/article/details/42460589
3. http://blog.csdn.net/ab198604/article/details/8250461