hadoop 学习

 官网地址：http://hadoop.apache.org/

 简单学习一下hadoop的安装：

 1.下载

  我下载的是hadoop 1.0.3

 2. 伪分布式配置：

  a. core-site.xml 

 <configuration>
         <property>
                   <name>fs.default.name</name>
                    <value>hdfs://localhost:9000</value>
         </property>
</configuration>

b.hdfs-site.xml

  1 <?xml version="1.0"?>
  2 <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
  3 
  4 <!-- Put site-specific property overrides in this file. -->
  5 
  6 <configuration>
  7         <property>:
  8                 <name>dfs.replication</name>
  9                 <value>1</value>
 10         </property>
 11         <property>
 12                 <name>dfs.name.dir</name>
 13                 <value>/home/xx/data/name</value>
 14         </property>
 15         <property>
 16                 <name>dfs.data.dir</name>
 17                 <value>/home/xx/data/data</value>
 18         </property>
 19         <property>
 20                 <name>dfs.support.append</name>
 21                 <value>true</value>
 22         </property>
 23         <property>
 24                 <name>dfs.datanode.max.xcievers</name>
 25                 <value>4096</value>
 26         </property>
 27 </configuration>

　c. 指定JAVA_HOME

     最好是sun-java 6

3.启动hadoop

    bin/start-all.sh

   用jps查看

Picked up _JAVA_OPTIONS: -Dawt.useSystemAAFontSettings=on
5604 ThriftServer
12750 Main
18148 Jps
4208 SecondaryNameNode
3981 DataNode
3768 NameNode
xxx@HP-ProBook-4411s:~/tools/hadoop-1.0.3/bin$ 

　　会发现比原来多了二个DataNode, NameNode

4.测试

  bin/hadoop fs -ls /

 如果能正常显示表示安装正常