Linux搭建Hadoop环境

Hadoop 下载地址

https://archive.apache.org/dist/hadoop/common/hadoop-2.7.2/

上传安装包到 linux

上传到 /opt/software 目录下

解压安装包到某个目录

tar -zxvf hadoop-2.7.2.tar.gz -C /opt

将Hadoop添加到环境变量

获取Hadoop的安装路径

[root@hadoop101 hadoop-3.3.6]# pwd
/opt/hadoop-3.3.6

打开etc/profie文件

[root@hadoop101 hadoop-3.3.6]# vi /etc/profile

添加变量到文件末尾
shift+g 可以直接到达文件末尾

##HADOOP_HOME
export HADOOP_HOME=/opt/hadoop-3.3.6
export PATH=$PATH:$HADOOP_HOME/bin
export PATH=$PATH:$HADOOP_HOME/sbin

保存退出 :wq

让环境变量生效

[root@hadoop101 hadoop-3.3.6]# source /etc/profile

测试是否安装成功

[root@hadoop101 hadoop-3.3.6]# hadoop version
Hadoop 3.3.6
Source code repository https://github.com/apache/hadoop.git -r 1be78238728da9266a4f88195058f08fd012bf9c
Compiled by ubuntu on 2023-06-18T23:15Z
Compiled on platform linux-aarch_64
Compiled with protoc 3.7.1
From source with checksum 5652179ad55f76cb287d9c633bb53bbd
This command was run using /opt/hadoop-3.3.6/share/hadoop/common/hadoop-common-3.3.6.jar

Hadoop 目录结构说明

[root@hadoop101 hadoop-3.3.6]# ll
total 88
drwxr-xr-x. 2 1000 1000   203 Jun 18  2023 bin
drwxr-xr-x. 3 1000 1000    20 Jun 18  2023 etc
drwxr-xr-x. 2 1000 1000   106 Jun 18  2023 include
drwxr-xr-x. 3 1000 1000    20 Jun 18  2023 lib
drwxr-xr-x. 4 1000 1000   288 Jun 18  2023 libexec
-rw-rw-r--. 1 1000 1000 24276 Jun 13  2023 LICENSE-binary
drwxr-xr-x. 2 1000 1000  4096 Jun 18  2023 licenses-binary
-rw-rw-r--. 1 1000 1000 15217 Jun  7  2023 LICENSE.txt
-rw-rw-r--. 1 1000 1000 29473 Jun  7  2023 NOTICE-binary
-rw-rw-r--. 1 1000 1000  1541 Jun  7  2023 NOTICE.txt
-rw-rw-r--. 1 1000 1000   175 Jun  7  2023 README.txt
drwxr-xr-x. 3 1000 1000  4096 Jun 18  2023 sbin
drwxr-xr-x. 4 1000 1000    31 Jun 18  2023 share

（1）bin目录：存放对Hadoop相关服务（HDFS,YARN）进行操作的脚本
（2）etc目录：Hadoop的配置文件目录，存放Hadoop的配置文件
（3）lib目录：存放Hadoop的本地库（对数据进行压缩解压缩功能）
（4）sbin目录：存放启动或停止Hadoop相关服务的脚本
（5）share目录：存放Hadoop的依赖jar包、文档、和官方案例