yarn

yarn集群配置

yarn集群中有两个角色:

主节点:Resource Manager 1台

从节点:Node Manager N台

Resource Manager一般安装在一台专门的机器上

Node Manager应该与HDFS中的data node重叠在一起

1.vim yarn-site.xml

	<property>
		<name>yarn.resourcemanager.hostname</name>
		<value>pengyy22</value>
	</property>
	<property>
		<name>yarn.nodemanager.aux-services</name>
		<value>mapreduce_shuffle</value>
	</property>
	<property>
		<name>yarn.nodemanager.resource.memory-mb</name>
		<value>2048</value>
	</property>
	<property>
		<name>yarn.nodemanager.resource.cpu-vcores</name>
		<value>2</value>
	</property>

2.远程复制

scp yarn-site.xml pengyy42:$PWD
scp yarn-site.xml pengyy43:$PWD
scp yarn-site.xml pengyy44:$PWD

3.启动、停止 yarn (yarn启动要在 resourcemanager 服务器上开启)

start-yarn.sh
stop-yarn.sh
posted @ 2019-08-07 22:23  心随沙动  阅读(152)  评论(0)    收藏  举报