Yarn-Resource报错: Can not find any active RM. Will retry in next 7 seconds.
报错信息
yarn-resource界面报错信息:
Can not find any active RM. Will retry in next 7 seconds.
HA Zookeeper Connection State: TERMINATED
排查思路
[root@node03 zookeeperData]# netstat -nltp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN 665/rpcbind
tcp 0 0 192.168.122.1:53 0.0.0.0:* LISTEN 1439/dnsmasq
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 1155/sshd
tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 1156/cupsd
tcp 0 0 192.168.182.113:8088 0.0.0.0:* LISTEN 70979/java
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN 1383/master
tcp 0 0 127.0.0.1:40702 0.0.0.0:* LISTEN 62095/java
tcp 0 0 0.0.0.0:8480 0.0.0.0:* LISTEN 62208/java
tcp 0 0 192.168.182.113:8033 0.0.0.0:* LISTEN 70979/java
tcp 0 0 0.0.0.0:8485 0.0.0.0:* LISTEN 62208/java
tcp 0 0 0.0.0.0:9864 0.0.0.0:* LISTEN 62095/java
tcp 0 0 0.0.0.0:9866 0.0.0.0:* LISTEN 62095/java
tcp 0 0 0.0.0.0:9867 0.0.0.0:* LISTEN 62095/java
tcp6 0 0 :::111 :::* LISTEN 665/rpcbind
tcp6 0 0 192.168.182.113:3888 :::* LISTEN 70562/java
tcp6 0 0 :::8080 :::* LISTEN 70562/java
tcp6 0 0 :::34835 :::* LISTEN 70562/java
tcp6 0 0 :::22 :::* LISTEN 1155/sshd
tcp6 0 0 ::1:631 :::* LISTEN 1156/cupsd
tcp6 0 0 ::1:25 :::* LISTEN 1383/master
tcp6 0 0 :::2181 :::* LISTEN 70562/java
tcp6 0 0 192.168.182.113:2888 :::* LISTEN 70562/java
将resourceManager关闭后发现无法启动,查看日志:
[root@node04 logs]# tail --100 hadoop-root-resourcemanager-node04.log | cat
2023-03-30 20:31:19,330 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: RM uses DefaultResourceCalculator which used only memory as resource-type but invalid resource-types specified {resource2=name: resource2, units: , type: COUNTABLE, value: 0, minimum allocation: 0, maximum allocation: 9223372036854775807, memory-mb=name: memory-mb, units: Mi, type: COUNTABLE, value: 0, minimum allocation: 1024, maximum allocation: 8192, vcores=name: vcores, units: , type: COUNTABLE, value: 0, minimum allocation: 1, maximum allocation: 4, resource1=name: resource1, units: G, type: COUNTABLE, value: 0, minimum allocation: 0, maximum allocation: 9223372036854775807}. Use DominantResourceCalculator instead to make effective use of these resource-types
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:346)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:425)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:819)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1224)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:318)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1506)
2023-03-30 20:31:19,334 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at node04/192.168.182.114
************************************************************/
解决办法
原因:官方文档有误
需要修改的内容, 去掉官网上带的s,resources -> resource
<configuration>
<property>
<name>yarn.resource-type</name>
<value>resource1,resource2</value>
</property>
<property>
<name>yarn.resource-type.resource1.units</name>
<value>G</value>
</property>
<property>
<name>yarn.resource-type.resource2.minimum</name>
<value>1</value>
</property>
<property>
<name>yarn.resource-type.resource2.maximum</name>
<value>1024</value>
</property>
</configuration>
[root@node04 hadoop]# yarn-daemon.sh start resourcemanager
WARNING: Use of this script to start YARN daemons is deprecated.
WARNING: Attempting to execute replacement "yarn --daemon start" instead.
Last login: Thu Mar 30 20:31:17 PDT 2023 on pts/1
[root@node04 hadoop]# jps
78433 QuorumPeerMain
21152 ResourceManager
53865 DataNode
21181 Jps