Yarn-Resource报错: Can not find any active RM. Will retry in next 7 seconds.

报错信息

yarn-resource界面报错信息:

Can not find any active RM. Will retry in next 7 seconds.
HA Zookeeper Connection State: TERMINATED

排查思路

[root@node03 zookeeperData]# netstat -nltp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      665/rpcbind         
tcp        0      0 192.168.122.1:53        0.0.0.0:*               LISTEN      1439/dnsmasq        
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      1155/sshd           
tcp        0      0 127.0.0.1:631           0.0.0.0:*               LISTEN      1156/cupsd          
tcp        0      0 192.168.182.113:8088    0.0.0.0:*               LISTEN      70979/java          
tcp        0      0 127.0.0.1:25            0.0.0.0:*               LISTEN      1383/master         
tcp        0      0 127.0.0.1:40702         0.0.0.0:*               LISTEN      62095/java          
tcp        0      0 0.0.0.0:8480            0.0.0.0:*               LISTEN      62208/java          
tcp        0      0 192.168.182.113:8033    0.0.0.0:*               LISTEN      70979/java          
tcp        0      0 0.0.0.0:8485            0.0.0.0:*               LISTEN      62208/java          
tcp        0      0 0.0.0.0:9864            0.0.0.0:*               LISTEN      62095/java          
tcp        0      0 0.0.0.0:9866            0.0.0.0:*               LISTEN      62095/java          
tcp        0      0 0.0.0.0:9867            0.0.0.0:*               LISTEN      62095/java          
tcp6       0      0 :::111                  :::*                    LISTEN      665/rpcbind         
tcp6       0      0 192.168.182.113:3888    :::*                    LISTEN      70562/java          
tcp6       0      0 :::8080                 :::*                    LISTEN      70562/java          
tcp6       0      0 :::34835                :::*                    LISTEN      70562/java          
tcp6       0      0 :::22                   :::*                    LISTEN      1155/sshd           
tcp6       0      0 ::1:631                 :::*                    LISTEN      1156/cupsd          
tcp6       0      0 ::1:25                  :::*                    LISTEN      1383/master         
tcp6       0      0 :::2181                 :::*                    LISTEN      70562/java          
tcp6       0      0 192.168.182.113:2888    :::*                    LISTEN      70562/java

将resourceManager关闭后发现无法启动,查看日志:

[root@node04 logs]#  tail --100 hadoop-root-resourcemanager-node04.log  | cat
2023-03-30 20:31:19,330 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: RM uses DefaultResourceCalculator which used only memory as resource-type but invalid resource-types specified {resource2=name: resource2, units: , type: COUNTABLE, value: 0, minimum allocation: 0, maximum allocation: 9223372036854775807, memory-mb=name: memory-mb, units: Mi, type: COUNTABLE, value: 0, minimum allocation: 1024, maximum allocation: 8192, vcores=name: vcores, units: , type: COUNTABLE, value: 0, minimum allocation: 1, maximum allocation: 4, resource1=name: resource1, units: G, type: COUNTABLE, value: 0, minimum allocation: 0, maximum allocation: 9223372036854775807}. Use DominantResourceCalculator instead to make effective use of these resource-types
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:346)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:425)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:819)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1224)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:318)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1506)
2023-03-30 20:31:19,334 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at node04/192.168.182.114
************************************************************/

解决办法

原因:官方文档有误

需要修改的内容, 去掉官网上带的s,resources -> resource

<configuration>
  <property>
    <name>yarn.resource-type</name>
    <value>resource1,resource2</value>
  </property>
  <property>
    <name>yarn.resource-type.resource1.units</name>
    <value>G</value>
  </property>
  <property>
    <name>yarn.resource-type.resource2.minimum</name>
    <value>1</value>
  </property>
  <property>
    <name>yarn.resource-type.resource2.maximum</name>
    <value>1024</value>
  </property>
</configuration>
[root@node04 hadoop]# yarn-daemon.sh start resourcemanager
WARNING: Use of this script to start YARN daemons is deprecated.
WARNING: Attempting to execute replacement "yarn --daemon start" instead.
Last login: Thu Mar 30 20:31:17 PDT 2023 on pts/1
[root@node04 hadoop]# jps
78433 QuorumPeerMain
21152 ResourceManager
53865 DataNode
21181 Jps
posted @ 2023-07-07 09:38  等不到的口琴  阅读(1030)  评论(0)    收藏  举报