随笔分类 -  Yarn

yarn app启动过程
摘要：CapacityScheduler.addApplication() →RMAppImpl.handle() // .addTransition(RMAppState.SUBMITTED, RMAppState.ACCEPTED, RMAppEventType.APP_ACCEPTED, new S 阅读全文
posted @ 2021-12-17 17:25 Yu\.W 阅读(150) 评论(0) 推荐(0)
Nodemanager Container启动过程
摘要：default_container_executor.sh #!/bin/bash /bin/bash "/tmp/hadoop-yarn/nm-local-dir/usercache/hive/appcache/application_1631589808308_0023/container_e2 阅读全文
posted @ 2021-12-10 11:44 Yu\.W 阅读(325) 评论(0) 推荐(0)
NodeManager Recovery特性对Tez任务的影响
摘要：NodeManager退出对ResourceManager的影响 在直接kill nodemanager进程 或 执行/opt/hadoop/bin/yarn --daemon stop nodemanager，并且没有设置recovery时，resourcemanager上状态改为shutdown 阅读全文
posted @ 2021-09-29 16:12 Yu\.W 阅读(228) 评论(0) 推荐(0)