[DB] CDH集群规划

配置

• 三台机器：node01、node02、node03
• node01：6G+60G
• node02：2G+40G
• node03：2G+40G

组件

Cloudera Managerment Service

• Service Monitor：node01
• Activity Monitor：node01
• Host Monitor：node01
• Event Server：node01
• Alert Publisher：node01

HDFS

• NameNode：node01
• Secondary NameNode：node01
• DataNode：node01、node02、node03

Yarn

• ResourceManager：node01
• NodeManager：node01、node02、node03
• JobHistory Server：node03

Zookeeper

• Server：node01、node02、node03

HBase

• HMaster：node01、node02
• RegionServer：node01、node02、node03

Hive

• HiveServer2：node01
• Metastore：node01
• Gateway：node01、node02、node03

Kafka

Spark

• Gateway：node01、node02、node03
• History Server：node03

并没有安装全部的组件，内存已经不够用了，主节点一定要分配足够的内存

位置

• zookeeper
  • /opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/zookeeper/conf
• kafka
  • /opt/cloudera/parcels/KAFKA-2.1.0-1.2.1.0.p0.115/etc/kafka/conf.dist/server.properties
    
• flume
  •  

 

参考

HBaser集群搭建

https://blog.csdn.net/leifeng100200/article/details/83001158

Kafka

http://archive.cloudera.com/kafka/parcels/2.1.1/

https://blog.csdn.net/weizhonggui/article/details/87897129

https://blog.csdn.net/BigData_Mining/article/details/80854372

https://blog.csdn.net/u010452388/article/details/102719681

内存分配

https://blog.csdn.net/adshiye/article/details/78840040