Kubernetes环境搭建

第一种安装方案(官网)

基于官方的安装方式(安装包并非是最新版本的)

准备CentOS 7.x环境

查看内核版本

1
2
3
[root@k8s-master kube-yaml]# uname -r
3.10.0-514.6.1.el7.x86_64
[root@k8s-master kube-yaml]#

 

最好是选择3.10版本以上的内核，进行安装。
本次安装，选择了4台服务器进行集群安装。

1
2
3
4
5
6
[root@k8s-master kube-yaml]# cat /etc/hosts
10.200.102.93 k8s-master
10.200.102.92 k8s-node-1
10.200.102.81 k8s-node-2
10.200.102.82 k8s-node-3
[root@k8s-master kube-yaml]#

配置官方k8s yum源:

1
2
3
4
[virt7-docker-common-release]
name=virt7-docker-common-release
baseurl=http://cbs.centos.org/repos/virt7-docker-common-release/x86_64/os/
gpgcheck=0

 

配置阿里云yum源:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
[base]
name=CentOS-$releasever - Base - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/os/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/os/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=os
gpgcheck=1
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-7
 
#released updates
[updates]
name=CentOS-$releasever - Updates - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/updates/$basearch/ http://mirrors.aliyuncs.com/centos/$releasever/updates/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=updates
gpgcheck=1
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-7
#additional packages that may be useful
[extras]
name=CentOS-$releasever - Extras - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/extras/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/extras/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=extras
gpgcheck=1
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-7
#additional packages that extend functionality of existing packages
[centosplus]
name=CentOS-$releasever - Plus - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/centosplus/$basearch/ http://mirrors.aliyuncs.com/centos/$releasever/centosplus/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=centosplus
gpgcheck=1
enabled=0
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-7
#contrib - packages by Centos Users
[contrib]
name=CentOS-$releasever - Contrib - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/contrib/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/contrib/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=contrib
gpgcheck=1
enabled=0
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-7

 

更新本地镜像源

1
2
yum clean all
yum makecache

 

安装Kubernetes环境(Master)

1
yum -y install --enablerepo=virt7-docker-common-release kubernetes etcd flannel

Kubernates环境安装

安装的过程有点久，因为需要下载和安装。期间如果出现什么下载失败，更新包更新失败。基本上都是因为yum的问题，换个国内大企业的镜像yum就好了。
Kubernates搭建结果
至此，整个下载和安装的过程就算成功了。

编辑本地host文件，做好访问映射：vim /etc/hosts

1
2
3
4
5
6
7
[root@k8s-master kube-yaml]# cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
10.200.102.93 k8s-master
10.200.102.92 k8s-node-1
10.200.102.81 k8s-node-2
10.200.102.82 k8s-node-3

Hosts配置

编辑k8s的配置文件信息：vi /etc/kubernetes/config
k8s-config

由于CentOS 7.x默认是开启防火墙的，需要进行防火墙的设置操作：
关闭SELinux：setenforce 0
1、临时关闭(不用重启机器):


setenforce 0 #设置SELinux 成为permissive模式
setenforce 1 #设置SELinux 成为enforcing模式

setLinux
2、关闭防火墙:

1
2
systemctl stop firewalld.service
systemctl disable firewalld.service

编辑etcd的配置文件信息：vi /etc/etcd/etcd.conf
etcd

编辑k8s的配置信息：vi /etc/kubernetes/apiserver
apiserver

启动etcd服务：systemctl start etcd
start-etcd

创建网络，并且设置网络配置信息：

1
2
3
etcdctl mkdir /kube-centos/network
etcdctl mk /kube-centos/network/config
"{\"Network\":\"172.30.0.0/16\",\"SubnetLen\":24,\"Backend\":{\"Type\":\"vxlan\"}}"

etcd-network

 

配置flanneld信息：vi /etc/sysconfig/flanneld
flanneld

运行环境：for SERVICES in etcd kube-apiserver kube-controller-manager kube-scheduler flanneld; do systemctl restart $SERVICES; systemctl enable $SERVICES; systemctl status $SERVICES; done
k8s-startk8s-ready

至此k8s-master的安装和启动到此完成。

安装Kubernetes环境(Minion/Node):

内核版本和yum源配置，请参考上面部分进行配置就可以了。

1
yum -y install --enablerepo=virt7-docker-common-release kubernetes flannel

Kubernates环境安装

 

安装的过程有点久，因为需要下载和安装。期间如果出现什么下载失败，更新包更新失败。基本上都是因为yum的问题，换个国内大企业的镜像yum就好了。
Kubernates搭建结果
至此，整个下载和安装的过程就算成功了。

编辑本地host文件，做好访问映射：vim /etc/hosts

1
2
3
4
5
6
7
[root@k8s-master kube-yaml]# cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
10.200.102.93 k8s-master
10.200.102.92 k8s-node-1
10.200.102.81 k8s-node-2
10.200.102.82 k8s-node-3

Hosts配置

 

由于CentOS 7.x默认是开启防火墙的，需要进行防火墙的设置操作：
关闭SELinux：setenforce 0
1、临时关闭(不用重启机器):

 


setenforce 0 #设置SELinux 成为permissive模式
setenforce 1 #设置SELinux 成为enforcing模式

setLinux
2、关闭防火墙:

1
2
systemctl stop firewalld.service
systemctl disable firewalld.service

 

编辑k8s的配置文件信息：vi /etc/kubernetes/config
k8s-config

配置kubernetes信息：vi /etc/kubernetes/kubelet
kubectl

配置flanneld信息：vi /etc/sysconfig/flanneld
flanneld

运行环境：for SERVICES in kube-proxy kubelet flanneld docker; do systemctl restart $SERVICES; systemctl enable $SERVICES; systemctl status $SERVICES; donek8s-node

配置参数：

1
2
3
kubectl config set-cluster default-cluster --server=http://k8s-master:8080
kubectl config set-context default-context --cluster=default-cluster --user=default-admin
kubectl config use-context default-context

kubectl-config

 

第二种安装方案(tar安装)

服务器环境：

1
2
3
4
5
6
7
10.15.206.120 vip
10.15.206.105 master
10.15.206.106 node
 
10.15.206.107 etcd1 node
10.15.206.108 etcd2 node
10.15.206.109 etcd3

 

第一步：配置flannel网卡,先在etcd中注册flannel子网：

1
etcdctl set /coreos.com/network/config '{"network": "172.16.0.0/16"}'

第二步：在所有节点安装flannel

1
yum install -y flannel

第三步：修改flannel配置文件/etc/sysconfig/flanneld

1
2
FLANNEL_ETCD="http://10.15.206.107:2379,http://10.15.206.108:2379,http://10.15.206.109:2379"
FLANNEL_ETCD_KEY="/coreos.com/network"

重启flannel：

1
2
systemctl start flanneld
systemctl enable flanneld

 

需要说明的是，如果要让docker使用flannel的网络，docker必须要后于flannel启动，所以需要重新启动docker

1
systemctl restart docker

 

第四步：下载地址

kubernetes-client地址
https://storage.googleapis.com/kubernetes-release/release/v1.5.3/kubernetes-client-linux-amd64.tar.gz

kubernetes-server地址：
https://storage.googleapis.com/kubernetes-release/release/v1.5.3/kubernetes-server-linux-amd64.tar.gz

第五步：在server端服务器解压包

tar zxvf kubernetes-server-linux-amd64.tar.gz cd kubernetes/server/bin

然后将文件复制到/usr/local/bin下

1
2
3
4
for i in `ls -F|grep "*"|awk '{print $1}'|awk -F "*" '{print $1}'`;
do
cp $i /usr/local/bin/ ;
done

 

第六步：启动master

启动api-server

1
2
3
4
5
6
7
8
9
10
kube-apiserver
--address=0.0.0.0
--insecure-port=8080
--service-cluster-ip-range='10.15.206.120/24'
--log_dir=/usr/local/kubernetes/logs/kube
--kubelet_port=10250
--v=0
--logtostderr=false
--etcd_servers=http://10.15.206.107:2379,http://10.15.206.108:2379,http://10.15.206.109:2379
--allow_privileged=false >> /usr/local/kubernetes/logs/kube-apiserver.log 2>&1 &

 

启动controller-manager

1
2
3
4
5
kube-controller-manager
--v=0
--logtostderr=false
--log_dir=/usr/local/kubernetes/logs/kube
--master=10.15.206.120:8080 >> /usr/local/kubernetes/logs/kube-controller-manager 2>&1 &

 

启动scheduler

1
2
3
4
kube-scheduler
--master='10.15.206.120:8080'
--v=0
--log_dir=/usr/local/kubernetes/logs/kube >> /usr/local/kubernetes/logs/kube-scheduler.log 2>&1 &

 

第七步：验证是否成功

1
2
3
4
5
6
7
kubectl get componentstatuses
NAME STATUS MESSAGE ERROR
controller-manager Healthy ok
scheduler Healthy ok
etcd-2 Healthy {"health": "true"}
etcd-0 Healthy {"health": "true"}
etcd-1 Healthy {"health": "true"}

第八步：配置client

1
2
3
tar zxvf kubernetes-client-linux-amd64.tar.gz
cd kubernetes/client/bin
cp * /usr/local/bin/

第九步：启动client

启动kubelet

1
2
3
4
5
6
7
8
9
kubelet
--logtostderr=false
--v=0
--allow-privileged=false
--log_dir=/usr/local/kubernetes/logs/kube
--address=0.0.0.0
--port=10250
--hostname_override=10.15.206.120
--api_servers=http://10.15.206.120:8080 >> /usr/local/kubernetes/logs/kube-kubelet.log 2>&1 &

 

启动proxy

1
2
3
4
kube-proxy
--logtostderr=false
--v=0
--master=http://10.15.206.120

 

第三种安装方案(calico)

环境介绍:

服务器IpHosts
Centos-7.3 10.200.102.95 k8s-master
Centos-7.3 10.200.102.94 k8s-node-1
Centos-7.3 10.200.102.85 k8s-node-2
Centos-7.3 10.200.102.90 k8s-node-3

确保操作系统的内核是3.10版本以上的。
并且关闭防火墙和selinux。

1
2
3
setenforce 0
systemctl stop firewalld.service
systemctl disable firewalld.service

 

根据需要是否配置必要的源，可以参考上述的源配置。

etc环境安装(可以选择集群的方案安装)

服务器 IP Hosts
| 服务器 | Ip | Hosts |
| ————- |:—————:|:———:|
| Centos-7.3 | 10.200.102.85 | Echo0 |
| Centos-7.3 | 10.200.102.86 | Echo1 |
| Centos-7.3 | 10.200.102.84 | Echo2 |

安装ectd环境
etcd-install

配置etcd信息
etcd-config

etcd-config2

启动服务
etcd-start
所有的节点都进行如上相应的配置

安装k8s master环境

1
yum install kubernetes-master docker -y

配置好相应的kubernetes信息
k8s-calico-config

k8s-calico-apiserver

配置好docker信息
calico-docker

查看集群信息
calico-k8s-server

安装k8s node环境

1
yum install kubernetes-node docker –y

配置k8s和docker信息
配置kubectlcalico-k8s-kubectl
配置proxycalico-k8s-proxy
配置configcalico-k8s-config
配置docker镜像拉取位置calico-docker2

查看集群信息
calico-k8s-server2

安装kube-dns环境(master节点)

1
2
3
4
5
6
7
8
9
10
11
下载kube-dns命令
# wget https://dl.k8s.io/v1.5.2/kubernetes-server-linux-amd64.tar.gz
# tar -xf kubernetes-server-linux-amd64.tar.gz
# mv /opt/docker/src/kubernetes/server/bin/kube-dns /usr/bin/
 
新建kube-dns配置文件
# vi /etc/kubernetes/kube-dns
KUBE_DNS_PORT="--dns-port=53"
KUBE_DNS_DOMAIN="--domain=cluster.local"
KUBE_DNS_MASTER=--kube-master-url="http://10.200.102.95:8080”
KUBE_DNS_ARGS=""
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
新建kube-dns.service配置文件
# cat /usr/lib/systemd/system/kube-dns.service
[Unit]
Description=Kubernetes Kube-dns Server
Documentation=https://github.com/GoogleCloudPlatform/kubernetes
After=kube-apiserver.service
Requires=kube-apiserver.service
 
[Service]
WorkingDirectory=/var/lib/kube-dns
EnvironmentFile=-/etc/kubernetes/kube-dns
ExecStart=/usr/bin/kube-dns \
$KUBE_DNS_PORT \
$KUBE_DNS_DOMAIN \
$KUBE_DNS_MASTER \
$KUBE_DNS_ARGS
Restart=on-failure
[Install]
WantedBy=multi-user.target
1
2
3
4
5
6
7
8
9
10
11
12
Master启动
# mkdir -p /var/lib/kube-dns
# systemctl enable kube-dns
# systemctl restart kube-dns
 
master修改/etc/resolv.conf文件
# cat /etc/resolv.conf
# Generated by NetworkManager
search default.svc.cluster.local svc.cluster.local cluster.local
nameserver 10.200.102.95
nameserver 223.5.5.5
nameserver 202.96.128.86

node结点修改kubelet文件
calico-edit-kubectl

验证kube-dns是否安装成功
kube-dns

安装calico环境

配置各个节点docker环境：
calico-docker-node-1
calico-docker-node-2
calico-docker-node-3

配置好，记得重启docker

1
2
# systemctl daemon-reload
# systemctl restart docker

 

下载calico插件

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
Master节点：
# wget https://github.com/projectcalico/calicoctl/releases/download/v1.1.0/calicoctl
# chmod +x calicoctl
# mv calicoctl /usr/bin/
# docker pull docker.io/calico/node:v1.1.0
# docker tag docker.io/calico/node:v1.1.0 quay.io/calico/node:v1.1.0
#wget N -P /opt/cni/bin/
https://github.com/projectcalico/calico-cni/releases/download/v1.6.0/calico
# wget -N -P /opt/cni/bin/
https://github.com/projectcalico/calico-cni/releases/download/v1.6.0/calico-ipam
# chmod +x /opt/cni/bin/calico /opt/cni/bin/calico-ipam
 
Node节点：
# docker pull docker.io/calico/node:v1.1.0
# docker tag docker.io/calico/node:v1.1.0 quay.io/calico/node:v1.1.0
# wget -N -P /opt/cni/bin/
https://github.com/projectcalico/calico-cni/releases/download/v1.6.0/calico
# wget -N -P /opt/cni/bin/
https://github.com/projectcalico/calico-cni/releases/download/v1.6.0/calico-ipam
# chmod +x /opt/cni/bin/calico /opt/cni/bin/calico-ipam

 

配置文件(所有节点)
calico-config-1
calico-config-2
calico-config-3

Master机上
wget http://docs.projectcalico.org/v1.5/getting-started/kubernetes/installation/policy-controller.yaml

修改 policy-controller.yaml文件里的etcd的地址
policy-controller

启动文件：

1
2
3
4
5
6
7
8
9
10
11
# serivce etcd restart
# kubectl create -f policy-controller.yaml
 
每个节点上启动calico-node服务(ETCD_AUTHORITY可以配置多个（集群方案）)
# systemctl enable calico-node
# systemctl start calico-node
# export ETCD_AUTHORITY=10.200.102.85:2379
 
验证calico是否启动正常
calicoctl node status
calicoctl get nodes --out=wide

 

calico-node-status
calico-node

添加子网
calico-pooldo-pool
get-pool

至此calico的k8s方案搭建成功

posted on 2017-10-20 09:58  heidsoft  阅读(2850)  评论(0)  编辑  收藏  举报