OpenStack之Ocata单控部署测试
本着学以致用的原则，学习到新的东西一定要亲自去实践操作，就像别人回来给你描述那里的风景是多么多么美好，你如果不亲自去走一遭看一遍是体会不到的，要不然你大爷永远还是你大爷！P话！^_^O(∩_∩)O哈哈~~~~~
（仅供参考）
简介：
Ocata与以往版本主要区别在于引入了cell（单元格），cell v2 自 Newton 版本引入 ，Ocata 版本变为必要组件，以后默认部署都会初始化一个单 cell 的架构。
OpenStack 在控制平面上的性能瓶颈主要在 Message Queue 和 Database 。尤其是 Message Queue , 随着计算节点的增加，性能变的越来越差，因为openstack里每个资源和接口都是通过消息队列来通信的
引入Cells功能主要是以解决OpenStack集群的扩展性问题。
与以往版本部署区别主要在nova 这块，会多出nova_cell 数据库的创建，以及placement参与调度服务的配置等。以下开始部署测试：
一、环境准备
1. 前提准备
三台虚拟机配置至少CPU 4c MEM 4G的虚拟机（控制节点 + 计算几点 + Cinder节点）
安装CentOS7.2系统（最小化安装， + 关闭防火墙 + 关闭selinux + 主机互信 + hosts文件）
# systemctl stop firewalld.service
# systemctl disable firewalld.service
配置使用公司O 版内部源
# curl -O 172.30.120.147/repo.files/ocataCentOS74.x86_64.repo
安装相关基础工具
# yum install net-tools wget vim ntpdate bash-completion -y
2. 更改hostname
# hostnamectl set-hostname controller1
然后每个节点配置/etc/hosts文件如下
172.30.126.4 controller1
172.30.126.5 cinder
172.30.126.6 compute1
3. 安装NTP同步系统时间或者chrony
# ntpdate cn.pool.ntp.org
然后查看运行date命令查看时间是否同步成功，注意，openstack是分布式架构的，每个节点都不能有时间差！另外，也把这个命令加到开机启动里面去
# echo "ntpdate cn.pool.ntp.org" >> /etc/rc.d/rc.local
# chmod +x /etc/rc.d/rc.local
#vi /etc/ntp.conf
#ntpq -p
二、 搭建Mariadb
1. 安装mariadb数据库
#yum install mariadb-server mariadb-client
2. 配置mariadb
# vim /etc/my.cnf.d/mariadb-server.cnf
在mysqld区块添加如下内容：
[mysqld]
default-storage-engine = innodb
innodb_file_per_table
collation-server = utf8_general_ci
init-connect = 'SET NAMES utf8'
character-set-server = utf8
bind-address = 172.30.126.4
3、启动数据库及设置mariadb开机启动
# systemctl enable mariadb.service
# systemctl restart mariadb.service
# systemctl status mariadb.service
# systemctl list-unit-files |grep mariadb.service
4. 配置mariadb，给mariadb设置密码
# mysql_secure_installation
三、安装RabbitMQ
1. 每个节点都安装erlang
# yum install -y erlang
2. 每个节点都安装RabbitMQ
# yum install -y rabbitmq-server
3. 每个节点都启动rabbitmq及设置开机启动
# systemctl enable rabbitmq-server.service
# systemctl restart rabbitmq-server.service
# systemctl status rabbitmq-server.service
# systemctl list-unit-files |grep rabbitmq-server.service
- 创建openstack
# rabbitmqctl add_user openstack passw0rd
5. 将openstack用户赋予权限
# rabbitmqctl set_permissions openstack ".*" ".*" ".*"
# rabbitmqctl set_user_tags openstack administrator
# rabbitmqctl list_users
6. 看下监听端口 rabbitmq用的是5672端口
# netstat -ntlp |grep 5672
7. 查看RabbitMQ插件
# /usr/lib/rabbitmq/bin/rabbitmq-plugins list
8. 打开RabbitMQ相关插件
# /usr/lib/rabbitmq/bin/rabbitmq-plugins enable rabbitmq_management mochiweb webmachine rabbitmq_web_dispatch
amqp_client rabbitmq_management_agent
打开相关插件后，重启下rabbitmq服务
systemctl restart rabbitmq-server
浏览器输入：http://172.30.126.4:15672 默认用户名密码：guest/guest
通过这个界面，可以能很直观的看到rabbitmq的运行和负载情况
9. 查看rabbitmq状态
用浏览器登录http://172.30.126.4:15672 输入openstack/passw0rd也可以查看状态信息：
四、安装配置Keystone
1、创建keystone数据库
MariaDB [(none)]>create database keystone;
2、创建数据库keystone用户&root用户及赋予权限
MariaDB [(none)]> grant all privileges on keystone.* to 'keystone'@'localhost' identified by 'passw0rd';
MariaDB [(none)]> grant all privileges on keystone.* to 'keystone'@'%' identified by 'passw0rd';
MariaDB [(none)]>flush privileges;
3、安装keystone和memcached
# yum -y install openstack-keystone httpd mod_wsgi python-openstackclient memcached python-memcached openstack-utils
4、启动memcache服务并设置开机自启动
# systemctl enable memcached.service
# systemctl restart memcached.service
# systemctl status memcached.service
5、配置/etc/keystone/keystone.conf文件
# cp /etc/keystone/keystone.conf /etc/keystone/keystone.conf.bak 做好备份
# >/etc/keystone/keystone.conf 清空源配置文件 从新写入
#
openstack-config --set /etc/keystone/keystone.conf DEFAULT transport_url rabbit://openstack:passw0rd@controller1
openstack-config --set /etc/keystone/keystone.conf database connection mysql://keystone:passw0rd@controller1/keystone
openstack-config --set /etc/keystone/keystone.conf cache backend oslo_cache.memcache_pool
openstack-config --set /etc/keystone/keystone.conf cache enabled true
openstack-config --set /etc/keystone/keystone.conf cache memcache_servers controller1:11211
openstack-config --set /etc/keystone/keystone.conf memcache servers controller1:11211
openstack-config --set /etc/keystone/keystone.conf token expiration 3600
openstack-config --set /etc/keystone/keystone.conf token provider fernet
6、配置httpd.conf文件&memcached文件 配置前先看看原文件
# sed -i "s/#ServerName www.example.com:80/ServerName controller/" /etc/httpd/conf/httpd.conf
# sed -i 's/OPTIONS*.*/OPTIONS="-l 127.0.0.1,::1,172.30.126.4"/' /etc/sysconfig/memcached
7、配置keystone与httpd结合
# ln -s /usr/share/keystone/wsgi-keystone.conf /etc/httpd/conf.d/
8、数据库同步
# su -s /bin/sh -c "keystone-manage db_sync" keystone 同步完一定要查看keystone 数据库是否有表存在
有说明同步成功
9、初始化fernet
# keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone
# keystone-manage credential_setup --keystone-user keystone --keystone-group keystone
10、启动httpd，并设置httpd开机启动
# systemctl enable httpd.service
# systemctl restart httpd.service
# systemctl status httpd.service
# systemctl list-unit-files |grep httpd.service
11、创建 admin 用户角色
keystone-manage bootstrap \
> --bootstrap-password passw0rd \
> --bootstrap-username admin \
> --bootstrap-project-name admin \
> --bootstrap-role-name admin \
> --bootstrap-service-name keystone \
> --bootstrap-region-id RegionOne \
> --bootstrap-admin-url http://controller1:35357/v3 \
> --bootstrap-internal-url http://controller1:35357/v3 \
> --bootstrap-public-url http://controller1:5000/v3
验证一下：
# openstack project list --os-username admin --os-project-name admin --os-user-domain-id default --os-project-domain-id
default --os-identity-api-version 3 --os-auth-url http://controller1:5000 --os-password passw0rd
12. 创建admin用户环境变量，创建/root/admin-openrc 文件并写入如下内容：
# vim /root/admin-openrc
添加以下内容：
export OS_USER_DOMAIN_ID=default
export OS_PROJECT_DOMAIN_ID=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=passw0rd
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2
export OS_AUTH_URL=http://controller1:35357/v3
13、创建service项目
# source /root/admin-openrc
# openstack project create --domain default --description "Service Project" service
14、创建demo项目
# openstack project create --domain default --description "Demo Project" demo
15、创建demo用户
# openstack user create --domain default demo --password passw0rd
注意：passw0rd为demo用户密码
16、创建user角色将demo用户赋予user角色
# openstack role create user
# openstack role add --project demo --user demo user
17、验证keystone
# unset OS_TOKEN OS_URL
# openstack --os-auth-url http://controller1:35357/v3 --os-project-domain-name default --os-user-domain-name default --
os-project-name admin --os-username admin token issue --os-password passw0rd
# openstack --os-auth-url http://controller1:5000/v3 --os-project-domain-name default --os-user-domain-name default --
os-project-name demo --os-username demo token issue --os-password passw0rd
五、安装配置glance
1、创建glance数据库
MariaDB [(none)]>CREATE DATABASE glance;
2、创建数据库用户并赋予权限
MariaDB [(none)]>GRANT ALL PRIVILEGES ON glance.* TO 'glance'@'localhost' IDENTIFIED BY 'passw0rd';
MariaDB [(none)]>GRANT ALL PRIVILEGES ON glance.* TO 'glance'@'%' IDENTIFIED BY 'passw0rd';
3、创建glance用户及赋予admin权限
# source /root/admin-openrc
# openstack user create --domain default glance --password passw0rd
# openstack role add --project service --user glance admin
4、创建image服务
# openstack service create --name glance --description "OpenStack Image service" image
5、创建glance的endpoint 分别为 public internal admin
# openstack endpoint create --region RegionOne image public http://controller1:9292
# openstack endpoint create --region RegionOne image internal http://controller1:9292
# openstack endpoint create --region RegionOne image admin http://controller1:9292
6、安装glance相关rpm包
# yum install openstack-glance -y
7、修改glance配置文件/etc/glance/glance-api.conf
# cp /etc/glance/glance-api.conf /etc/glance/glance-api.conf.bak
# >/etc/glance/glance-api.conf
#openstack-config --set /etc/glance/glance-api.conf DEFAULT transport_url rabbit://openstack:passw0rd@controller1
openstack-config --set /etc/glance/glance-api.conf database connection mysql+pymysql://glance:passw0rd@controller1/glance
openstack-config --set /etc/glance/glance-api.conf keystone_authtoken auth_uri http://controller1:5000
openstack-config --set /etc/glance/glance-api.conf keystone_authtoken auth_url http://controller1:35357
openstack-config --set /etc/glance/glance-api.conf keystone_authtoken memcached_servers controller1:11211
openstack-config --set /etc/glance/glance-api.conf keystone_authtoken auth_type password
openstack-config --set /etc/glance/glance-api.conf keystone_authtoken project_domain_name default
openstack-config --set /etc/glance/glance-api.conf keystone_authtoken user_domain_name default
openstack-config --set /etc/glance/glance-api.conf keystone_authtoken username glance
openstack-config --set /etc/glance/glance-api.conf keystone_authtoken password passw0rd
openstack-config --set /etc/glance/glance-api.conf keystone_authtoken project_name service
openstack-config --set /etc/glance/glance-api.conf paste_deploy flavor keystone
openstack-config --set /etc/glance/glance-api.conf glance_store stores file,http
openstack-config --set /etc/glance/glance-api.conf glance_store default_store file
openstack-config --set /etc/glance/glance-api.conf glance_store filesystem_store_datadir /var/lib/glance/images/
8、修改glance配置文件/etc/glance/glance-registry.conf：
# cp /etc/glance/glance-registry.conf /etc/glance/glance-registry.conf.bak
# >/etc/glance/glance-registry.conf
配置如下：
[DEFAULT]
transport_url = rabbit://openstack:passw0rd@controller1
[database]
connection = mysql+pymysql://glance:passw0rd@controller1/glance
[keystone_authtoken]
auth_uri = http://controller1:5000
auth_url = http://controller1:35357
memcached_servers = controller1:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = glance
password = passw0rd
[paste_deploy]
flavor = keystone
9、同步glance数据库
# su -s /bin/sh -c "glance-manage db_sync" glance
10、启动glance及设置开机启动
# systemctl enable openstack-glance-api.service openstack-glance-registry.service
# systemctl restart openstack-glance-api.service openstack-glance-registry.service
# systemctl status openstack-glance-api.service openstack-glance-registry.service
12、上传个小镜像到glance
# source /root/admin-openrc
# glance image-create --name "cirros-0.3.4-x86_64" --file cirros-0.3.4-x86_64-disk.img --disk-format qcow2 --containerformat bare --visibility public --progress
查看镜像列表：
# glance image-list
六、安装配置nova
1、创建nova数据库
MariaDB [(none)]> create database nova;
MariaDB [(none)]> create database nova_api;
MariaDB [(none)]> create database nova_cell0;
2、创建数据库用户并赋予权限
grant all privileges on nova.* to 'nova'@'localhost' identified by 'passw0rd';
MariaDB [(none)]>grant all privileges on nova.* to 'nova'@'%' identified by 'passw0rd';
MariaDB [(none)]> grant all privileges on nova_api.* to 'nova'@'localhost' identified by 'passw0rd';
MariaDB [(none)]> grant all privileges on nova_api.* to 'nova'@'%' identified by 'passw0rd';
MariaDB [(none)]> grant all privileges on nova_cell0.* to 'nova'@'localhost' identified by 'passw0rd';
MariaDB [(none)]> grant all privileges on nova_cell0.* to 'nova'@'%' identified by 'passw0rd';
MariaDB [(none)]> grant all privileges on *.* to 'root'@'controller1' identified by 'passw0rd';
注：查看授权列表信息：
MariaDB [(none)]> select distinct concat('User: ''',user,'''@''',host,''';') as query from mysql.user;
取消之前某个授权MariaDB [(none)]> revoke alter on *.* to 'root'@'controller1' identified by'passw0rd';
3、创建nova用户及赋予admin权限
# source /root/admin-openrc
# openstack user create --domain default nova --password passw0rd
# openstack role add --project service --user nova admin
4、创建computer服务
# openstack service create --name nova --description "OpenStack Compute" compute
5、创建nova的endpoint
# openstack endpoint create --region RegionOne compute public http://controller1:8774/v2.1/%\(tenant_id\)s
# openstack endpoint create --region RegionOne compute internal http://controller1:8774/v2.1/%\(tenant_id\)s
#openstack endpoint create --region RegionOne compute admin http://controller1:8774/v2.1/%\(tenant_id\)s
6、安装nova相关软件
# yum install -y openstack-nova-api openstack-nova-conductor openstack-nova-cert openstack-nova-console openstack-nova-novncproxy openstack-nova-scheduler
7、配置nova的配置文件/etc/nova/nova.conf
# cp /etc/nova/nova.conf /etc/nova/nova.conf.bak
# >/etc/nova/nova.conf
#vi /etc/nova/nova.conf
[DEFAULT]
enabled_apis = osapi_compute,metadata
auth_strategy = keystone
my_ip = 172.30.126.4
use_neutron = True
firewall_driver = nova.virt.firewall.NoopFirewallDriver
transport_url = rabbit://openstack:passw0rd@controller1
[database]
connection = mysql+pymysql://nova:passw0rd@controller1/nova
[api_database]
connection = mysql+pymysql://nova:passw0rd@controller1/nova_api
[scheduler]
discover_hosts_in_cells_interval = -1
[keystone_authtoken]
auth_uri = http://controller1:5000
auth_url = http://controller1:35357
memcached_servers = controller1:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = nova
password = passw0rd
service_token_roles_required = True
[vnc]
vncserver_listen = 172.30.126.4
vncserver_proxyclient_address = 172.30.126.4
[glance]
api_servers = http://controller1:9292
[oslo_concurrency]
lock_path = /var/lib/nova/tmp
8、设置cell（单元格）
同步下nova数据库
# su -s /bin/sh -c "nova-manage api_db sync" nova
# su -s /bin/sh -c "nova-manage db sync" nova
设置cell_v2关联上创建好的数据库nova_cell0
# nova-manage cell_v2 map_cell0 --database_connection mysql+pymysql://root:passw0rd@controller1/nova_cell0
创建一个常规cell，名字叫cell1，这个单元格里面将会包含计算节点
# nova-manage cell_v2 create_cell --verbose --name cell1 --database_connection
mysql+pymysql://root:passw0rd@controller1/nova_cell0 --transport-url rabbit://openstack:passw0rd@controller1:5672/
检查部署是否正常，后面再执行
# nova-status upgrade check （如果还没有计算节点检查肯定会报错）
创建和映射cell0，并将现有计算主机和实例映射到单元格中 最后在执行
# nova-manage cell_v2 simple_cell_setup 没有主机会报错
查看已经创建好的单元格列表
# nova-manage cell_v2 list_cells --verbose
注意，如果有新添加的计算节点，需要运行下面命令来发现，并且添加到单元格中
# nova-manage cell_v2 discover_hosts
可以在控制节点的nova.conf文件里[scheduler]模块下添加 discover_hosts_in_cells_interval=-1 这个设置来自动发现
9、安装placement
注意：从Ocata开始，需要安装配置placement参与nova调度了，不然虚拟机将无法创建！
# yum install -y openstack-nova-placement-api
创建placement用户和placement 服务
# openstack user create --domain default placement --password passw0rd
# openstack role add --project service --user placement admin
# openstack service create --name placement --description "OpenStack Placement" placement
创建placement的 endpoint
# openstack endpoint create --region RegionOne placement public http://controller1:8778
# openstack endpoint create --region RegionOne placement admin http://controller1:8778
# openstack endpoint create --region RegionOne placement internal http://controller1:8778
把placement 整合到nova.conf里
[placement]
auth_url = http://controller1:35357
memcached_servers = controller1:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = nova
password = passw0rd
os_region_name = RegionOne
配置修改00-nova-placement-api.conf文件，这步没做创建虚拟机的时候会出现禁止访问资源的问题
# cd /etc/httpd/conf.d/
# cp 00-nova-placement-api.conf 00-nova-placement-api.conf.bak
# >00-nova-placement-api.conf
# vim 00-nova-placement-api.conf
添加以下内容：
Listen 8778
<VirtualHost *:8778>
WSGIProcessGroup nova-placement-api
WSGIApplicationGroup %{GLOBAL}
WSGIPassAuthorization On
WSGIDaemonProcess nova-placement-api processes=3 threads=1 user=nova group=nova
WSGIScriptAlias / /usr/bin/nova-placement-api
<Directory "/">
Order allow,deny
Allow from all
Require all granted
</Directory>
<IfVersion >= 2.4>
ErrorLogFormat "%M"
</IfVersion>
ErrorLog /var/log/nova/nova-placement-api.log
</VirtualHost>
Alias /nova-placement-api /usr/bin/nova-placement-api
<Location /nova-placement-api>
SetHandler wsgi-script
Options +ExecCGI
WSGIProcessGroup nova-placement-api
WSGIApplicationGroup %{GLOBAL}
WSGIPassAuthorization On
</Location>
重启下httpd服务
# systemctl restart httpd
检查下是否配置成功
# nova-status upgrade check
10、设置nova相关服务开机启动
# systemctl enable openstack-nova-api.service openstack-nova-cert.service openstack-nova-consoleauth.service openstack-nova-scheduler.service openstack-nova-conductor.service openstack-nova-novncproxy.service
启动nova服务：
# systemctl restart openstack-nova-api.service openstack-nova-cert.service openstack-nova-consoleauth.service openstack-nova-scheduler.service openstack-nova-conductor.service openstack-nova-novncproxy.service
查看nova服务：
# systemctl status openstack-nova-api.service openstack-nova-cert.service openstack-nova-consoleauth.service openstack-nova-scheduler.service openstack-nova-conductor.service openstack-nova-novncproxy.service
# systemctl list-unit-files |grep openstack-nova-*
11、验证nova服务
# unset OS_TOKEN OS_URL
# source /root/admin-openrc
# nova service-list
# openstack endpoint list 查看是否有结果正确输出
七、安装配置neutron
网络架构参考： 图片来源于网络宝哥的OCATA单控部署文档
1、创建neutron数据库
MariaDB [(none)]> create database neutron;
2、创建数据库用户并赋予权限
MariaDB [(none)]> grant all privileges on neutron.* to 'neutron'@'localhost' identified by 'passw0rd';
MariaDB [(none)]> grant all privileges on neutron.* to 'neutron'@'%' identified by 'passw0rd';
3、创建neutron用户及赋予admin权限
# source /root/admin-openrc
# openstack user create --domain default neutron --password passw0rd
# openstack role add --project service --user neutron admin
4、创建network服务
# openstack service create --name neutron --description "OpenStack Networking" network
5、创建endpoint
# openstack endpoint create --region RegionOne network public http://controller1:9696
# openstack endpoint create --region RegionOne network internal http://controller1:9696
# openstack endpoint create --region RegionOne network admin http://controller1:9696
6、安装neutron相关软件
# yum install openstack-neutron openstack-neutron-ml2 openstack-neutron-linuxbridge ebtables -y
7、配置neutron配置文件/etc/neutron/neutron.conf
# cp /etc/neutron/neutron.conf /etc/neutron/neutron.conf.bak
# >/etc/neutron/neutron.conf
#/etc/neutron/neutron.conf
[DEFAULT]
core_plugin = ml2
service_plugins = router
allow_overlapping_ips = True
auth_strategy = keystone
transport_url = rabbit://openstack:passw0rd@controller1
notify_nova_on_port_status_changes = True
notify_nova_on_port_data_changes = True
[keystone_authtoken]
auth_uri = http://controller1:5000
auth_url = http://controller1:35357
memcached_servers = controller1:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = neutron
password = passw0rd
[database]
connection = mysql+pymysql://neutron:passw0rd@controller1/neutron
[nova]
auth_url = http://controller1:35357
auth_type = password
project_domain_name = default
user_domain_name = default
region_name = RegionOne
project_name = service
username = nova
password = passw0rd
[oslo_concurrency]
lock_path = /var/lib/neutron/tmp
8、配置/etc/neutron/plugins/ml2/ml2_conf.ini
[DEFAULT]
[ml2]
type_drivers = flat,vlan,vxlan
mechanism_drivers = linuxbridge,l2population
extension_drivers = port_security
tenant_network_types = vxlan
path_mtu = 1500
[ml2_type_flat]
flat_networks = provider
[ml2_type_geneve]
[ml2_type_gre]
[ml2_type_vlan]
[ml2_type_vxlan]
vni_ranges = 1:1000
[securitygroup]
enable_ipset = True
9、配置/etc/neutron/plugins/ml2/linuxbridge_agent.ini
[DEFAULT]
debug = false
[agent]
prevent_arp_spoofing = True
[linux_bridge]
physical_interface_mappings = provider:eno50338560
[securitygroup]
enable_security_group = True
firewall_driver = neutron.agent.linux.iptables_firewall.IptablesFirewallDriver
[vxlan]
enable_vxlan = True
local_ip = 172.30.125.4
l2_population = True
注意eno50338560是定义的外网网卡，这里是125网段，做floating_ip 用
local_ip 定义的是隧道网络，vxLan下 vm-linuxbridge->vxlan ------tun-----vxlan->linuxbridge-vm
10、配置 /etc/neutron/l3_agent.ini
[DEFAULT]
interface_driver = neutron.agent.linux.interface.BridgeInterfaceDriver
external_network_bridge =
debug = false
11、配置/etc/neutron/dhcp_agent.ini
[DEFAULT]
interface_driver = neutron.agent.linux.interface.BridgeInterfaceDriver
dhcp_driver = neutron.agent.linux.dhcp.Dnsmasq
enable_isolated_metadata = True
verbose = True
debug = false
12、重新配置/etc/nova/nova.conf，配置这步的目的是让compute节点能使用上neutron网络
[neutron]
url = http://controller1:9696
auth_url = http://controller1:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
region_name = RegionOne
project_name = service
username = neutron
password = passw0rd
service_metadata_proxy = True
metadata_proxy_shared_secret = passw0rd
13、将dhcp-option-force=26,1450写入/etc/neutron/dnsmasq-neutron.conf
# echo "dhcp-option-force=26,1450" >/etc/neutron/dnsmasq-neutron.conf
14、配置/etc/neutron/metadata_agent.ini
[DEFAULT]
nova_metadata_ip = controller1
metadata_proxy_shared_secret = passw0rd
metadata_workers = 4
verbose = True
debug = false
nova_metadata_protocol = http
15、创建硬链接
# ln -s /etc/neutron/plugins/ml2/ml2_conf.ini /etc/neutron/plugin.ini
16、同步数据库
# su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf --config-file
/etc/neutron/plugins/ml2/ml2_conf.ini upgrade head" neutron
17、重启nova服务，因为刚才改了nova.conf
# systemctl restart openstack-nova-api.service
# systemctl status openstack-nova-api.service
18、重启neutron服务并设置开机启动
# systemctl enable neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service
# systemctl restart neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service
# systemctl status neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service
19、启动neutron-l3-agent.service并设置开机启动
# systemctl enable neutron-l3-agent.service
# systemctl restart neutron-l3-agent.service
# systemctl status neutron-l3-agent.service
20、执行验证
# source /root/admin-openrc
# neutron ext-list
# neutron agent-list
21、创建vxLan模式网络，让虚拟机能外出
A. 首先先执行环境变量
# source /root/admin-openrc
B. 创建flat模式的public网络，注意这个public是外出网络，必须是flat模式的
# neutron --debug net-create --shared provider --router:external True --provider:network_type flat --
provider:physical_network provider
# neutron subnet-create provider 172.30.125.0/24 --name provider-sub --allocation-pool start=172.30.125.7,end=172.30.125.14
-dns-nameserver 8.8.8.8 --gateway 172.30.125.254
C. 创建名为private的私有网络, 网络模式为vxlan
# neutron net-create private --provider:network_type vxlan --router:external False --shared
D. 创建名为private-subnet的私有网络子网，网段为192.168.1.0, 这个网段就是虚拟机获取的私有的IP地址
# neutron subnet-create private --name private-subnet --gateway 192.168.1.1 192.168.1.0/24
F. 创建路由，在界面上操作
路由名称随便命名，这里写"router1", 管理员状态，选择"上"(up)，外部网络选择"provider"
八、安装Dashboard
1、安装dashboard相关软件包
# yum install openstack-dashboard -y
2、修改配置文件/etc/openstack-dashboard/local_settings
# vim /etc/openstack-dashboard/local_settings
3、启动dashboard服务并设置开机启动
# systemctl restart httpd.service memcached.service
# systemctl status httpd.service memcached.service
到此，Controller节点搭建完毕，打开浏览器即可访问horizon界面
九、安装配置cinder
1、创建数据库用户并赋予权限
MariaDB [(none)]> create database cinder;
MariaDB [(none)]> grant all privileges on cinder.* to 'cinder'@'localhost' identified by 'passw0rd';
MariaDB [(none)]> grant all privileges on cinder.* to 'cinder'@'%' identified by 'passw0rd';
2、创建cinder用户并赋予admin权限
# source /root/admin-openrc
# openstack user create --domain default cinder --password passw0rd
# openstack role add --project service --user cinder admin
3、创建volume服务
# openstack service create --name cinder --description "OpenStack Block Storage" volume
# openstack service create --name cinderv2 --description "OpenStack Block Storage" volumev2
4、创建endpoint
# openstack endpoint create --region RegionOne volume public http://controller1:8776/v1/%\(tenant_id\)s
# openstack endpoint create --region RegionOne volume internal http://controller1:8776/v1/%\(tenant_id\)s
# openstack endpoint create --region RegionOne volume admin http://controller1:8776/v1/%\(tenant_id\)s
# openstack endpoint create --region RegionOne volumev2 public http://controller1:8776/v2/%\(tenant_id\)s
# openstack endpoint create --region RegionOne volumev2 internal http://controller1:8776/v2/%\(tenant_id\)s
# openstack endpoint create --region RegionOne volumev2 admin http://controller1:8776/v2/%\(tenant_id\)s
5、安装cinder相关服务
# yum install openstack-cinder -y
6、配置cinder配置文件
# cp /etc/cinder/cinder.conf /etc/cinder/cinder.conf.bak
# >/etc/cinder/cinder.conf
[DEFAULT]
my_ip = 172.30.126.4
auth_strategy = keystone
transport_url = rabbit://openstack:passw0rd@controller1
[database]
connection = mysql+pymysql://cinder:passw0rd@controller1/cinder
[keystone_authtoken]
auth_uri = http://controller1:5000
auth_url = http://controller1:35357
memcached_servers = controller1:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = cinder
password = passw0rd
[oslo_concurrency]
lock_path = /var/lib/cinder/tmp
7、上同步数据库
# su -s /bin/sh -c "cinder-manage db sync" cinder #同步完一定要查看数据库中是否有表存在
8、在controller上启动cinder服务，并设置开机启动
# systemctl enable openstack-cinder-api.service openstack-cinder-scheduler.service
# systemctl restart openstack-cinder-api.service openstack-cinder-scheduler.service
# systemctl status openstack-cinder-api.service openstack-cinder-scheduler.service
9、
10、安装Cinder节点 从新创建一个节点
Cinder节点这里我们需要额外的添加一个硬盘（/dev/sdb)用作cinder的存储服务 (这一步是在cinder节点
操作的）
# yum install lvm2 -y
10、启动服务并设置为开机自启 (注意！这一步是在cinder节点操作的）
# systemctl enable lvm2-lvmetad.service
# systemctl start lvm2-lvmetad.service
# systemctl status lvm2-lvmetad.service
11、创建lvm, 这里的/dev/sdb就是额外添加的硬盘 (注意！这一步是在cinder节点操作的）
# fdisk -l
# pvcreate /dev/sdb
# vgcreate cinder-volumes /dev/sdb
12. 编辑存储节点lvm.conf文件 (注意！这一步是在cinder节点操作的）
# vim /etc/lvm/lvm.conf
在devices 下面添加 filter = [ "a/sda/", "a/sdb/", "r/.*/"] ，130行 ，如图：
然后重启下lvm2服务：
# systemctl restart lvm2-lvmetad.service
# systemctl status lvm2-lvmetad.service
13、安装openstack-cinder、targetcli (注意！这一步是在cinder节点操作的）
# yum install openstack-cinder openstack-utils targetcli python-keystone ntpdate -y
14、配置cinder配置文件 (注意！这一步是在cinder节点操作的）
# cp /etc/cinder/cinder.conf /etc/cinder/cinder.conf.bak
# >/etc/cinder/cinder.conf
[DEFAULT]
auth_strategy = keystone
my_ip = 172.30.126.5
enabled_backends = lvm
glance_api_servers = http://controller1:9292
glance_api_version = 2
enable_v1_api = True
enable_v2_api = True
enable_v3_api = True
storage_availability_zone = nova
default_availability_zone = nova
os_region_name = RegionOne
api_paste_config = /etc/cinder/api-paste.ini
transport_url = rabbit://openstack:passw0rd@controller1
[database]
connection = mysql+pymysql://cinder:passw0rd@controller1/cinder
[keystone_authtoken]
auth_uri = http://controller1:5000
auth_url = http://controller1:35357
memcached_servers = controller1:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = cinder
password = passw0rd
[lvm]
volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver
volume_group = cinder-volumes
iscsi_protocol = iscsi
iscsi_helper = lioadm
[oslo_concurrency]
lock_path = /var/lib/cinder/tmp
15、启动openstack-cinder-volume和target并设置开机启动 (注意！这一步是在cinder节点操作的）
# systemctl enable openstack-cinder-volume.service target.service
# systemctl restart openstack-cinder-volume.service target.service
# systemctl status openstack-cinder-volume.service target.service
16、验证cinder服务是否正常
# source /root/admin-openrc
# cinder service-list
Compute节点部署
一、安装相关依赖包 （centos7.2系统会有几个包版本冲突，自行下载升级解决）
# yum install openstack-selinux python-openstackclient yum-plugin-priorities openstack-nova-compute openstack-utils
1. 配置nova.conf
# cp /etc/nova/nova.conf /etc/nova/nova.conf.bak
# >/etc/nova/nova.conf
# openstack-config --set /etc/nova/nova.conf DEFAULT auth_strategy keystone
# openstack-config --set /etc/nova/nova.conf DEFAULT my_ip 172.30.126.6
# openstack-config --set /etc/nova/nova.conf DEFAULT use_neutron True
# openstack-config --set /etc/nova/nova.conf DEFAULT firewall_driver nova.virt.firewall.NoopFirewallDriver
# openstack-config --set /etc/nova/nova.conf DEFAULT transport_url rabbit://openstack:passw0rd@controller1
# openstack-config --set /etc/nova/nova.conf keystone_authtoken auth_uri http://controller1:5000
# openstack-config --set /etc/nova/nova.conf keystone_authtoken auth_url http://controller1:35357
# openstack-config --set /etc/nova/nova.conf keystone_authtoken memcached_servers controller1:11211
# openstack-config --set /etc/nova/nova.conf keystone_authtoken auth_type password
# openstack-config --set /etc/nova/nova.conf keystone_authtoken project_domain_name default
# openstack-config --set /etc/nova/nova.conf keystone_authtoken user_domain_name default
# openstack-config --set /etc/nova/nova.conf keystone_authtoken project_name service
# openstack-config --set /etc/nova/nova.conf keystone_authtoken username nova
# openstack-config --set /etc/nova/nova.conf keystone_authtoken password passw0rd
# openstack-config --set /etc/nova/nova.conf placement auth_uri http://controller1:5000
# openstack-config --set /etc/nova/nova.conf placement auth_url http://controller1:35357
# openstack-config --set /etc/nova/nova.conf placement memcached_servers controller1:11211
# openstack-config --set /etc/nova/nova.conf placement auth_type password
# openstack-config --set /etc/nova/nova.conf placement project_domain_name default
# openstack-config --set /etc/nova/nova.conf placement user_domain_name default
# openstack-config --set /etc/nova/nova.conf placement project_name service
# openstack-config --set /etc/nova/nova.conf placement username nova
# openstack-config --set /etc/nova/nova.conf placement password passw0rd
# openstack-config --set /etc/nova/nova.conf placement os_region_name RegionOne
# openstack-config --set /etc/nova/nova.conf vnc enabled True
# openstack-config --set /etc/nova/nova.conf vnc keymap en-us
# openstack-config --set /etc/nova/nova.conf vnc vncserver_listen 0.0.0.0
# openstack-config --set /etc/nova/nova.conf vnc vncserver_proxyclient_address 172.30.126.6
# openstack-config --set /etc/nova/nova.conf vnc novncproxy_base_url http://172.30.126.4:6080/vnc_auto.html
# openstack-config --set /etc/nova/nova.conf glance api_servers http://controller1:9292
# openstack-config --set /etc/nova/nova.conf oslo_concurrency lock_path /var/lib/nova/tmp
# openstack-config --set /etc/nova/nova.conf libvirt virt_type qemu #如果是物理机记得改为kvm
2018-1-9-20:39
2. 设置libvirtd.service 和openstack-nova-compute.service开机启动
# systemctl enable libvirtd.service openstack-nova-compute.service
# systemctl restart libvirtd.service openstack-nova-compute.service
# systemctl status libvirtd.service openstack-nova-compute.service
3. 到controller上执行验证
# source /root/admin-openrc
# openstack compute service list
二、安装Neutron
1. 安装相关软件包
# yum install openstack-neutron-linuxbridge ebtables ipset -y
2. 配置neutron.conf
# cp /etc/neutron/neutron.conf /etc/neutron/neutron.conf.bak
# >/etc/neutron/neutron.conf
# openstack-config --set /etc/neutron/neutron.conf DEFAULT auth_strategy keystone
# openstack-config --set /etc/neutron/neutron.conf DEFAULT advertise_mtu True
# openstack-config --set /etc/neutron/neutron.conf DEFAULT dhcp_agents_per_network 2
# openstack-config --set /etc/neutron/neutron.conf DEFAULT control_exchange neutron
# openstack-config --set /etc/neutron/neutron.conf DEFAULT nova_url http://controller1:8774/v2
# openstack-config --set /etc/neutron/neutron.conf DEFAULT transport_url rabbit://openstack:passw0rd@controller1
# openstack-config --set /etc/neutron/neutron.conf keystone_authtoken auth_uri http://controller1:5000
# openstack-config --set /etc/neutron/neutron.conf keystone_authtoken auth_url http://controller1:35357
# openstack-config --set /etc/neutron/neutron.conf keystone_authtoken memcached_servers controller1:11211
# openstack-config --set /etc/neutron/neutron.conf keystone_authtoken auth_type password
# openstack-config --set /etc/neutron/neutron.conf keystone_authtoken project_domain_name default
# openstack-config --set /etc/neutron/neutron.conf keystone_authtoken user_domain_name default
# openstack-config --set /etc/neutron/neutron.conf keystone_authtoken project_name service
# openstack-config --set /etc/neutron/neutron.conf keystone_authtoken username neutron
# openstack-config --set /etc/neutron/neutron.conf keystone_authtoken password passw0rd
# openstack-config --set /etc/neutron/neutron.conf oslo_concurrency lock_path /var/lib/neutron/tmp
3. 配置/etc/neutron/plugins/ml2/linuxbridge_agent.ini
# openstack-config --set /etc/neutron/plugins/ml2/linuxbridge_agent.ini linux_bridge physical_interface_mappings
provider:eno50338560
# openstack-config --set /etc/neutron/plugins/ml2/linuxbridge_agent.ini vxlan enable_vxlan True
# openstack-config --set /etc/neutron/plugins/ml2/linuxbridge_agent.ini vxlan local_ip 172.30.126.6
# openstack-config --set /etc/neutron/plugins/ml2/linuxbridge_agent.ini vxlan l2_population True
# openstack-config --set /etc/neutron/plugins/ml2/linuxbridge_agent.ini securitygroup enable_security_group True
# openstack-config --set /etc/neutron/plugins/ml2/linuxbridge_agent.ini securitygroup firewall_driver
neutron.agent.linux.iptables_firewall.IptablesFirewallDriver
注意provider后面那个eno50338560网卡名做floating_ip 网卡的名称。
4. 配置nova.conf
# openstack-config --set /etc/nova/nova.conf neutron url http://controller1:9696
# openstack-config --set /etc/nova/nova.conf neutron auth_url http://controller1:35357
# openstack-config --set /etc/nova/nova.conf neutron auth_type password
# openstack-config --set /etc/nova/nova.conf neutron project_domain_name default
# openstack-config --set /etc/nova/nova.conf neutron user_domain_name default
# openstack-config --set /etc/nova/nova.conf neutron region_name RegionOne
# openstack-config --set /etc/nova/nova.conf neutron project_name service
# openstack-config --set /etc/nova/nova.conf neutron username neutron
# openstack-config --set /etc/nova/nova.conf neutron password passw0rd
5. 重启和enable相关服务
# systemctl restart libvirtd.service openstack-nova-compute.service
# systemctl enable neutron-linuxbridge-agent.service 计算节点只有neutron-agent服务
# systemctl restart neutron-linuxbridge-agent.service
# systemctl status libvirtd.service openstack-nova-compute.service neutron-linuxbridge-agent.service
三、计算节点结合Cinder
1.计算节点要是想用cinder,那么需要配置nova配置文件 (注意！这一步是在计算节点操作的）
# openstack-config --set /etc/nova/nova.conf cinder os_region_name RegionOne
# systemctl restart openstack-nova-compute.service
2.然后在controller上重启nova服务
# systemctl restart openstack-nova-api.service
# systemctl status openstack-nova-api.service
四. 在controler上执行验证
# source /root/admin-openrc
# neutron agent-list
# nova-manage cell_v2 discover_hosts
到此，Compute节点搭建完毕，运行nova host-list可以查看新加入的compute1节点
如果需要再添加另外一个compute节点，只要重复下第二步即可，记得把计算机名和IP地址改下。
创建配额命令
# openstack flavor create m1.tiny --id 1 --ram 512 --disk 1 --vcpus 1
# openstack flavor list
.
四，创建instance
thanks !
It’s over !!!
