blob: 95c90bc9244122b13e65026646e6af8d512597ea [file] [log] [blame] [view]
Dean Troyere9819d52012-03-21 11:25:06 -05001DevStack is a set of scripts and utilities to quickly deploy an OpenStack cloud.
Anthony Young63987872011-09-30 11:34:43 -07002
3# Goals
4
Dean Troyer5218d452012-02-04 02:13:23 -06005* To quickly build dev OpenStack environments in a clean Ubuntu or Fedora environment
Anthony Young073d17d2011-11-23 12:50:46 -08006* To describe working configurations of OpenStack (which code branches work together? what do config files look like for those branches?)
7* To make it easier for developers to dive into OpenStack so that they can productively contribute without having to understand every part of the system at once
Anthony Young63987872011-09-30 11:34:43 -07008* To make it easy to prototype cross-project features
Dean Troyerce043c42012-02-03 22:56:38 -06009* To sanity-check OpenStack builds (used in gating commits to the primary repos)
Jesse Andrewsba23cc72011-09-11 03:22:13 -070010
Jesse Andrewsb69d6ce2011-10-13 10:36:00 -070011Read more at http://devstack.org (built from the gh-pages branch)
12
Dean Troyere9819d52012-03-21 11:25:06 -050013IMPORTANT: Be sure to carefully read `stack.sh` and any other scripts you execute before you run them, as they install software and may alter your networking configuration. We strongly recommend that you run `stack.sh` in a clean and disposable vm when you are first getting started.
Anthony Young0e65abf2011-09-30 09:24:00 -070014
Renuka Aptec56885a2012-02-29 16:09:26 -080015# Devstack on Xenserver
16
Dean Troyere9819d52012-03-21 11:25:06 -050017If you would like to use Xenserver as the hypervisor, please refer to the instructions in `./tools/xen/README.md`.
Renuka Aptec56885a2012-02-29 16:09:26 -080018
Anthony Young073d17d2011-11-23 12:50:46 -080019# Versions
20
Dean Troyere9819d52012-03-21 11:25:06 -050021The devstack master branch generally points to trunk versions of OpenStack components. For older, stable versions, look for branches named stable/[release] in the DevStack repo. For example, you can do the following to create a diablo OpenStack cloud:
Anthony Young073d17d2011-11-23 12:50:46 -080022
23 git checkout stable/diablo
24 ./stack.sh
25
Dean Troyere9819d52012-03-21 11:25:06 -050026You can also pick specific OpenStack project releases by setting the appropriate `*_BRANCH` variables in `localrc` (look in `stackrc` for the default set). Usually just before a release there will be milestone-proposed branches that need to be tested::
Dean Troyerce043c42012-02-03 22:56:38 -060027
Dean Troyere9819d52012-03-21 11:25:06 -050028 GLANCE_REPO=https://github.com/openstack/glance.git
29 GLANCE_BRANCH=milestone-proposed
Dean Troyerce043c42012-02-03 22:56:38 -060030
31# Start A Dev Cloud
32
33Installing in a dedicated disposable vm is safer than installing on your dev machine! To start a dev cloud:
Anthony Young0e65abf2011-09-30 09:24:00 -070034
35 ./stack.sh
36
Anthony Young073d17d2011-11-23 12:50:46 -080037When the script finishes executing, you should be able to access OpenStack endpoints, like so:
Anthony Young63987872011-09-30 11:34:43 -070038
Tres Henryca85b792011-10-28 14:00:21 -070039* Horizon: http://myhost/
Anthony Young63987872011-09-30 11:34:43 -070040* Keystone: http://myhost:5000/v2.0/
41
Anthony Young073d17d2011-11-23 12:50:46 -080042We also provide an environment file that you can use to interact with your cloud via CLI:
43
44 # source openrc file to load your environment with osapi and ec2 creds
45 . openrc
46 # list instances
47 nova list
Dean Troyer0bd24102012-03-08 00:33:54 -060048
49If the EC2 API is your cup-o-tea, you can create credentials and use euca2ools:
50
51 # source eucarc to generate EC2 credentials and set up the environment
52 . eucarc
Anthony Young073d17d2011-11-23 12:50:46 -080053 # list instances using ec2 api
54 euca-describe-instances
55
Anthony Young63987872011-09-30 11:34:43 -070056# Customizing
57
Dean Troyere9819d52012-03-21 11:25:06 -050058You can override environment variables used in `stack.sh` by creating file name `localrc`. It is likely that you will need to do this to tweak your networking configuration should you need to access your cloud from a different host.
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +000059
Terry Wilson428af5a2012-11-01 16:12:39 -040060# Database Backend
61
62Multiple database backends are available. The available databases are defined in the lib/databases directory.
Dean Troyerafc29fe2013-02-07 15:56:24 -060063`mysql` is the default database, choose a different one by putting the following in `localrc`:
Terry Wilson428af5a2012-11-01 16:12:39 -040064
Dean Troyerafc29fe2013-02-07 15:56:24 -060065 disable_service mysql
66 enable_service postgresql
Terry Wilson428af5a2012-11-01 16:12:39 -040067
Dean Troyerafc29fe2013-02-07 15:56:24 -060068`mysql` is the default database.
Terry Wilson428af5a2012-11-01 16:12:39 -040069
ewindisch3bae7c22012-01-18 11:18:35 -050070# RPC Backend
71
72Multiple RPC backends are available. Currently, this
73includes RabbitMQ (default), Qpid, and ZeroMQ. Your backend of
74choice may be selected via the `localrc`.
75
76Note that selecting more than one RPC backend will result in a failure.
77
78Example (ZeroMQ):
79
80 ENABLED_SERVICES="$ENABLED_SERVICES,-rabbit,-qpid,zeromq"
81
82Example (Qpid):
83
84 ENABLED_SERVICES="$ENABLED_SERVICES,-rabbit,-zeromq,qpid"
85
zhang-hared98a5d02013-06-21 18:18:02 +080086# Apache Frontend
87
88Apache web server is enabled for wsgi services by setting `APACHE_ENABLED_SERVICES` in your localrc. But remember to enable these services at first as above.
89
90Example:
91 APACHE_ENABLED_SERVICES+=keystone,swift
92
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +000093# Swift
94
Ian Wienand0352f582013-07-24 13:01:32 +100095Swift is disabled by default. When enabled, it is configured with
96only one replica to avoid being IO/memory intensive on a small
97vm. When running with only one replica the account, container and
98object services will run directly in screen. The others services like
99replicator, updaters or auditor runs in background.
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +0000100
Ian Wienand0352f582013-07-24 13:01:32 +1000101If you would like to enable Swift you can add this to your `localrc` :
Chmouel Boudjnah0c3a5582013-03-06 10:58:33 +0100102
Ian Wienand0352f582013-07-24 13:01:32 +1000103 enable_service s-proxy s-object s-container s-account
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +0000104
Ian Wienand0352f582013-07-24 13:01:32 +1000105If you want a minimal Swift install with only Swift and Keystone you
106can have this instead in your `localrc`:
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000107
Doug Hellmannf04178f2012-07-05 17:10:03 -0400108 disable_all_services
Chmouel Boudjnah0c3a5582013-03-06 10:58:33 +0100109 enable_service key mysql s-proxy s-object s-container s-account
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000110
Ian Wienand0352f582013-07-24 13:01:32 +1000111If you only want to do some testing of a real normal swift cluster
112with multiple replicas you can do so by customizing the variable
113`SWIFT_REPLICAS` in your `localrc` (usually to 3).
Chmouel Boudjnah0c3a5582013-03-06 10:58:33 +0100114
115# Swift S3
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000116
Ian Wienand0352f582013-07-24 13:01:32 +1000117If you are enabling `swift3` in `ENABLED_SERVICES` devstack will
118install the swift3 middleware emulation. Swift will be configured to
119act as a S3 endpoint for Keystone so effectively replacing the
120`nova-objectstore`.
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000121
Ian Wienand0352f582013-07-24 13:01:32 +1000122Only Swift proxy server is launched in the screen session all other
123services are started in background and managed by `swift-init` tool.
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700124
Mark McClainb05c8762013-07-06 23:29:39 -0400125# Neutron
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700126
127Basic Setup
128
Ian Wienand0352f582013-07-24 13:01:32 +1000129In order to enable Neutron a single node setup, you'll need the
130following settings in your `localrc` :
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700131
132 disable_service n-net
133 enable_service q-svc
134 enable_service q-agt
135 enable_service q-dhcp
136 enable_service q-l3
137 enable_service q-meta
Mark McClainb05c8762013-07-06 23:29:39 -0400138 enable_service neutron
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700139 # Optional, to enable tempest configuration as part of devstack
140 enable_service tempest
141
Dean Troyercc6b4432013-04-08 15:38:03 -0500142Then run `stack.sh` as normal.
143
Simon Pasquierca96b0a2013-07-09 16:59:12 +0200144devstack supports adding specific Neutron configuration flags to the service, Open vSwitch plugin and LinuxBridge plugin configuration files. To make use of this feature, the following variables are defined and can be configured in your `localrc` file:
Kyle Mesteryebfac642013-05-17 15:20:56 -0500145
Simon Pasquierca96b0a2013-07-09 16:59:12 +0200146 Variable Name Config File Section Modified
Kyle Mesteryebfac642013-05-17 15:20:56 -0500147 -------------------------------------------------------------------------------------
Simon Pasquierca96b0a2013-07-09 16:59:12 +0200148 Q_SRV_EXTRA_OPTS Plugin `OVS` (for Open Vswitch) or `LINUX_BRIDGE` (for LinuxBridge)
149 Q_AGENT_EXTRA_AGENT_OPTS Plugin AGENT
150 Q_AGENT_EXTRA_SRV_OPTS Plugin `OVS` (for Open Vswitch) or `LINUX_BRIDGE` (for LinuxBridge)
151 Q_SRV_EXTRA_DEFAULT_OPTS Service DEFAULT
Kyle Mesteryebfac642013-05-17 15:20:56 -0500152
153An example of using the variables in your `localrc` is below:
154
155 Q_AGENT_EXTRA_AGENT_OPTS=(tunnel_type=vxlan vxlan_udp_port=8472)
156 Q_SRV_EXTRA_OPTS=(tenant_network_type=vxlan)
157
Kyle Mesteryb7726592013-07-19 14:26:53 +0000158devstack also supports configuring the Neutron ML2 plugin. The ML2 plugin can run with the OVS, LinuxBridge, or Hyper-V agents on compute hosts. A simple way to configure the ml2 plugin is shown below:
159
160 # VLAN configuration
161 Q_PLUGIN=ml2
162 ENABLE_TENANT_VLANS=True
163
164 # GRE tunnel configuration
165 Q_PLUGIN=ml2
166 ENABLE_TENANT_TUNNELS=True
167
168 # VXLAN tunnel configuration
169 Q_PLUGIN=ml2
170 Q_ML2_TENANT_NETWORK_TYPE=vxlan
171
172The above will default in devstack to using the OVS on each compute host. To change this, set the `Q_AGENT` variable to the agent you want to run (e.g. linuxbridge).
173
174 Variable Name Notes
175 -------------------------------------------------------------------------------------
176 Q_AGENT This specifies which agent to run with the ML2 Plugin (either `openvswitch` or `linuxbridge`).
177 Q_ML2_PLUGIN_MECHANISM_DRIVERS The ML2 MechanismDrivers to load. The default is none. Note, ML2 will work with the OVS and LinuxBridge agents by default.
178 Q_ML2_PLUGIN_TYPE_DRIVERS The ML2 TypeDrivers to load. Defaults to all available TypeDrivers.
179 Q_ML2_PLUGIN_GRE_TYPE_OPTIONS GRE TypeDriver options. Defaults to none.
180 Q_ML2_PLUGIN_VXLAN_TYPE_OPTIONS VXLAN TypeDriver options. Defaults to none.
181 Q_ML2_PLUGIN_VLAN_TYPE_OPTIONS VLAN TypeDriver options. Defaults to none.
182 Q_AGENT_EXTRA_AGENT_OPTS Extra configuration options to pass to the OVS or LinuxBridge Agent.
183
Steve Baker389b3a02013-08-01 10:44:09 +1200184# Heat
185
186Heat is disabled by default. To enable it you'll need the following settings
187in your `localrc` :
188
189 enable_service heat h-api h-api-cfn h-api-cw h-eng
190
191Heat can also run in standalone mode, and be configured to orchestrate
192on an external OpenStack cloud. To launch only Heat in standalone mode
193you'll need the following settings in your `localrc` :
194
195 disable_all_services
196 enable_service rabbit mysql heat h-api h-api-cfn h-api-cw h-eng
197 HEAT_STANDALONE=True
198 KEYSTONE_SERVICE_HOST=...
199 KEYSTONE_AUTH_HOST=...
200
Dean Troyercc6b4432013-04-08 15:38:03 -0500201# Tempest
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700202
203If tempest has been successfully configured, a basic set of smoke tests can be run as follows:
204
205 $ cd /opt/stack/tempest
206 $ nosetests tempest/tests/network/test_network_basic_ops.py
207
Dean Troyercc6b4432013-04-08 15:38:03 -0500208# Multi-Node Setup
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700209
Mark McClainb05c8762013-07-06 23:29:39 -0400210A more interesting setup involves running multiple compute nodes, with Neutron networks connecting VMs on different compute nodes.
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700211You should run at least one "controller node", which should have a `stackrc` that includes at least:
212
213 disable_service n-net
214 enable_service q-svc
215 enable_service q-agt
216 enable_service q-dhcp
217 enable_service q-l3
218 enable_service q-meta
Mark McClainb05c8762013-07-06 23:29:39 -0400219 enable_service neutron
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700220
221You likely want to change your `localrc` to run a scheduler that will balance VMs across hosts:
222
223 SCHEDULER=nova.scheduler.simple.SimpleScheduler
224
225You can then run many compute nodes, each of which should have a `stackrc` which includes the following, with the IP address of the above controller node:
226
Mark McClainb05c8762013-07-06 23:29:39 -0400227 ENABLED_SERVICES=n-cpu,rabbit,g-api,neutron,q-agt
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700228 SERVICE_HOST=[IP of controller node]
229 MYSQL_HOST=$SERVICE_HOST
230 RABBIT_HOST=$SERVICE_HOST
231 Q_HOST=$SERVICE_HOST
Eric Windisch800bf382013-05-24 11:21:11 -0400232 MATCHMAKER_REDIS_HOST=$SERVICE_HOST
Kieran Spearfb2a3ae2013-03-11 23:55:49 +0000233
234# Cells
235
236Cells is a new scaling option with a full spec at http://wiki.openstack.org/blueprint-nova-compute-cells.
237
238To setup a cells environment add the following to your `localrc`:
239
240 enable_service n-cell
Kieran Spearfb2a3ae2013-03-11 23:55:49 +0000241
Chris Behrensc62c2b92013-07-24 03:56:13 -0700242Be aware that there are some features currently missing in cells, one notable one being security groups. The exercises have been patched to disable functionality not supported by cells.