blob: 99e983887ec886353b5a52199d7b03ddfb970f7d [file] [log] [blame] [view]
Dean Troyere9819d52012-03-21 11:25:06 -05001DevStack is a set of scripts and utilities to quickly deploy an OpenStack cloud.
Anthony Young63987872011-09-30 11:34:43 -07002
3# Goals
4
Dean Troyer5218d452012-02-04 02:13:23 -06005* To quickly build dev OpenStack environments in a clean Ubuntu or Fedora environment
Anthony Young073d17d2011-11-23 12:50:46 -08006* To describe working configurations of OpenStack (which code branches work together? what do config files look like for those branches?)
7* To make it easier for developers to dive into OpenStack so that they can productively contribute without having to understand every part of the system at once
Anthony Young63987872011-09-30 11:34:43 -07008* To make it easy to prototype cross-project features
Dean Troyerce043c42012-02-03 22:56:38 -06009* To sanity-check OpenStack builds (used in gating commits to the primary repos)
Jesse Andrewsba23cc72011-09-11 03:22:13 -070010
Jesse Andrewsb69d6ce2011-10-13 10:36:00 -070011Read more at http://devstack.org (built from the gh-pages branch)
12
Dean Troyere9819d52012-03-21 11:25:06 -050013IMPORTANT: Be sure to carefully read `stack.sh` and any other scripts you execute before you run them, as they install software and may alter your networking configuration. We strongly recommend that you run `stack.sh` in a clean and disposable vm when you are first getting started.
Anthony Young0e65abf2011-09-30 09:24:00 -070014
Dean Troyer2aa2a892013-08-04 19:53:19 -050015# DevStack on Xenserver
Renuka Aptec56885a2012-02-29 16:09:26 -080016
Dean Troyere9819d52012-03-21 11:25:06 -050017If you would like to use Xenserver as the hypervisor, please refer to the instructions in `./tools/xen/README.md`.
Renuka Aptec56885a2012-02-29 16:09:26 -080018
Dean Troyer2aa2a892013-08-04 19:53:19 -050019# DevStack on Docker
20
21If you would like to use Docker as the hypervisor, please refer to the instructions in `./tools/docker/README.md`.
22
Anthony Young073d17d2011-11-23 12:50:46 -080023# Versions
24
Dean Troyere9819d52012-03-21 11:25:06 -050025The devstack master branch generally points to trunk versions of OpenStack components. For older, stable versions, look for branches named stable/[release] in the DevStack repo. For example, you can do the following to create a diablo OpenStack cloud:
Anthony Young073d17d2011-11-23 12:50:46 -080026
27 git checkout stable/diablo
28 ./stack.sh
29
Dean Troyere9819d52012-03-21 11:25:06 -050030You can also pick specific OpenStack project releases by setting the appropriate `*_BRANCH` variables in `localrc` (look in `stackrc` for the default set). Usually just before a release there will be milestone-proposed branches that need to be tested::
Dean Troyerce043c42012-02-03 22:56:38 -060031
Dean Troyere9819d52012-03-21 11:25:06 -050032 GLANCE_REPO=https://github.com/openstack/glance.git
33 GLANCE_BRANCH=milestone-proposed
Dean Troyerce043c42012-02-03 22:56:38 -060034
35# Start A Dev Cloud
36
37Installing in a dedicated disposable vm is safer than installing on your dev machine! To start a dev cloud:
Anthony Young0e65abf2011-09-30 09:24:00 -070038
39 ./stack.sh
40
Anthony Young073d17d2011-11-23 12:50:46 -080041When the script finishes executing, you should be able to access OpenStack endpoints, like so:
Anthony Young63987872011-09-30 11:34:43 -070042
Tres Henryca85b792011-10-28 14:00:21 -070043* Horizon: http://myhost/
Anthony Young63987872011-09-30 11:34:43 -070044* Keystone: http://myhost:5000/v2.0/
45
Anthony Young073d17d2011-11-23 12:50:46 -080046We also provide an environment file that you can use to interact with your cloud via CLI:
47
48 # source openrc file to load your environment with osapi and ec2 creds
49 . openrc
50 # list instances
51 nova list
Dean Troyer0bd24102012-03-08 00:33:54 -060052
53If the EC2 API is your cup-o-tea, you can create credentials and use euca2ools:
54
55 # source eucarc to generate EC2 credentials and set up the environment
56 . eucarc
Anthony Young073d17d2011-11-23 12:50:46 -080057 # list instances using ec2 api
58 euca-describe-instances
59
Anthony Young63987872011-09-30 11:34:43 -070060# Customizing
61
Dean Troyere9819d52012-03-21 11:25:06 -050062You can override environment variables used in `stack.sh` by creating file name `localrc`. It is likely that you will need to do this to tweak your networking configuration should you need to access your cloud from a different host.
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +000063
Terry Wilson428af5a2012-11-01 16:12:39 -040064# Database Backend
65
66Multiple database backends are available. The available databases are defined in the lib/databases directory.
Dean Troyerafc29fe2013-02-07 15:56:24 -060067`mysql` is the default database, choose a different one by putting the following in `localrc`:
Terry Wilson428af5a2012-11-01 16:12:39 -040068
Dean Troyerafc29fe2013-02-07 15:56:24 -060069 disable_service mysql
70 enable_service postgresql
Terry Wilson428af5a2012-11-01 16:12:39 -040071
Dean Troyerafc29fe2013-02-07 15:56:24 -060072`mysql` is the default database.
Terry Wilson428af5a2012-11-01 16:12:39 -040073
ewindisch3bae7c22012-01-18 11:18:35 -050074# RPC Backend
75
76Multiple RPC backends are available. Currently, this
77includes RabbitMQ (default), Qpid, and ZeroMQ. Your backend of
78choice may be selected via the `localrc`.
79
80Note that selecting more than one RPC backend will result in a failure.
81
82Example (ZeroMQ):
83
84 ENABLED_SERVICES="$ENABLED_SERVICES,-rabbit,-qpid,zeromq"
85
86Example (Qpid):
87
88 ENABLED_SERVICES="$ENABLED_SERVICES,-rabbit,-zeromq,qpid"
89
zhang-hared98a5d02013-06-21 18:18:02 +080090# Apache Frontend
91
92Apache web server is enabled for wsgi services by setting `APACHE_ENABLED_SERVICES` in your localrc. But remember to enable these services at first as above.
93
94Example:
95 APACHE_ENABLED_SERVICES+=keystone,swift
96
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +000097# Swift
98
Ian Wienand0352f582013-07-24 13:01:32 +100099Swift is disabled by default. When enabled, it is configured with
100only one replica to avoid being IO/memory intensive on a small
101vm. When running with only one replica the account, container and
102object services will run directly in screen. The others services like
103replicator, updaters or auditor runs in background.
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +0000104
Ian Wienand0352f582013-07-24 13:01:32 +1000105If you would like to enable Swift you can add this to your `localrc` :
Chmouel Boudjnah0c3a5582013-03-06 10:58:33 +0100106
Ian Wienand0352f582013-07-24 13:01:32 +1000107 enable_service s-proxy s-object s-container s-account
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +0000108
Ian Wienand0352f582013-07-24 13:01:32 +1000109If you want a minimal Swift install with only Swift and Keystone you
110can have this instead in your `localrc`:
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000111
Doug Hellmannf04178f2012-07-05 17:10:03 -0400112 disable_all_services
Chmouel Boudjnah0c3a5582013-03-06 10:58:33 +0100113 enable_service key mysql s-proxy s-object s-container s-account
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000114
Ian Wienand0352f582013-07-24 13:01:32 +1000115If you only want to do some testing of a real normal swift cluster
116with multiple replicas you can do so by customizing the variable
117`SWIFT_REPLICAS` in your `localrc` (usually to 3).
Chmouel Boudjnah0c3a5582013-03-06 10:58:33 +0100118
119# Swift S3
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000120
Ian Wienand0352f582013-07-24 13:01:32 +1000121If you are enabling `swift3` in `ENABLED_SERVICES` devstack will
122install the swift3 middleware emulation. Swift will be configured to
123act as a S3 endpoint for Keystone so effectively replacing the
124`nova-objectstore`.
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000125
Ian Wienand0352f582013-07-24 13:01:32 +1000126Only Swift proxy server is launched in the screen session all other
127services are started in background and managed by `swift-init` tool.
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700128
Mark McClainb05c8762013-07-06 23:29:39 -0400129# Neutron
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700130
131Basic Setup
132
Ian Wienand0352f582013-07-24 13:01:32 +1000133In order to enable Neutron a single node setup, you'll need the
134following settings in your `localrc` :
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700135
136 disable_service n-net
137 enable_service q-svc
138 enable_service q-agt
139 enable_service q-dhcp
140 enable_service q-l3
141 enable_service q-meta
Mark McClainb05c8762013-07-06 23:29:39 -0400142 enable_service neutron
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700143 # Optional, to enable tempest configuration as part of devstack
144 enable_service tempest
145
Dean Troyercc6b4432013-04-08 15:38:03 -0500146Then run `stack.sh` as normal.
147
Simon Pasquierca96b0a2013-07-09 16:59:12 +0200148devstack supports adding specific Neutron configuration flags to the service, Open vSwitch plugin and LinuxBridge plugin configuration files. To make use of this feature, the following variables are defined and can be configured in your `localrc` file:
Kyle Mesteryebfac642013-05-17 15:20:56 -0500149
Simon Pasquierca96b0a2013-07-09 16:59:12 +0200150 Variable Name Config File Section Modified
Kyle Mesteryebfac642013-05-17 15:20:56 -0500151 -------------------------------------------------------------------------------------
Simon Pasquierca96b0a2013-07-09 16:59:12 +0200152 Q_SRV_EXTRA_OPTS Plugin `OVS` (for Open Vswitch) or `LINUX_BRIDGE` (for LinuxBridge)
153 Q_AGENT_EXTRA_AGENT_OPTS Plugin AGENT
154 Q_AGENT_EXTRA_SRV_OPTS Plugin `OVS` (for Open Vswitch) or `LINUX_BRIDGE` (for LinuxBridge)
155 Q_SRV_EXTRA_DEFAULT_OPTS Service DEFAULT
Kyle Mesteryebfac642013-05-17 15:20:56 -0500156
157An example of using the variables in your `localrc` is below:
158
159 Q_AGENT_EXTRA_AGENT_OPTS=(tunnel_type=vxlan vxlan_udp_port=8472)
160 Q_SRV_EXTRA_OPTS=(tenant_network_type=vxlan)
161
Kyle Mesteryb7726592013-07-19 14:26:53 +0000162devstack also supports configuring the Neutron ML2 plugin. The ML2 plugin can run with the OVS, LinuxBridge, or Hyper-V agents on compute hosts. A simple way to configure the ml2 plugin is shown below:
163
164 # VLAN configuration
165 Q_PLUGIN=ml2
166 ENABLE_TENANT_VLANS=True
167
168 # GRE tunnel configuration
169 Q_PLUGIN=ml2
170 ENABLE_TENANT_TUNNELS=True
171
172 # VXLAN tunnel configuration
173 Q_PLUGIN=ml2
174 Q_ML2_TENANT_NETWORK_TYPE=vxlan
175
176The above will default in devstack to using the OVS on each compute host. To change this, set the `Q_AGENT` variable to the agent you want to run (e.g. linuxbridge).
177
178 Variable Name Notes
179 -------------------------------------------------------------------------------------
180 Q_AGENT This specifies which agent to run with the ML2 Plugin (either `openvswitch` or `linuxbridge`).
181 Q_ML2_PLUGIN_MECHANISM_DRIVERS The ML2 MechanismDrivers to load. The default is none. Note, ML2 will work with the OVS and LinuxBridge agents by default.
182 Q_ML2_PLUGIN_TYPE_DRIVERS The ML2 TypeDrivers to load. Defaults to all available TypeDrivers.
183 Q_ML2_PLUGIN_GRE_TYPE_OPTIONS GRE TypeDriver options. Defaults to none.
184 Q_ML2_PLUGIN_VXLAN_TYPE_OPTIONS VXLAN TypeDriver options. Defaults to none.
185 Q_ML2_PLUGIN_VLAN_TYPE_OPTIONS VLAN TypeDriver options. Defaults to none.
186 Q_AGENT_EXTRA_AGENT_OPTS Extra configuration options to pass to the OVS or LinuxBridge Agent.
187
Steve Baker389b3a02013-08-01 10:44:09 +1200188# Heat
189
190Heat is disabled by default. To enable it you'll need the following settings
191in your `localrc` :
192
193 enable_service heat h-api h-api-cfn h-api-cw h-eng
194
195Heat can also run in standalone mode, and be configured to orchestrate
196on an external OpenStack cloud. To launch only Heat in standalone mode
197you'll need the following settings in your `localrc` :
198
199 disable_all_services
200 enable_service rabbit mysql heat h-api h-api-cfn h-api-cw h-eng
201 HEAT_STANDALONE=True
202 KEYSTONE_SERVICE_HOST=...
203 KEYSTONE_AUTH_HOST=...
204
Dean Troyercc6b4432013-04-08 15:38:03 -0500205# Tempest
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700206
207If tempest has been successfully configured, a basic set of smoke tests can be run as follows:
208
209 $ cd /opt/stack/tempest
Kui Shif9b47382013-08-02 05:53:58 +0800210 $ nosetests tempest/scenario/test_network_basic_ops.py
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700211
Dean Troyercc6b4432013-04-08 15:38:03 -0500212# Multi-Node Setup
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700213
Mark McClainb05c8762013-07-06 23:29:39 -0400214A more interesting setup involves running multiple compute nodes, with Neutron networks connecting VMs on different compute nodes.
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700215You should run at least one "controller node", which should have a `stackrc` that includes at least:
216
217 disable_service n-net
218 enable_service q-svc
219 enable_service q-agt
220 enable_service q-dhcp
221 enable_service q-l3
222 enable_service q-meta
Mark McClainb05c8762013-07-06 23:29:39 -0400223 enable_service neutron
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700224
225You likely want to change your `localrc` to run a scheduler that will balance VMs across hosts:
226
227 SCHEDULER=nova.scheduler.simple.SimpleScheduler
228
229You can then run many compute nodes, each of which should have a `stackrc` which includes the following, with the IP address of the above controller node:
230
Mark McClainb05c8762013-07-06 23:29:39 -0400231 ENABLED_SERVICES=n-cpu,rabbit,g-api,neutron,q-agt
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700232 SERVICE_HOST=[IP of controller node]
233 MYSQL_HOST=$SERVICE_HOST
234 RABBIT_HOST=$SERVICE_HOST
235 Q_HOST=$SERVICE_HOST
Eric Windisch800bf382013-05-24 11:21:11 -0400236 MATCHMAKER_REDIS_HOST=$SERVICE_HOST
Kieran Spearfb2a3ae2013-03-11 23:55:49 +0000237
238# Cells
239
240Cells is a new scaling option with a full spec at http://wiki.openstack.org/blueprint-nova-compute-cells.
241
242To setup a cells environment add the following to your `localrc`:
243
244 enable_service n-cell
Kieran Spearfb2a3ae2013-03-11 23:55:49 +0000245
Chris Behrensc62c2b92013-07-24 03:56:13 -0700246Be aware that there are some features currently missing in cells, one notable one being security groups. The exercises have been patched to disable functionality not supported by cells.