blob: c94d8bd23af6679fdb1e0fb2326502efea1e8402 [file] [log] [blame] [view]
Dean Troyere9819d52012-03-21 11:25:06 -05001DevStack is a set of scripts and utilities to quickly deploy an OpenStack cloud.
Anthony Young63987872011-09-30 11:34:43 -07002
3# Goals
4
Dean Troyer5218d452012-02-04 02:13:23 -06005* To quickly build dev OpenStack environments in a clean Ubuntu or Fedora environment
Anthony Young073d17d2011-11-23 12:50:46 -08006* To describe working configurations of OpenStack (which code branches work together? what do config files look like for those branches?)
7* To make it easier for developers to dive into OpenStack so that they can productively contribute without having to understand every part of the system at once
Anthony Young63987872011-09-30 11:34:43 -07008* To make it easy to prototype cross-project features
Dean Troyerce043c42012-02-03 22:56:38 -06009* To sanity-check OpenStack builds (used in gating commits to the primary repos)
Jesse Andrewsba23cc72011-09-11 03:22:13 -070010
Jesse Andrewsb69d6ce2011-10-13 10:36:00 -070011Read more at http://devstack.org (built from the gh-pages branch)
12
Dean Troyere9819d52012-03-21 11:25:06 -050013IMPORTANT: Be sure to carefully read `stack.sh` and any other scripts you execute before you run them, as they install software and may alter your networking configuration. We strongly recommend that you run `stack.sh` in a clean and disposable vm when you are first getting started.
Anthony Young0e65abf2011-09-30 09:24:00 -070014
Dean Troyer2aa2a892013-08-04 19:53:19 -050015# DevStack on Xenserver
Renuka Aptec56885a2012-02-29 16:09:26 -080016
Dean Troyere9819d52012-03-21 11:25:06 -050017If you would like to use Xenserver as the hypervisor, please refer to the instructions in `./tools/xen/README.md`.
Renuka Aptec56885a2012-02-29 16:09:26 -080018
Dean Troyer2aa2a892013-08-04 19:53:19 -050019# DevStack on Docker
20
21If you would like to use Docker as the hypervisor, please refer to the instructions in `./tools/docker/README.md`.
22
Anthony Young073d17d2011-11-23 12:50:46 -080023# Versions
24
Dean Troyere9819d52012-03-21 11:25:06 -050025The devstack master branch generally points to trunk versions of OpenStack components. For older, stable versions, look for branches named stable/[release] in the DevStack repo. For example, you can do the following to create a diablo OpenStack cloud:
Anthony Young073d17d2011-11-23 12:50:46 -080026
27 git checkout stable/diablo
28 ./stack.sh
29
Dean Troyere9819d52012-03-21 11:25:06 -050030You can also pick specific OpenStack project releases by setting the appropriate `*_BRANCH` variables in `localrc` (look in `stackrc` for the default set). Usually just before a release there will be milestone-proposed branches that need to be tested::
Dean Troyerce043c42012-02-03 22:56:38 -060031
Dean Troyere9819d52012-03-21 11:25:06 -050032 GLANCE_REPO=https://github.com/openstack/glance.git
33 GLANCE_BRANCH=milestone-proposed
Dean Troyerce043c42012-02-03 22:56:38 -060034
35# Start A Dev Cloud
36
37Installing in a dedicated disposable vm is safer than installing on your dev machine! To start a dev cloud:
Anthony Young0e65abf2011-09-30 09:24:00 -070038
39 ./stack.sh
40
Anthony Young073d17d2011-11-23 12:50:46 -080041When the script finishes executing, you should be able to access OpenStack endpoints, like so:
Anthony Young63987872011-09-30 11:34:43 -070042
Tres Henryca85b792011-10-28 14:00:21 -070043* Horizon: http://myhost/
Anthony Young63987872011-09-30 11:34:43 -070044* Keystone: http://myhost:5000/v2.0/
45
Anthony Young073d17d2011-11-23 12:50:46 -080046We also provide an environment file that you can use to interact with your cloud via CLI:
47
48 # source openrc file to load your environment with osapi and ec2 creds
49 . openrc
50 # list instances
51 nova list
Dean Troyer0bd24102012-03-08 00:33:54 -060052
53If the EC2 API is your cup-o-tea, you can create credentials and use euca2ools:
54
55 # source eucarc to generate EC2 credentials and set up the environment
56 . eucarc
Anthony Young073d17d2011-11-23 12:50:46 -080057 # list instances using ec2 api
58 euca-describe-instances
59
Anthony Young63987872011-09-30 11:34:43 -070060# Customizing
61
Dean Troyere9819d52012-03-21 11:25:06 -050062You can override environment variables used in `stack.sh` by creating file name `localrc`. It is likely that you will need to do this to tweak your networking configuration should you need to access your cloud from a different host.
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +000063
Terry Wilson428af5a2012-11-01 16:12:39 -040064# Database Backend
65
66Multiple database backends are available. The available databases are defined in the lib/databases directory.
Dean Troyerafc29fe2013-02-07 15:56:24 -060067`mysql` is the default database, choose a different one by putting the following in `localrc`:
Terry Wilson428af5a2012-11-01 16:12:39 -040068
Dean Troyerafc29fe2013-02-07 15:56:24 -060069 disable_service mysql
70 enable_service postgresql
Terry Wilson428af5a2012-11-01 16:12:39 -040071
Dean Troyerafc29fe2013-02-07 15:56:24 -060072`mysql` is the default database.
Terry Wilson428af5a2012-11-01 16:12:39 -040073
ewindisch3bae7c22012-01-18 11:18:35 -050074# RPC Backend
75
76Multiple RPC backends are available. Currently, this
77includes RabbitMQ (default), Qpid, and ZeroMQ. Your backend of
78choice may be selected via the `localrc`.
79
80Note that selecting more than one RPC backend will result in a failure.
81
82Example (ZeroMQ):
83
84 ENABLED_SERVICES="$ENABLED_SERVICES,-rabbit,-qpid,zeromq"
85
86Example (Qpid):
87
88 ENABLED_SERVICES="$ENABLED_SERVICES,-rabbit,-zeromq,qpid"
89
zhang-hared98a5d02013-06-21 18:18:02 +080090# Apache Frontend
91
92Apache web server is enabled for wsgi services by setting `APACHE_ENABLED_SERVICES` in your localrc. But remember to enable these services at first as above.
93
94Example:
95 APACHE_ENABLED_SERVICES+=keystone,swift
96
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +000097# Swift
98
Ian Wienand0352f582013-07-24 13:01:32 +100099Swift is disabled by default. When enabled, it is configured with
100only one replica to avoid being IO/memory intensive on a small
101vm. When running with only one replica the account, container and
102object services will run directly in screen. The others services like
103replicator, updaters or auditor runs in background.
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +0000104
Ian Wienand0352f582013-07-24 13:01:32 +1000105If you would like to enable Swift you can add this to your `localrc` :
Chmouel Boudjnah0c3a5582013-03-06 10:58:33 +0100106
Ian Wienand0352f582013-07-24 13:01:32 +1000107 enable_service s-proxy s-object s-container s-account
Chmouel Boudjnah782f24e2012-02-29 13:42:44 +0000108
Ian Wienand0352f582013-07-24 13:01:32 +1000109If you want a minimal Swift install with only Swift and Keystone you
110can have this instead in your `localrc`:
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000111
Doug Hellmannf04178f2012-07-05 17:10:03 -0400112 disable_all_services
Chmouel Boudjnah0c3a5582013-03-06 10:58:33 +0100113 enable_service key mysql s-proxy s-object s-container s-account
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000114
Ian Wienand0352f582013-07-24 13:01:32 +1000115If you only want to do some testing of a real normal swift cluster
116with multiple replicas you can do so by customizing the variable
117`SWIFT_REPLICAS` in your `localrc` (usually to 3).
Chmouel Boudjnah0c3a5582013-03-06 10:58:33 +0100118
119# Swift S3
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000120
Ian Wienand0352f582013-07-24 13:01:32 +1000121If you are enabling `swift3` in `ENABLED_SERVICES` devstack will
122install the swift3 middleware emulation. Swift will be configured to
123act as a S3 endpoint for Keystone so effectively replacing the
124`nova-objectstore`.
Chmouel Boudjnah504f8712012-03-15 20:43:26 +0000125
Ian Wienand0352f582013-07-24 13:01:32 +1000126Only Swift proxy server is launched in the screen session all other
127services are started in background and managed by `swift-init` tool.
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700128
Mark McClainb05c8762013-07-06 23:29:39 -0400129# Neutron
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700130
131Basic Setup
132
Ian Wienand0352f582013-07-24 13:01:32 +1000133In order to enable Neutron a single node setup, you'll need the
134following settings in your `localrc` :
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700135
136 disable_service n-net
137 enable_service q-svc
138 enable_service q-agt
139 enable_service q-dhcp
140 enable_service q-l3
141 enable_service q-meta
Emilien Macchi40546f72013-09-24 15:10:25 +0200142 enable_service q-metering
Mark McClainb05c8762013-07-06 23:29:39 -0400143 enable_service neutron
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700144 # Optional, to enable tempest configuration as part of devstack
145 enable_service tempest
146
Dean Troyercc6b4432013-04-08 15:38:03 -0500147Then run `stack.sh` as normal.
148
Simon Pasquierca96b0a2013-07-09 16:59:12 +0200149devstack supports adding specific Neutron configuration flags to the service, Open vSwitch plugin and LinuxBridge plugin configuration files. To make use of this feature, the following variables are defined and can be configured in your `localrc` file:
Kyle Mesteryebfac642013-05-17 15:20:56 -0500150
Simon Pasquierca96b0a2013-07-09 16:59:12 +0200151 Variable Name Config File Section Modified
Kyle Mesteryebfac642013-05-17 15:20:56 -0500152 -------------------------------------------------------------------------------------
Simon Pasquierca96b0a2013-07-09 16:59:12 +0200153 Q_SRV_EXTRA_OPTS Plugin `OVS` (for Open Vswitch) or `LINUX_BRIDGE` (for LinuxBridge)
154 Q_AGENT_EXTRA_AGENT_OPTS Plugin AGENT
155 Q_AGENT_EXTRA_SRV_OPTS Plugin `OVS` (for Open Vswitch) or `LINUX_BRIDGE` (for LinuxBridge)
156 Q_SRV_EXTRA_DEFAULT_OPTS Service DEFAULT
Kyle Mesteryebfac642013-05-17 15:20:56 -0500157
158An example of using the variables in your `localrc` is below:
159
160 Q_AGENT_EXTRA_AGENT_OPTS=(tunnel_type=vxlan vxlan_udp_port=8472)
161 Q_SRV_EXTRA_OPTS=(tenant_network_type=vxlan)
162
Kyle Mesteryb7726592013-07-19 14:26:53 +0000163devstack also supports configuring the Neutron ML2 plugin. The ML2 plugin can run with the OVS, LinuxBridge, or Hyper-V agents on compute hosts. A simple way to configure the ml2 plugin is shown below:
164
165 # VLAN configuration
166 Q_PLUGIN=ml2
167 ENABLE_TENANT_VLANS=True
168
169 # GRE tunnel configuration
170 Q_PLUGIN=ml2
171 ENABLE_TENANT_TUNNELS=True
172
173 # VXLAN tunnel configuration
174 Q_PLUGIN=ml2
175 Q_ML2_TENANT_NETWORK_TYPE=vxlan
176
177The above will default in devstack to using the OVS on each compute host. To change this, set the `Q_AGENT` variable to the agent you want to run (e.g. linuxbridge).
178
179 Variable Name Notes
180 -------------------------------------------------------------------------------------
181 Q_AGENT This specifies which agent to run with the ML2 Plugin (either `openvswitch` or `linuxbridge`).
182 Q_ML2_PLUGIN_MECHANISM_DRIVERS The ML2 MechanismDrivers to load. The default is none. Note, ML2 will work with the OVS and LinuxBridge agents by default.
183 Q_ML2_PLUGIN_TYPE_DRIVERS The ML2 TypeDrivers to load. Defaults to all available TypeDrivers.
184 Q_ML2_PLUGIN_GRE_TYPE_OPTIONS GRE TypeDriver options. Defaults to none.
185 Q_ML2_PLUGIN_VXLAN_TYPE_OPTIONS VXLAN TypeDriver options. Defaults to none.
186 Q_ML2_PLUGIN_VLAN_TYPE_OPTIONS VLAN TypeDriver options. Defaults to none.
187 Q_AGENT_EXTRA_AGENT_OPTS Extra configuration options to pass to the OVS or LinuxBridge Agent.
188
Steve Baker389b3a02013-08-01 10:44:09 +1200189# Heat
190
191Heat is disabled by default. To enable it you'll need the following settings
192in your `localrc` :
193
194 enable_service heat h-api h-api-cfn h-api-cw h-eng
195
196Heat can also run in standalone mode, and be configured to orchestrate
197on an external OpenStack cloud. To launch only Heat in standalone mode
198you'll need the following settings in your `localrc` :
199
200 disable_all_services
201 enable_service rabbit mysql heat h-api h-api-cfn h-api-cw h-eng
202 HEAT_STANDALONE=True
203 KEYSTONE_SERVICE_HOST=...
204 KEYSTONE_AUTH_HOST=...
205
Dean Troyercc6b4432013-04-08 15:38:03 -0500206# Tempest
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700207
208If tempest has been successfully configured, a basic set of smoke tests can be run as follows:
209
210 $ cd /opt/stack/tempest
Kui Shif9b47382013-08-02 05:53:58 +0800211 $ nosetests tempest/scenario/test_network_basic_ops.py
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700212
Dean Troyercc6b4432013-04-08 15:38:03 -0500213# Multi-Node Setup
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700214
Mark McClainb05c8762013-07-06 23:29:39 -0400215A more interesting setup involves running multiple compute nodes, with Neutron networks connecting VMs on different compute nodes.
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700216You should run at least one "controller node", which should have a `stackrc` that includes at least:
217
218 disable_service n-net
219 enable_service q-svc
220 enable_service q-agt
221 enable_service q-dhcp
222 enable_service q-l3
223 enable_service q-meta
Mark McClainb05c8762013-07-06 23:29:39 -0400224 enable_service neutron
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700225
226You likely want to change your `localrc` to run a scheduler that will balance VMs across hosts:
227
228 SCHEDULER=nova.scheduler.simple.SimpleScheduler
229
230You can then run many compute nodes, each of which should have a `stackrc` which includes the following, with the IP address of the above controller node:
231
Mark McClainb05c8762013-07-06 23:29:39 -0400232 ENABLED_SERVICES=n-cpu,rabbit,g-api,neutron,q-agt
Oleg Bondarev1f11f9a2013-03-25 05:34:23 -0700233 SERVICE_HOST=[IP of controller node]
234 MYSQL_HOST=$SERVICE_HOST
235 RABBIT_HOST=$SERVICE_HOST
236 Q_HOST=$SERVICE_HOST
Eric Windisch800bf382013-05-24 11:21:11 -0400237 MATCHMAKER_REDIS_HOST=$SERVICE_HOST
Kieran Spearfb2a3ae2013-03-11 23:55:49 +0000238
239# Cells
240
241Cells is a new scaling option with a full spec at http://wiki.openstack.org/blueprint-nova-compute-cells.
242
243To setup a cells environment add the following to your `localrc`:
244
245 enable_service n-cell
Kieran Spearfb2a3ae2013-03-11 23:55:49 +0000246
Chris Behrensc62c2b92013-07-24 03:56:13 -0700247Be aware that there are some features currently missing in cells, one notable one being security groups. The exercises have been patched to disable functionality not supported by cells.