Manage a pool of nodes for a distributed test infrastructure
Go to file
Jesse Pretorius 4c8b5f4f99 Add ability to ignore provider quota for a pool
In some circumstances it is useful to tell the launcher to
ignore the provide quota and just trust the max-* settings
for that pool instead.

This particular need arises when using Rackspace public cloud
for both instances and OnMetal nodes. In this situation the
quota for instances and for OnMetal nodes is different, but
nodepool only queries the quota for instances. When trying to
build OnMetal nodes, the quota check fails - but should not.

In this circumstance, instead of making shade/nodepool
complicated by figuring out how to calculate disparate quota
types, it makes sense to rather just allow nodepool to ignore
the quota for a pool to try executing the build instead.

While this is our use-case, it may also be useful to others
for other reasons.

Change-Id: I232a1ab365795381ab180aceb48e8c87843ac713
2018-07-11 17:37:55 +00:00
devstack Add opensuse-150 to nodepool dsvm 2018-06-06 11:13:08 +01:00
doc Add ability to ignore provider quota for a pool 2018-07-11 17:37:55 +00:00
etc Merge "Add systemd drop-in file for CentOS 7" 2018-05-09 18:09:54 +00:00
nodepool Add ability to ignore provider quota for a pool 2018-07-11 17:37:55 +00:00
playbooks Refactor playbooks/nodepool-zuul-functional/pre.yaml 2018-02-20 19:56:11 +01:00
releasenotes/notes Add ability to ignore provider quota for a pool 2018-07-11 17:37:55 +00:00
roles/nodepool-zuul-functional Refactor playbooks/nodepool-zuul-functional/pre.yaml 2018-02-20 19:56:11 +01:00
tools Add opensuse-150 to nodepool dsvm 2018-06-06 11:13:08 +01:00
.coveragerc Switch to stestr 2018-04-26 11:52:17 -05:00
.gitignore Ignore .stestr directory in .gitignore 2018-05-07 12:37:44 -04:00
.gitreview Replace master with feature/zuulv3 2018-01-18 10:13:57 -08:00
.stestr.conf Switch to stestr 2018-04-26 11:52:17 -05:00
.zuul.yaml Publish docs on release 2018-06-29 15:41:46 -07:00
bindep.txt Ensure only python3 is installed with bindep.txt 2018-02-14 12:19:16 -05:00
LICENSE license: remove dos line break 2018-01-19 00:30:22 +00:00
README.rst Rename nodepoold to nodepool-launcher 2017-03-29 09:28:33 -04:00
requirements.txt webapp: fix browser return 2018-06-07 18:47:06 +10:00
setup.cfg update supported python version in setup.cfg 2018-02-02 04:30:06 +00:00
setup.py Bump pbr requirements to >=1.3 2015-09-14 16:19:13 -04:00
test-requirements.txt Switch to stestr 2018-04-26 11:52:17 -05:00
tox.ini fix tox python3 overrides 2018-06-12 01:02:57 +08:00

Nodepool

Nodepool is a service used by the OpenStack CI team to deploy and manage a pool of devstack images on a cloud server for use in OpenStack project testing.

Developer setup

Make sure you have pip installed:

wget https://bootstrap.pypa.io/get-pip.py
sudo python get-pip.py

Install dependencies:

sudo pip install bindep
sudo apt-get install $(bindep -b nodepool)

mkdir src
cd ~/src
git clone git://git.openstack.org/openstack-infra/system-config
git clone git://git.openstack.org/openstack-infra/nodepool
cd nodepool
sudo pip install -U -r requirements.txt
sudo pip install -e .

If you're testing a specific patch that is already in gerrit, you will also want to install git-review and apply that patch while in the nodepool directory, ie:

git review -x XXXXX

Create or adapt a nodepool yaml file. You can adapt an infra/system-config one, or fake.yaml as desired. Note that fake.yaml's settings won't Just Work - consult ./modules/openstack_project/templates/nodepool/nodepool.yaml.erb in the infra/system-config tree to see a production config.

If the cloud being used has no default_floating_pool defined in nova.conf, you will need to define a pool name using the nodepool yaml file to use floating ips.

Export variable for your ssh key so you can log into the created instances:

export NODEPOOL_SSH_KEY=`cat ~/.ssh/id_rsa.pub | awk '{print $2}'`

Start nodepool with a demo config file (copy or edit fake.yaml to contain your data):

export STATSD_HOST=127.0.0.1
export STATSD_PORT=8125
nodepool-launcher -d -c tools/fake.yaml

All logging ends up in stdout.

Use the following tool to check on progress:

nodepool image-list