Manage a pool of nodes for a distributed test infrastructure

Go to file

James E. Blair c46a53141e Line-by-line dib logs Log each line of output from DIB as it is read, and log it to the image log file instead of the standard one. Also, update the fake-dib system so that it exercises more code. Fix the filename check for fake-dib as the fake filename key actually ends up in the middle of the filename string. Add a fake-dib config file. Change-Id: I1e43c26ac0f9db4cf4e52f77b2cf5ca59f19989c		2014-09-23 11:15:13 -07:00
doc	Ignore min-ready when at capacity	2014-09-04 11:22:42 +10:00
nodepool	Line-by-line dib logs	2014-09-23 11:15:13 -07:00
tools	Line-by-line dib logs	2014-09-23 11:15:13 -07:00
.gitignore	Ignore vim editor backup and swap files.	2014-01-20 13:23:04 +13:00
.gitreview	Added .gitreview	2013-08-13 17:10:06 +00:00
.testr.conf	Add a test for subnodes	2014-03-31 09:22:00 -07:00
README.rst	Correct ssh key instructions in README	2014-08-25 13:46:57 -07:00
requirements.txt	Build images using diskimage-builder	2014-08-14 11:31:57 +02:00
setup.cfg	Add a nodepool command	2013-09-03 09:27:04 -07:00
setup.py	Update pbr version	2014-06-29 00:20:36 +08:00
test-requirements.txt	Finish initial docs	2014-03-31 09:21:56 -07:00
tox.ini	Use except x as y instead of except x, y	2014-05-29 23:57:48 +02:00

README.rst

Nodepool

Nodepool is a service used by the OpenStack CI team to deploy and manage a pool of devstack images on a cloud server for use in OpenStack project testing.

Developer setup

Install dependencies:

sudo apt-get update
sudo apt-get -qy install git mysql-server libmysqlclient-dev g++ python-dev python-pip
mkdir src
cd ~/src
git clone git://git.openstack.org/openstack-infra/config
git clone git://git.openstack.org/openstack-infra/nodepool
cd nodepool
sudo pip install -U -r requirements.txt
sudo pip install -e .

If you're testing a specific patch that is already in gerrit, you will also want to install git-review and apply that patch while in the nodepool directory, ie:

git review -x XXXXX

Create or adapt a nodepool yaml file. You can adapt an infra/config one, or fake.yaml as desired. Note that fake.yaml's settings won't Just Work - consult ./modules/openstack_project/templates/nodepool/nodepool.yaml.erb in the infra/config tree to see a production config.

If the cloud being used has no default_floating_pool defined in nova.conf, you will need to define a pool name using the nodepool yaml file to use floating ips.

Set up database for interactive testing:

mysql -u root

mysql> create database nodepool;
mysql> GRANT ALL ON nodepool.* TO 'nodepool'@'localhost';
mysql> flush privileges;

Set up database for unit tests:

mysql -u root
mysql> grant all privileges on *.* to 'openstack_citest'@'localhost' identified by 'openstack_citest' with grant option;
mysql> flush privileges;
mysql> create database openstack_citest;

Export variable for your ssh key so you can log into the created instances:

export NODEPOOL_SSH_KEY=`cat ~/.ssh/id_rsa.pub | awk '{print $2}'`

Start nodepool with a demo config file (copy or edit fake.yaml to contain your data):

export STATSD_HOST=127.0.0.1
export STATSD_PORT=8125
nodepoold -d -c tools/fake.yaml

All logging ends up in stdout.

Use the following tool to check on progress:

nodepool image-list

After each run (the fake nova provider is only in-memory):

mysql> delete from snapshot_image; delete from node;