zuul/nodepool
Code Issues Proposed changes
Manage a pool of nodes for a distributed test infrastructure
168 Commits 1 Branch 26 Tags 35 MiB
Python 98.3%
Shell 1.1%
Dockerfile 0.3%
Jinja 0.3%
22961c5ba5
Go to file
James E. Blair 22961c5ba5 Add tests for the allocator 
And fix a bug in it that caused too-small allocations in some
circumstances.

The main demonstration of this failure was:
  nodepool.tests.test_allocator.TwoLabels.test_allocator(two_nodes)

Which allocated 1,2 instead of 2,2.  But the following tests also
failed:

  nodepool.tests.test_allocator.TwoProvidersTwoLabels.test_allocator(four_nodes_over_quota)
  nodepool.tests.test_allocator.TwoProvidersTwoLabels.test_allocator(four_nodes)
  nodepool.tests.test_allocator.TwoProvidersTwoLabels.test_allocator(three_nodes)
  nodepool.tests.test_allocator.TwoProvidersTwoLabels.test_allocator(four_nodes_at_quota)
  nodepool.tests.test_allocator.TwoProvidersTwoLabels.test_allocator(one_node)

Change-Id: Idba0e52b2775132f52386785b3d5f0974c5e0f8e
2014-03-31 09:20:16 -07:00
doc Add ready-script and multi-node support 2014-03-31 09:20:15 -07:00
nodepool Add tests for the allocator 2014-03-31 09:20:16 -07:00
tools Add ready-script and multi-node support 2014-03-31 09:20:15 -07:00
.gitignore Ignore vim editor backup and swap files. 2014-01-20 13:23:04 +13:00
.gitreview Added .gitreview 2013-08-13 17:10:06 +00:00
.testr.conf Add tests for the allocator 2014-03-31 09:20:16 -07:00
README.rst Merge "Readme enhancements" 2014-01-27 22:54:15 +00:00
requirements.txt Set paramiko version > 1.9.0 2014-03-23 19:36:41 -04:00
setup.cfg Add a nodepool command 2013-09-03 09:27:04 -07:00
setup.py Initial commit 2013-08-15 09:47:23 -07:00
test-requirements.txt Add tests for the allocator 2014-03-31 09:20:16 -07:00
tox.ini Ignore hacking warnings 2013-09-13 11:09:15 -05:00

README.rst

Nodepool

Nodepool is a service used by the OpenStack CI team to deploy and manage a pool of devstack images on a cloud server for use in OpenStack project testing.

Developer setup

Install dependencies:

sudo apt-get -qy install git mysql-server libmysqlclient-dev g++ python-dev libzmq-dev python-pip
mkdir src
cd ~/src
git clone git://git.openstack.org/openstack-infra/config
git clone git://git.openstack.org/openstack-infra/nodepool
cd nodepool
sudo pip install -U -r requirements.txt
sudo pip install -e .

If you're testing a specific patch that is already in gerrit, you will also want to install git-review and apply that patch while in the nodepool directory, ie:

git review -x XXXXX

Create or adapt a nodepool yaml file. You can adapt an infra/config one, or fake.yaml as desired. Note that fake.yaml's settings won't Just Work - consult ./modules/openstack_project/templates/nodepool/nodepool.yaml.erb in the infra/config tree to see a production config.

If the cloud being used has no default_floating_pool defined in nova.conf, you will need to define a pool name using the nodepool yaml file to use floating ips.

Set up database:

mysql -u root

mysql> create database nodepool;
mysql> GRANT ALL ON nodepool.* TO 'nodepool'@'localhost';
mysql> flush privileges;

Export variable for your ssh key so you can log into the created instances:

export NODEPOOL_SSH_KEY=`cat ~/.ssh/id_rsa.pub`

Start nodepool with a demo config file (copy or edit fake.yaml to contain your data):

export STATSD_HOST=127.0.0.1
export STATSD_PORT=8125
nodepoold -d -c tools/fake.yaml

All logging ends up in stdout.

Use the following tool to check on progress:

nodepool image-list

After each run (the fake nova provider is only in-memory):

mysql> delete from snapshot_image; delete from node;