
Context and scenario to create pods and RCs In this scenario, a Kubernetes cluster is created and pods and replication controllers are launched. These will in turn launch docker instances. The manifest for the pods and replication controllers specifies the docker image to be downloaded and used in the containers. The sample files will create nginx containers. This scenario is intended to test the performance of the Kubernetes as provisioned and configured by Magnum. There are many ways to configure the cluster, therefore it would be helpful to detect if any configuration can be tuned for better performance. Partially-Implements: blueprint benchmark-scenarios-for-magnum Co-Authored-By: Ton Ngo <ton@us.ibm.com> Change-Id: I3284f44ecce1f6b30087ad380b72da9ac41f21ce
Testing
Please, don't hesitate to write tests ;)
Unit tests
Files: /tests/unit/*
The goal of unit tests is to ensure that internal parts of the code work properly. All internal methods should be fully covered by unit tests with a reasonable mocks usage.
About Rally unit tests:
- All unit tests are located inside /tests/unit/*
- Tests are written on top of: testtools and mock libs
- Tox is used to run unit tests
To run unit tests locally:
$ pip install tox
$ tox
To run py27, py34, py35 or pep8 only:
$ tox -e <name>
# NOTE: <name> is one of py27, py34, py35 or pep8
To run py27/py34/py35 against mysql or psql
$ export RALLY_UNITTEST_DB_URL="mysql://user:secret@localhost/rally" $ tox -epy27
To run specific test of py27/py34/py35:
$ tox -e py27 -- tests.unit.test_osclients
To get test coverage:
$ tox -e cover
# NOTE: Results will be in ./cover/index.html
To generate docs:
$ tox -e docs
# NOTE: Documentation will be in doc/source/_build/html/index.html
Functional tests
Files: /tests/functional/*
The goal of functional tests is to check that everything works well together. Fuctional tests use Rally API only and check responses without touching internal parts.
To run functional tests locally:
$ source openrc
$ rally deployment create --fromenv --name testing
$ tox -e cli
# NOTE: openrc file with OpenStack admin credentials
Output of every Rally execution will be collected under some reports root in directory structure like: reports_root/ClassName/MethodName_suffix.extension This functionality implemented in tests.functional.utils.Rally.__call__ method. Use 'gen_report_path' method of 'Rally' class to get automatically generated file path and name if you need. You can use it to publish html reports, generated during tests. Reports root can be passed through environment variable 'REPORTS_ROOT'. Default is 'rally-cli-output-files'.
Rally CI scripts
Files: /tests/ci/*
This directory contains scripts and files related to the Rally CI system.
Rally Style Commandments
File: /tests/hacking/checks.py
This module contains Rally specific hacking rules for checking commandments.