x/kloudbuster
Code Issues Proposed changes
A tool to load OpenStack clouds end to end in both control plane and data plane.
134 Commits 1 Branch 38 Tags 7.4 MiB
JavaScript 28.6%
C 24.8%
Python 24.3%
CSS 12.2%
HTML 9.1%
Other 0.9%
e0408bb653
Go to file
Yichen Wang e0408bb653 Fix the automated building issue for DIB 
Change-Id: Ibebf1c7cef23f48c472c7b09df505221d7b91307
2015-11-10 10:33:26 -08:00
doc Fix the automated building issue for DIB 2015-11-10 10:33:26 -08:00
kb_dib Fix the automated building issue for DIB 2015-11-10 10:33:26 -08:00
kb_server Fix the automated building issue for DIB 2015-11-10 10:33:26 -08:00
kb_web Fix the automated building issue for DIB 2015-11-10 10:33:26 -08:00
kloudbuster Enhance the single/dual cloud mode detection logic 2015-10-21 23:23:38 -07:00
.coveragerc Change ignore-errors to ignore_errors 2015-09-21 14:28:33 +00:00
.gitignore for minify code 2015-11-04 19:31:59 -08:00
.gitreview Update .gitreview for new Gerrit remote name 2015-08-03 22:33:36 +00:00
.mailmap Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
.testr.conf Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
babel.cfg Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
HACKING.rst Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
LICENSE Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
MANIFEST.in Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
openstack-common.conf Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
README.rst Reset the final_result after clean_up 2015-10-20 14:56:41 -07:00
requirements-dev.txt Adding support to store CPU info 2015-02-25 16:07:19 -08:00
requirements.txt Fix the automated building issue for DIB 2015-11-10 10:33:26 -08:00
setup.cfg Add --show-config 2015-08-28 15:10:20 -07:00
setup.py Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
test-requirements.txt Add the support for dynamiclly generating the HTML page 2015-09-22 15:45:51 -07:00
tox.ini Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00

README.rst

Overview

How good is your OpenStack data plane under real heavy load?

KloudBuster is a tool that can load the data plane of any Neutron OpenStack cloud at massive scale and can measure how well the cloud behaves under load.

Features

  • Neutron configuration agnostic (any encapsulation, any overlay, any plugin)

  • Can load the data plane with one OpenStack cloud (single-cloud operations for L3 East-West scale) or 2 OpenStack clouds (dual-cloud operations with one cloud hosting the HTTP servers and the other loading HTTP traffic for L3 North-South scale testing)

  • User can specify any number of tenants, routers, networks (only limited by cloud capacity) and KloudBuster will stage all these resources in a way that makes sense for operational data plane traffic

  • HTTP traffic load:

    • Real HTTP servers (Nginx) running in real Linux images (Ubuntu 14.04)
    • Can specify any number of HTTP servers per tenant
    • High performance and highly scalable HTTP traffic generators to simulate huge number of HTTP users and TCP connections (hundreds of thousands to millions)
    • overall throughput and latency measurement for every single HTTP request (typically millions per run) using the open source HdrHistogram library

  • Traffic shaping to specify on which links traffic should flow

  • Highly efficient and scalable metric aggregation

  • Can support periodic reporting and aggregation of results

  • Automatic cleanup upon termination (by default)

  • Manual cleanup script

  • Server mode and REST interface:

    • Allows KloudBuster to be driven by other programs
    • Swagger 2.0 YAML description of the REST interface

  • Aggregated results provide an easy to understand way to assess the scale of the cloud under test

  • KloudBuster VM images built using OpenStack DIB (Disk Image Builder)

  • Verified to work on any OpenStack release starting from IceHouse

Limitations

  • Requires Neutron networking (does not support Nova networking)
  • Only supports HTTP traffic in this version

Contributions and Feedbacks

If you are interested in OpenStack Performance and Scale, contributions and feedbacks are welcome!

The KloudBuster code is still relatively small in size and touches many different areas such as:

  • Backend control plane and data plane (python, C)
  • Frontend RESTful interface
  • REST modeilizatiuon (swagger)
  • Web User Interface (javascript)

If you have any feedbacks or would like to make small or large contributions, simply send an email to openstack-dev@lists.openstack.org with a '[kloudbuster]' tag in the subject.

Licensing

KloudBuster is licensed under the Apache License, Version 2.0 (the "License"). You may not use this tool except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

KloudBuster VM images contain multiple open source license components:

Links