x/kloudbuster
Code Issues Proposed changes
A tool to load OpenStack clouds end to end in both control plane and data plane.
227 Commits 1 Branch 38 Tags 7.4 MiB
JavaScript 28.6%
C 24.8%
Python 24.3%
CSS 12.2%
HTML 9.1%
Other 0.9%
668a7ea9cb
Go to file
Yichen Wang 668a7ea9cb Enhance error handling for volume creation failure 
1. Enhance error handling for volume creation failure;
2. Fix the trackback of force_clean.py if other resourses are
pre-existed in the cloud under test;
3. Update requirements to support sphinx 1.4.0;

Change-Id: Ifa403a560a6673c23f791833992e188f4d15878e
2016-03-29 13:26:13 -07:00
doc Change the result JSON schema to include metadata 2016-03-24 22:29:11 +00:00
kb_dib Feature commit to support storage testing on ephemeral disk 2016-03-21 17:39:59 -07:00
kb_server adjust default values in UI 2016-03-24 12:24:12 -07:00
kb_web update json format in UI 2016-03-24 18:46:34 -07:00
kloudbuster Enhance error handling for volume creation failure 2016-03-29 13:26:13 -07:00
.coveragerc Change ignore-errors to ignore_errors 2015-09-21 14:28:33 +00:00
.gitignore for minify code 2015-11-04 19:31:59 -08:00
.gitreview Update .gitreview for new Gerrit remote name 2015-08-03 22:33:36 +00:00
.mailmap Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
.testr.conf Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
babel.cfg Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
HACKING.rst Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
LICENSE Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
MANIFEST.in Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
openstack-common.conf Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
README.rst Adjust default values 2016-03-24 10:57:42 -07:00
requirements-dev.txt Enhance error handling for volume creation failure 2016-03-29 13:26:13 -07:00
requirements.txt Error handling and debugging enhancements 2016-03-23 15:03:04 -07:00
setup.cfg Final works for publishing v6 2016-03-17 16:53:15 -07:00
setup.py Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
test-requirements.txt Enhance error handling for volume creation failure 2016-03-29 13:26:13 -07:00
tox.ini Add python based force cleanup script 2016-02-26 00:10:50 -08:00

README.rst

Overview

How good is your OpenStack data plane or storage plane under real heavy load?

KloudBuster is a tool that can load the data or storage plane of any OpenStack cloud at massive scale and can measure how well the cloud behaves under load.

Anybody with basic knowledge of OpenStack, data plane and storage performance concepts can use the tool and get scale numbers for any OpenStack cloud straight off the box with pre-defined default workloads.

No need for complex installation as the KloudBuster installation takes care of all the dependencies.

Features

  • Neutron configuration agnostic (any encapsulation, any overlay, any plugin)

  • OpenStack Storage backend agnostic

  • User can specify any number of tenants, routers, networks, VM instances (only limited by cloud capacity) and KloudBuster will stage all these resources in a way that makes sense for operational usage

  • Real VM-level performance and scale numbers (not bare metal)

  • Punishing scale (thousands of VMs and enough load to fill even the fastest NIC cards or load any storage cluster with ease - if your cloud can even support that much)

  • Data plane with HTTP traffic load:

    • Can load the data plane with one OpenStack cloud (single-cloud operations for L3 East-West scale) or 2 OpenStack clouds (dual-cloud operations with one cloud hosting the HTTP servers and the other loading HTTP traffic for L3 North-South scale testing)
    • Real HTTP servers (Nginx) running in real Linux images (Ubuntu 14.04)
    • Can specify any number of HTTP servers per tenant (as many as your cloud can handle)
    • High performance and highly scalable HTTP traffic generators to simulate huge number of HTTP users and TCP connections (hundreds of thousands to millions of concurrent and active connections)
    • Overall throughput aggegation and loss-less latency aggregation for every single HTTP request (typically millions per run) using the open source HdrHistogram library
    • Traffic shaping to specify on which links traffic should flow
    • Can support periodic reporting and aggregation of results

  • Storage load:

    • VM-level Cinder volume (block storage) or Ephemeral disk file I/O performance measurement using FIO running inside VMs (not bare metal)
    • Supports random and sequential file access mode
    • Supports read, write and read/write mix
    • IOPs, bandwitdh and loss-less latency aggregation
    • User configurable storage workload profiles

  • Supports automated scale progressions (VM count series in any multiple increment) to reduce dramatically scale testing time

  • Highly efficient and scalable metric aggregation

  • Automatic cleanup upon termination (can be disabled)

  • Manual cleanup script

  • KloudBuster Server to drive scale test:

    • from any browser (KloudBuster Web UI)
    • from any external programs (KloudBuster REST API)

  • Aggregated results provide an easy to understand way to assess the scale of the cloud under test

  • KloudBuster VM image pre-built and available from the OpenStack Community App Catalog (https://apps.openstack.org/)

Limitations and Non-Goals

  • Requires Neutron networking (does not support Nova networking)
  • Only supports HTTP and storage traffic in this version

Unlike some other scaling test frameworks, KloudBuster does not attempt to:

  • provide a scale test framework that works across different cloud technologies (OpenStack + AWS + Google Cloud + ...) - we are only focusing on OpenStack
  • provide a scale test framework that is flexible and programmable to do everything -we just focus on opinionated and well targeted performance and scale areas with sensible use cases and available in a fully integrated and easy to consume packaged format
  • replace bare metal and domain specific native performance and scale frameworks (line level traffic generators, ceph specific performance and scale tools...)

Contributions and Feedbacks

If you are interested in OpenStack Performance and Scale, contributions and feedbacks are welcome!

If you have any feedbacks or would like to make small or large contributions, simply send an email to openstack-dev@lists.openstack.org with a '[kloudbuster]' tag in the subject.

Licensing

KloudBuster is licensed under the Apache License, Version 2.0 (the "License"). You may not use this tool except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

KloudBuster VM images contain multiple open source license components:

Although the VM image includes a binary copy of the FIO code, it does not include the source code used to build it. In accordance to the GPL V2 license related to the inclusion of binary copies of FIO, the source code used to build the FIO binary copy was not modified and can be found directly at https://github.com/axboe/fio or can be obtained by email request to the maintainer of KloudBuster.

Links