Alex Kang 2065418288 tempest: lbaas l7 switching scenario tests

1. add lbaas l7 switching clients
2. enhance to delete l7 resources if present
3. enhance NSX-v scenario to support l7 switching testing
   3.1 check floatingip assiged to server before ping test
       NSX-v3 can take 500+ second to assign floatingip to VM
   3.2 enhance test_lbaas_round_robin to support l7 test
   3.3 test_lbaas_l7_switching_ops only test URL starts_with
       validation.
4. l7_switching_ops requires around 2000 seconds. When run test
   set OS_TEST_TIMEOUT=2400 to avoid fixture timeout.
5. add CONF.nsxv.bugs_to_resolve to skip tests that can not be
   run at sepcific NSX plugin environment.
6. doc/README-LBaaS.rst describes limitation and how to run
   tests at different plugin's and backends.

Change-Id: Ib2ee4ce57d45882d76e25ce7b7bba3d825bf34ab

2016-10-18 13:12:28 +00:00

1.9 KiB

Raw Blame History

Overview

This document describes what LBaaS tests are not supported at different NSX plugin's and backends.

NOTE:

All LBaaS API & Scenario tests should PASS with exceptions
due to NSX plugins and features supported by backend.

For how tests can be skipped for specific plugin and backend,
please refer to paragraph "Config for Test Execution".

NOTE:

We no longer support LBaaS v1. So this document and LBaaS tests
only applys to releases from Mitaka/Marvin or later.

Limitation:

NSX-v with VMware LBaaS driver:

#. LBaaS networks need to attach to exclusive router
#. One tenant per subnet
#. L7 switching not supported

NSX-v3 with Octavia driver:

#. upstream implemenation - all tests should PASS.
#. scenario tests take long time, it might fail with fixture timeout.

Config for Test execution:

Following configuration attributes used to controll test execution:

#. no_router_type at group/session nsxv

   Default is False, and is used to run LBaaS tests in NSX-v environment.
   To run in NSX-t environment, set it to True

#. bugs_to_resolve at group/session nsxv

   For test to skip if bug-ID presented in this attribute.
   The test will use testtools.skipIf(condition, reason) to skip if its ID in the bugs_to_resolve list.

local.conf: ----------NSX-v:: [nsxv] no_router_type=False bugs_to_resolve=1641902,1715126,1703396,1739510

NSX-v3::

[compute] build_timeout=900 build_interval=2

[nsxv] no_router_type=True

Execution:

Use testr list-tests command to generate test suite for run API and Scenario tests:

tools/with_venv.sh testr list-tests nsxv.api.lbaas
tools/with_venv.sh testr list-tests nsxv.scenarion.test_lbaas

l7 switching tests take long time to complete. If got fixture timeout, do:
```
OS_TEST_TIMEOUT=2400 ./run_tempest.sh -t test_lbaas_l7_switching_ops
```

1.9 KiB Raw Blame History

Overview

Limitation:

Config for Test execution:

Execution:

1.9 KiB

Raw Blame History