diff --git a/doc/source/index.rst b/doc/source/index.rst index fc3884a..bdf86d3 100644 --- a/doc/source/index.rst +++ b/doc/source/index.rst @@ -11,7 +11,7 @@ Tempest Project Specifications :glob: :maxdepth: 2 - specs/* + specs/tempest/* DevStack Project Specifications ------------------------------- @@ -28,7 +28,8 @@ Implemented Specifications :glob: :maxdepth: 1 - specs/implemented/* + specs/tempest/implemented/* + specs/devstack/implemented/* ==================================== Specification Repository Information diff --git a/specs/add-basic-ceilometer-tests.rst b/specs/add-basic-ceilometer-tests.rst deleted file mode 100644 index 24817b8..0000000 --- a/specs/add-basic-ceilometer-tests.rst +++ /dev/null @@ -1,96 +0,0 @@ -:: - - This work is licensed under a Creative Commons Attribution 3.0 Unported - License. - - http://creativecommons.org/licenses/by/3.0/legalcode - -.. - -============================== -Add basic tests for Ceilometer -============================== - -https://blueprints.launchpad.net/tempest/+spec/add-basic-ceilometer-tests - -Implement basic integration tests for the Ceilometer project. -Related Etherpad: https://etherpad.openstack.org/p/ceilometer-tempest-testing - -Problem description -=================== - -Now Ceilometer is the important metering/monitoring projects of OpenStack. -So it's necessary to include the basic tests into Tempest to make sure it works -fine, as currently there are no these tests presented. - -Proposed change -=============== - -This blueprint contains the following steps to be implemented: - -1. Initial Ceilometer Tempest integration -2. Basic REST API based tests - -1. Initial Ceilometer Tempest integration ------------------------------------------ - -This point includes initial Telemetry client testing code, base classes and -configuration for the Telemetry tests. This step includes Telemetry client -to be implemented as well. - -2. Basic REST API based tests ------------------------------ - -This step should cover the API functionality for the Ceilometer project. This -requires the following changes: - - * alarm-history API tests and alarming API itself - * notifications tests for the different types of the notifications (from - Nova, Cinder, Neutron, Swift, etc.) - * pollsters tests (with different services polling) - * other non-scenarios changes (if needed) - - -Alternatives ------------- - -None - -Implementation -============== - -Assignee(s) ------------ - -Primary assignee: - * Yassine Lamgarchal - -Other contributors: - * Vadim Rovachev - * ravikumar-venkatesan - * Mehdi Abaakouk - * nayna-patel - -Ongoing maintainer: - * Vadim Rovachev - -Milestones ----------- - -Target Milestone for completion: - Juno-2 - -Work Items ----------- - -* [sileht] Add initial ceilometerclient testing code: DONE -* [yassine] Add base class for Telemetry tests: DONE -* [yassine] Add config for Telemetry: DONE -* [vrovachev] Create telemetry client for tempest: INPROGRESS -* [vrovachev] Create cinder notifications tests: INPROGRESS -* [vrovachev] Create neutron notifications tests: INPROGRESS -* [vrovachev] Create object storage notifications tests: INPROGRESS -* [vrovachev] Create compute notifications tests: INPROGRESS -* [ravikumar] Create all alarms tests: INPROGRESS -* [vrovachev] Create all pollsters tests: TODO - diff --git a/specs/add-ceilometer-scenario-tests.rst b/specs/add-ceilometer-scenario-tests.rst deleted file mode 100644 index c303e08..0000000 --- a/specs/add-ceilometer-scenario-tests.rst +++ /dev/null @@ -1,77 +0,0 @@ -:: - - This work is licensed under a Creative Commons Attribution 3.0 Unported - License. - - http://creativecommons.org/licenses/by/3.0/legalcode - -.. - -============================= -Add Ceilometer scenario tests -============================= - -https://blueprints.launchpad.net/tempest/+spec/add-ceilometer-scenario-tests - -Implement complex scenario tests for the Ceilometer project. -Related Etherpad: https://etherpad.openstack.org/p/ceilometer-tempest-testing - -Problem description -=================== - -Telemetry project uses complex interactions inside the OpenStack cloud, so it's -needed to test not only basic Ceilometer capabilities via API testing, but also -more complex scenarios that might happen in the cloud. In this case scenarios -integration tests need to be implemented. - -Proposed change -=============== - -This blueprint contains the following steps to be implemented: - -1. Initial Tempest and Ceilometer integration for the scenario tests -2. Scenario tests themselves (we need to start with the alarms and events - testing) - - Simple alarms test, for example, will follow next scenario: - - create alarm which triggered to 'alarm' state and send callback by - alarm_actions if in last period more then one server had been created, - - create one server, - - check that alarm triggered to state 'ok', - - create two servers, - - check that alarm triggered to state 'alarm', - - check that alarms callback received. - - Simple events test will look like the following: - - choose some action for every OpenStack service (like keypair - creation in Nova) that should lead to notification sent and then event - created, each action is followed by specific order of - notifications and special order of events as well, - - check events come and their order. - -Alternatives ------------- - -None - -Implementation -============== - -Assignee(s) ------------ - -Primary assignee: - * Artur Svechnikov - -Milestones ----------- - -Target Milestone for completion: - Juno-2 - -Work Items ----------- - -* [asvechnikov] Add Ceilometer client for scenarios tests: DONE -* [asvechnikov] Add Ceilometer events scenarios tests: INPROGRESS -* [asvechnikov] Add Ceilometer alarms scenarios tests: INPROGRESS \ No newline at end of file diff --git a/specs/barbican-api-tests.rst b/specs/barbican-api-tests.rst deleted file mode 100644 index eff7524..0000000 --- a/specs/barbican-api-tests.rst +++ /dev/null @@ -1,78 +0,0 @@ -:: - - This work is licensed under a Creative Commons Attribution 3.0 Unported - License. - - http://creativecommons.org/licenses/by/3.0/legalcode - -.. - -============================ -Implement Barbican API tests -============================ - -https://blueprints.launchpad.net/tempest/+spec/add-basic-tests-for-barbican - -Add test coverage in Tempest for Barbican APIs - - -Problem description -=================== -Barbican is a ReST API designed for the secure storage, provisioning and management of secrets. -Barbican is an incubated openstack project and it is important that we have tempest tests to validate the -functionality of Barbican API. The goal is to create a set of tests that exercises the documented -positive paths and options of the APIs. The Barbican API specification is located at -https://github.com/cloudkeep/barbican/wiki/Application-Programming-Interface - -Proposed change -=============== - -This blueprint proposes to add functional test coverage for Barbican APIs tests. -Following Implementation is needed in Tempest: - -1. Implement service client in /tempest/services/key_management/ -2. Implement test cases in /tempest/api/key_management/ - -1. Implement service client ---------------------------- -Seperate service clients is implemented for each type of resource -For example: -secrets_client.py handles API calls to the secrets resource -orders_client.py handles API calls to the orders resource -container_client.py handles API calls to the containers resource - - -2. Implement test cases ------------------------ -Seperate folder of each type of API needs to be maintained - -For example: -tempest/api/key_management/secrets -tempest/api/key_management/orders -tempest/api/key_management/containers - -Implementation -============== - -Assignee(s) ------------ - -Primary assignee: - Meera Belur - -Other contributors: - Apal Song - -Milestones ----------- - -Target Milestone for completion: - Juno-3 - -Work Items ----------- -- Add service clients -- Add new test cases for each APIs using service client - -To manage these work items an etherpad has been created -https://etherpad.openstack.org/p/test-barbican-api diff --git a/specs/devstack/devstack-logging-and-service-names.rst b/specs/devstack/implemented/devstack-logging-and-service-names.rst similarity index 100% rename from specs/devstack/devstack-logging-and-service-names.rst rename to specs/devstack/implemented/devstack-logging-and-service-names.rst diff --git a/specs/add-icehouse-swift-tests.rst b/specs/tempest/add-icehouse-swift-tests.rst similarity index 100% rename from specs/add-icehouse-swift-tests.rst rename to specs/tempest/add-icehouse-swift-tests.rst diff --git a/specs/autogen-negative-tests.rst b/specs/tempest/autogen-negative-tests.rst similarity index 100% rename from specs/autogen-negative-tests.rst rename to specs/tempest/autogen-negative-tests.rst diff --git a/specs/branchless-tempest-extensions.rst b/specs/tempest/branchless-tempest-extensions.rst similarity index 100% rename from specs/branchless-tempest-extensions.rst rename to specs/tempest/branchless-tempest-extensions.rst diff --git a/specs/consistent-service-method-names.rst b/specs/tempest/consistent-service-method-names.rst similarity index 100% rename from specs/consistent-service-method-names.rst rename to specs/tempest/consistent-service-method-names.rst diff --git a/specs/fuzzy-test.rst b/specs/tempest/fuzzy-test.rst similarity index 100% rename from specs/fuzzy-test.rst rename to specs/tempest/fuzzy-test.rst diff --git a/specs/implemented/add-service-tags.rst b/specs/tempest/implemented/add-service-tags.rst similarity index 100% rename from specs/implemented/add-service-tags.rst rename to specs/tempest/implemented/add-service-tags.rst diff --git a/specs/implemented/api-schema-unification.rst b/specs/tempest/implemented/api-schema-unification.rst similarity index 100% rename from specs/implemented/api-schema-unification.rst rename to specs/tempest/implemented/api-schema-unification.rst diff --git a/specs/implemented/branchless-tempest.rst b/specs/tempest/implemented/branchless-tempest.rst similarity index 100% rename from specs/implemented/branchless-tempest.rst rename to specs/tempest/implemented/branchless-tempest.rst diff --git a/specs/implemented/cinder-v2-api-tests.rst b/specs/tempest/implemented/cinder-v2-api-tests.rst similarity index 100% rename from specs/implemented/cinder-v2-api-tests.rst rename to specs/tempest/implemented/cinder-v2-api-tests.rst diff --git a/specs/implemented/client-checks-success.rst b/specs/tempest/implemented/client-checks-success.rst similarity index 100% rename from specs/implemented/client-checks-success.rst rename to specs/tempest/implemented/client-checks-success.rst diff --git a/specs/clients-return-one-value.rst b/specs/tempest/implemented/clients-return-one-value.rst similarity index 95% rename from specs/clients-return-one-value.rst rename to specs/tempest/implemented/clients-return-one-value.rst index 10c3de9..4da66c8 100644 --- a/specs/clients-return-one-value.rst +++ b/specs/tempest/implemented/clients-return-one-value.rst @@ -11,8 +11,8 @@ https://blueprints.launchpad.net/tempest/+spec/clients-return-one-value Currently tempest clients return a response code and body. Since we moved response checking to clients, almost all callers of the clients ignore the -response code: :doc:`implemented/client-checks-success`. It would be much -cleaner if clients returned a single response +response code: :doc:`client-checks-success`. It would be +much cleaner if clients returned a single response object that was the body, with a property to get the response status and headers if needed. diff --git a/specs/config-verification.rst b/specs/tempest/implemented/config-verification.rst similarity index 100% rename from specs/config-verification.rst rename to specs/tempest/implemented/config-verification.rst diff --git a/specs/javelin2.rst b/specs/tempest/implemented/javelin2.rst similarity index 100% rename from specs/javelin2.rst rename to specs/tempest/implemented/javelin2.rst diff --git a/specs/meta-data-and-uuid-for-tests.rst b/specs/tempest/implemented/meta-data-and-uuid-for-tests.rst similarity index 100% rename from specs/meta-data-and-uuid-for-tests.rst rename to specs/tempest/implemented/meta-data-and-uuid-for-tests.rst diff --git a/specs/implemented/minversion-check-for-cli-tests.rst b/specs/tempest/implemented/minversion-check-for-cli-tests.rst similarity index 100% rename from specs/implemented/minversion-check-for-cli-tests.rst rename to specs/tempest/implemented/minversion-check-for-cli-tests.rst diff --git a/specs/implemented/more-selectable-swift-tests.rst b/specs/tempest/implemented/more-selectable-swift-tests.rst similarity index 100% rename from specs/implemented/more-selectable-swift-tests.rst rename to specs/tempest/implemented/more-selectable-swift-tests.rst diff --git a/specs/implemented/multi-keystone-api-version-tests.rst b/specs/tempest/implemented/multi-keystone-api-version-tests.rst similarity index 100% rename from specs/implemented/multi-keystone-api-version-tests.rst rename to specs/tempest/implemented/multi-keystone-api-version-tests.rst diff --git a/specs/neutron-advanced-scenarios.rst b/specs/tempest/implemented/neutron-advanced-scenarios.rst similarity index 100% rename from specs/neutron-advanced-scenarios.rst rename to specs/tempest/implemented/neutron-advanced-scenarios.rst diff --git a/specs/implemented/post-run-cleanup.rst b/specs/tempest/implemented/post-run-cleanup.rst similarity index 100% rename from specs/implemented/post-run-cleanup.rst rename to specs/tempest/implemented/post-run-cleanup.rst diff --git a/specs/implemented/rearrange-nova-response-schemas.rst b/specs/tempest/implemented/rearrange-nova-response-schemas.rst similarity index 100% rename from specs/implemented/rearrange-nova-response-schemas.rst rename to specs/tempest/implemented/rearrange-nova-response-schemas.rst diff --git a/specs/implemented/resource-cleanup.rst b/specs/tempest/implemented/resource-cleanup.rst similarity index 100% rename from specs/implemented/resource-cleanup.rst rename to specs/tempest/implemented/resource-cleanup.rst diff --git a/specs/implemented/tempest-client-scenarios.rst b/specs/tempest/implemented/tempest-client-scenarios.rst similarity index 100% rename from specs/implemented/tempest-client-scenarios.rst rename to specs/tempest/implemented/tempest-client-scenarios.rst diff --git a/specs/tempest-library.rst b/specs/tempest/implemented/tempest-library.rst similarity index 100% rename from specs/tempest-library.rst rename to specs/tempest/implemented/tempest-library.rst diff --git a/specs/test-accounts-continued.rst b/specs/tempest/implemented/test-accounts-continued.rst similarity index 100% rename from specs/test-accounts-continued.rst rename to specs/tempest/implemented/test-accounts-continued.rst diff --git a/specs/implemented/test-accounts.rst b/specs/tempest/implemented/test-accounts.rst similarity index 100% rename from specs/implemented/test-accounts.rst rename to specs/tempest/implemented/test-accounts.rst diff --git a/specs/ipv6-api-testing-parity.rst b/specs/tempest/ipv6-api-testing-parity.rst similarity index 100% rename from specs/ipv6-api-testing-parity.rst rename to specs/tempest/ipv6-api-testing-parity.rst diff --git a/specs/keystone-v3-jobs.rst b/specs/tempest/keystone-v3-jobs.rst similarity index 100% rename from specs/keystone-v3-jobs.rst rename to specs/tempest/keystone-v3-jobs.rst diff --git a/specs/ssh-auth-strategy.rst b/specs/tempest/ssh-auth-strategy.rst similarity index 100% rename from specs/ssh-auth-strategy.rst rename to specs/tempest/ssh-auth-strategy.rst diff --git a/specs/stress-api-tracking.rst b/specs/tempest/stress-api-tracking.rst similarity index 100% rename from specs/stress-api-tracking.rst rename to specs/tempest/stress-api-tracking.rst diff --git a/specs/tempest-cli-improvements.rst b/specs/tempest/tempest-cli-improvements.rst similarity index 100% rename from specs/tempest-cli-improvements.rst rename to specs/tempest/tempest-cli-improvements.rst diff --git a/specs/tempest-external-plugin-interface.rst b/specs/tempest/tempest-external-plugin-interface.rst similarity index 100% rename from specs/tempest-external-plugin-interface.rst rename to specs/tempest/tempest-external-plugin-interface.rst diff --git a/specs/trove-api-tests.rst b/specs/trove-api-tests.rst deleted file mode 100644 index 6d480f6..0000000 --- a/specs/trove-api-tests.rst +++ /dev/null @@ -1,88 +0,0 @@ -:: - - This work is licensed under a Creative Commons Attribution 3.0 Unported - License. - - http://creativecommons.org/licenses/by/3.0/legalcode - -.. - -============================ -Implement Trove API tests -============================ - -https://blueprints.launchpad.net/tempest/+spec/tempest-guest-tests - -Increase integration test coverage in Tempest - - -Problem description -=================== - -Currently only below Trove APIs test cases are present in Tempest- - -flavor - -version - -Tempest should have more Trove APIs test coverage. - - -Proposed change -=============== - -This blueprint proposes to add more Trove APIs tests. -Following Implementation is needed in Tempest: - -1. Implement service client in /tempest/services/database/ -2. Implement test cases in /tempest/api/database/ - -1. Implement service client --------------------------------- -Seperate service client should be implemented for each type of APIs - -For example- - -* All instance APIs client should be implemented in - /tempest/api/database/json/instances_client.py -* All backup APIs client should be implemented in - /tempest/api/database/json/backups_client.py - -2. Implement test cases --------------------------------- -Seperate folder of each type of API needs to be maintained - -For example- - -* All instance APIs tests should go under /tempest/api/database/instances -* All backup APIs tests should go under /tempest/api/database/backups. - - -Implementation -============== - -Assignee(s) ------------ - -Primary assignee: - Nikhil Manchanda - -Other contributors: - -* Ghanshyam Mann -* Peter Stachowski -* Ravikumar Venkatesan -* Ashish Nigam - -Milestones ----------- - -Target Milestone for completion: - Juno-3 - -Work Items ----------- - -- Add service client for each type of APIs -- Add new test cases for each APIs using service client - - Tasks will be managed using etherpad : - (https://etherpad.openstack.org/p/trove-tempest-items)