Current Series Release Notes

Current Series Release Notes

20.0.0-59

New Features

  • Add qos-policies and qos-minimum-bandwidth-rule clients to Tempest to make possible the testing of the placement based bandwidth allocation feature. The following API calls are available for tempest from now:

    QoS policies client:

    • GET /qos/policies

    • POST /qos/policies

    • GET /qos/policies/{policy_id}

    • PUT /qos/policies/{policy_id}

    • DELETE /qos/policies/{policy_id}

    QoS minimum bandwidth rules client:

    • GET qos/policies/{policy_id}/minimum_bandwidth_rules

    • POST /qos/policies/{policy_id}/minimum_bandwidth_rules

    • GET qos/policies/{policy_id}/minimum_bandwidth_rules/{rule_id}

    • PUT qos/policies/{policy_id}/minimum_bandwidth_rules/{rule_id}

    • DELETE /qos/policies/{policy_id}/minimum_bandwidth_rules/{rule_id}

  • Add list host API support to the volume v3 client library. This feature enables callers to list all hosts for a given project.

  • Add migrate volume API support to the volume v3 client library. This features allows callers to migrate volumes between backends.

  • New decorator unstable_test is added to tempest.lib.decorators. It can be used to mark some test as unstable thus it will be still run by tempest but job will not fail if this test will fail. Such test will be skipped in case of failure. It can be used for example when there is known bug related which cause irregular tests failures. Marking such test as unstable will help other developers to get their job done and still run this test to get additional debug data or to confirm if some potential fix really solved the issue.

  • New library interface to set the API microversion on Service Clients. APIMicroversionFixture, can be used to set the API microversion on multiple services. This Fixture will take care of reseting the service microversion to None once test is finished.

  • Add microversion support for scenario tests. Scenario test calls multiple service API within same test and many services like compute, volume and placement etc support API microversion. With microversion support in scenario test, we can call different service API with different microvesion. Which means we can implement scenario tests for microversion also. Currently Scenario manager support below services microversion:

    • Compute

    • Volume

    • Placement

Upgrade Notes

  • Remove deprecated config option endpoint_type from identity group. Use v2_public_endpoint_type from identity group instead. Remove deprecated config option tenant_isolation_domain_name from auth group. Use default_credentials_domain_name from auth group instead.

  • Remove deprecated config option admin_username from identity groups. Use admin_username from auth instead. Remove deprecated config option admin_tenant_name from auth and identity groups. Use admin_project_name from auth instead. Remove deprecated config option admin_password from identity groups. Use admin_password from auth instead. Remove deprecated config option admin_domain_name from identity groups. Use admin_domain_name from auth instead.

Deprecation Notes

  • The config option CONF.network.dns_servers is no longer used anywhere, so it is deprecated and will be removed in the future.

20.0.0

Prelude

This release is to tag the Tempest for OpenStack Stein release. This release marks the start of Stein release support in Tempest and the end of support for Ocata in Tempest. After this release, Tempest will support below OpenStack Releases:

  • Stein

  • Rocky

  • Queens

  • Pike

Current development of Tempest is for OpenStack Train development cycle. Every Tempest commit is also tested against master during the Train cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Train (or future release) cloud. To be on safe side, use this tag to test the OpenStack Stein release.

New Features

  • Add basic read-only Placement client to Tempest to make possible the testing of the placement based bandwidth allocation feature. The following API calls are available for tempest from now:

    • GET /allocation_candidates

    • GET /allocations/{consumer_uuid}

    Add new config group placement, with the config options:

    • endpoint_type to use for communication with placement service.

    • catalog_type of the placement service.

    • region as the placement region name to use.

    • min_microversion and max_microversion as the range between placement API requests are sent.

  • Add a new config setting immutable_user_source in the [identity-feature-enabled] group that defaults to false. This setting, combined with the usage of the @testtools.skipIf() decorator, will allow tests that require user creation, deletion, or modification to skip instead of failing in environments that are LDAP-backed. In such environments, the user source is read-only, so this feature flag is needed to allow such tests to gracefully skip without having to blacklist them.

  • Add support of OSProfiler library for profiling and distributed tracing of OpenStack. A new config option key in section profiler is added, the option sets the secret key used to enable profiling in OpenStack services. The value needs to correspond to the one specified in [profiler]/hmac_keys option of OpenStack services.

  • A new parameter follow_redirects has been added to the class RestClient, which is passed through to ClosingHttp or ClosingProxyHttp respectively. The default value is True which corresponds to the previous behaviour of following up to five redirections before returning a response. Setting follow_redirects = False allows to disable this behaviour, so that any redirect that is received is directly returned to the caller. This allows tests to verify that an API is responding with a redirect.

  • The tempest.lib.decorators.attr decorator now supports a condition kwarg which can be used to conditionally apply the attr to the test function if the condition evaluates to True.

  • Add show_version function to the NetworkVersionsClient client. This allows the possibility of getting details for Networking API.

Upgrade Notes

  • Changed the default value of ‘api_v1’ config option in the ‘image-feature-enabled’ group to False from True, because glance v1 APIs are deprecated. Please set True explicitly on the option if still testing glance v1 APIs.

  • The tempest-full, tempest-full-py3 and tempest-slow zuul v3 job configurations now set ENABLE_VOLUME_MULTIATTACH: true in the devstack_localrc variables section. If you have a plugin job configuration that inherits from one of these jobs and the backend cinder volume driver or nova compute driver do not support volume multiattach then you should override and set this variable to ENABLE_VOLUME_MULTIATTACH: false in your job configuration.

  • Below config option was deprecated for removal since juno release. It’s time to remove it as all supported stable branches and Tempest plugins are good to handle it.

    • [volume_feature_enabled].api_v1

    Also Tempest removes the below corresponding service clients alias from client.py which were being set based on above removed config option.

    • self.backups_client

    • self.encryption_types_client

    • self.snapshots_client

    • self.volume_availability_zone_client

    • self.volume_hosts_client

    • self.volume_limits_client

    • self.volume_qos_client

    • self.volume_quotas_client

    • self.volume_services_client

    • self.volume_types_client

    • self.volumes_client

    • self.volumes_extension_client

  • tempest.lib.common.utils.misc.find_test_caller was deprecated during Kilo release cycle in favor of tempest.lib.common.utils.test_utils.find_test_caller. The deprecated version of find_test_caller is removed.

  • CONF.validation.run_validation default enabled. This option required to be set true in order to run api tests stability when the guest cooperation required. For example when the guest needs react on Volume/Interface detach. The ssh test makes sure the VM is alive and ready when the detach needs to happen. The option was enabled on the gate for a long time.

Deprecation Notes

  • The scheduler_available_filters option is being deprecated in favor of scheduler_enabled_filters. The new name is more indicative of what the option means. scheduler_enabled_filters’s default value is set to the default value of Nova’s enabled_filters. scheduler_available_filters’s default was all. There was confusion around this value. Sometimes it was understood to mean the default Nova filters are enabled, other times it was understood to mean all filters are enabled. While all is still allowed for scheduler_enabled_filters for backwards compatibility, it is strongly recommended to provide an explicit list of filters that matches what’s configured in nova.conf.

Bug Fixes

  • [bug 1616892] Tempest now allows tests to verify that an API responds with a redirect.

  • Fixed bug #1791007. tempest workspace register and tempest workspace rename CLI will error if None or empty string is passed in –name arguments. Earlier both CLI used to accept the None or empty string as name which was confusing.

  • Fixed bug #1799883. tempest workspace register and tempest workspace move CLI will now validate the value of the --path CLI argument and raise an exception if it is None or empty string. Earlier both CLI actions were accepting None or empty path which was confusing.

  • Fixed bug #1808473. tempest run CLI will error if a non-exist config file is input to parameter –config-file. Earlier non-exist config value was silently getting ignored and the default config file was used instead which used to give false behavior to the user on using the passed config file.

  • Patch https://review.opendev.org/#/c/499575/ introduced support creating Neutron port with certain capabilities. Currently capabilities list interpreted as string this change fix it.

    tempest.conf [network] port_profile = capabilities:[switchdev]

    result: {‘capabilities’:’[switchdev]’}

    expected: {‘capabilities’: [‘switchdev’]}

19.0.0

Prelude

This release is to tag the Tempest for OpenStack Rocky release. After this release, Tempest will support below OpenStack Releases:

  • Rocky

  • Queens

  • Pike

  • Ocata

Current development of Tempest is for OpenStack Stein development cycle. Every Tempest commit is also tested against master during the Stein cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Stein (or future release) cloud. To be on safe side, use this tag to test the OpenStack Rocky release.

New Features

  • Add v3-ext/OS-ENDPOINT-POLICY API calls to support creation, deletion and retrieval of associations between service endpoints and policies. Such associations enable an endpoint to request its policy.

  • Add enable_service, disable_service , disable_log_reason, freeze_host and thaw_host API endpoints to volume v3 services_client.

  • Add a new parameter called bug_type to tempest.lib.decorators.related_bug and tempest.lib.decorators.skip_because decorators, which accepts 2 values:

    • launchpad

    • storyboard

    This offers the possibility of tracking bugs related to tests using launchpad or storyboard references. The default value is launchpad for backward compatibility.

    Passing in a non-digit bug value to either decorator will raise a InvalidParam exception (previously ValueError).

  • Add update flavor API to compute flavors_client library.

  • [blueprint application-credentials] Tempest can test keystone’s application credentials interface. A new client library is added for application credentials, and a new config option, [identity-feature-enabled]/application_credentials, can control whether the application credentials feature is tested (defaults to False, indicating the feature is not enabled in the cloud under test).

  • Add project_tags_client to the identity v3 library. This feature enables the possibility of invoking the following API actions:

    • update_project_tag

    • list_project_tags

    • update_all_project_tags

    • check_project_tag_existence

    • delete_project_tag

    • delete_all_project_tags

  • The update_service API is added to the services_client compute library. This API is introduced in microversion 2.53 and supersedes the following APIs:

    • PUT /os-services/disable (disable_service)

    • PUT /os-services/disable-log-reason (disable_log_reason)

    • PUT /os-services/enable (enable_service)

    • PUT /os-services/force-down (update_forced_down)

  • New string configuration option vnc_server_header is added to compute-feature-enabled section. It allows the expected VNC server name in the response header to be specified. For example, obvious at hand names are ‘WebSockify’, ‘nginx’.

  • Adds volume service clients for v3 APIs. As v3 base API should be identical to v2 APIs, we just copy all existing v2 service client for v3 API.

Upgrade Notes

  • Cinder CLI calls have now been updated to use the --os-endpoint-type option instead of --endpoint-type. The latter had been deprecated in Cinder and has been removed in the Rocky release.

  • Remove deprecated config option allow_tenant_isolation from auth and compute groups. Use use_dynamic_credentials directly instead of the removed option.

  • The volume config option catalog_type default is changed to volumev3 which is v3 API endpoint configured in devstack. With this change Tempest will be testing v3 API as default. User who want to test v2 API can still test by configuring the catalog_type to v2 endpoint.

Deprecation Notes

  • The v2 volume API has been deprecated since Pike release. Volume v3 API is current and Tempest volume tests can be run against v2 or v3 API based on config option CONF.volume.catalog_type. If catalog_type is volumev2, then all the volume tests will run against v2 API. If catalog_type is volumev3 which is default in Tempest, then all the volume tests will run against v3 API. That makes below config options unusable in Tempest which used to select the target volume API for volume tests.

    • CONF.volume-feature-enabled.api_v2

    • CONF.volume-feature-enabled.api_v3

    Tempest deprecate the above two config options in Rocky release and will be removed in future. Alternatively CONF.volume.catalog_type can be used to run the Tempest against volume v2 or v3 API.

  • Deprecates the volume service clients for v2 APIs. Volume v2 APIs are deprecated in all supported stable branches, so it’s time to deprecate the tempest service clients for v2 APIs and remove in future release.

Security Issues

  • The x-subject-token of a response header is ommitted from log, but clients specify the same token on a request header on Keystone API and that was not omitted. In this release, that has been omitted for a security reason.

Bug Fixes

  • Fix show_image_file interface in v2 ImagesClient: Bug#1756264. The expected success code of show_image_file is changed from 200 to [200, 204, 206].

  • Fix VNC server response header issue when it is behind reverse proxy

18.0.0

Prelude

This release marks the start of Queens release support in Tempest. This release also marks the end of support for Newton in Tempest.

New Features

  • Add group type specs APIs to v3 group_types_client library.

    • create_or_update_group_type_specs

    • list_group_type_specs

    • show_group_type_specs_item

    • update_group_type_specs_item

    • delete_group_type_specs_item

  • A new config option ‘port_profile’ is added to the section ‘network’ to specify capabilities of the port. By default this is set to {}. When using OVS HW offload feature we need to create Neutron port with a certain capability. This is done by creating Neutron port with binding profile. To be able to test this we need profile capability support in Tempest as well.

  • Add show default quotas API to network quotas_client library. This feature enables the possibility to show default network quotas for a specified project.

  • Add show encryption specs item API to v2 encryption_types_client library. This feature enables the possibility to show specific encryption specs for a volume type.

  • Add extension API show quota details to network quotas_client library. This feature enables the possibility to show a quota set for a specified project that includes the quota’s used, limit and reserved counts per resource.

  • Add update group types API to v3 group_types_client library; min_microversion of this API is 3.11.

  • A function has been added to the common library to allow mounting and unmounting of the config drive consistently.

  • The Tempest CLI commands have switched from calling testrepository internally to use stestr instead. This means that all of the features and bug fixes from moving to stestr are available to the tempest commands.

  • Adds a new CLI arg in tempest run, --black-regex, which is a regex to exclude the tests that match it.

  • A new boolean configuration option [compute-feature-enabled]/volume_backed_live_migration has been added. If enabled, tests which validate the behavior of Nova’s volume-backed live migration feature will be executed. The option defaults to False.

Upgrade Notes

  • Below config options or feature flags were deprecated for removal. It’s time to remove them as all supported stable branches are good to handle them.

    • [identity-feature-enabled].forbid_global_implied_dsr

    • [image-feature-enabled].deactivate_image

    • [default].resources_prefix

    • config group orchestration

    • [service_available].heat

  • Remove the deprecated decorator skip_unless_attr in lib/decorators.py.

  • The tox ostestr job (normally invoked with tox -eostestr) has been removed. This was lightly used, and in the near future ostestr will be removed from the tempest requirements file. If you were relying on this functionality you can replicate it by using the venv-tempest tox job. For example, simply running tox -evenv-tempest -- ostestr will do the same thing the old ostestr job did.

  • Tempest CLI commands will no long rely on anything from testr. This means any data in existing testr internals that were being exposed are no longer present. For example things like the .testr directories will be silently ignored. There is a potential incompatibility for existing users who are relying on test results being stored by testr. Anything relying on previous testr behavior will need to be updated to handle stestr.

Bug Fixes

  • Fixes tempest run CLI args mutually exclusive behavior which should not be the case anymore (Bug#1751201).

Other Notes

  • The CLIClient class, when it calls a command line client, uses --os-project-name instead of --os-tenant-name for the project, and passes --os-identity-api-version (default empty). All CLI clients still available in supported releases of OpenStack which are wrapped by the cmd_with_auth() method support those switches.

  • A new configuration option [compute-feature-enabled]/volume_multiattach has been added which defaults to False. Set this to True to enable volume multiattach testing. These tests require that compute API version 2.60 is available and block storage API version 3.44 is available.

    Note

    In the Queens release, the only compute driver that supports volume multiattach is the libvirt driver, and only then when qemu<2.10 or libvirt>=3.10. The only volume backend in Queens that supports volume multiattach is lvm.

  • OpenStack Releases supported after this release are Queens, Pike, and Ocata. The release under current development of this tag is Rocky, meaning that every Tempest commit is also tested against master during the Rocky cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Rocky (or future release) cloud.

17.2.0

New Features

  • Add support of args and kwargs when calling func in call_until_true, also to log the cost time when call_until_true returns True or False for debugging.

  • Add list_auth_domains API endpoint to the identity v3 client. This allows the possibility of listing all domains a user has access to via role assignments.

Upgrade Notes

  • Replace any call in your code to credentials_factory.DEFAULT_PARAMS with a call to config.service_client_config().

  • Remove deprecated APIs (show_pools and show_backend_capabilities) from volume v2 volumes_client, and the deprecated APIs are re-realized in volume v2 scheduler_stats_client (list_pools) and capabilities_client (show_backend_capabilities) accordingly.

Bug Fixes

  • The credentials_factory module used to load configuration at import time which caused configuration being loaded at test discovery time. This was fixed by removing the DEFAULT_PARAMS variable. This variable was redundant (and outdated), the same dictionary (but up to date) can be obtained via invoking config.service_client_config() with no service parameter.

17.1.0

Prelude

This is an intermediate release during the Queens development cycle to make new functionality available to plugins and other consumers.

New Features

  • Adds a new cli option to tempest run, --load-list <list-file> to specify target tests to run from a list-file. The list-file supports the output format of the tempest run --list-tests command.

  • Add reset group snapshot status API to v3 group_snapshots_client library, min_microversion of this API is 3.19. This feature enables the possibility to reset group snapshot status.

  • Add reset group status API to v3 groups_client library, min_microversion of this API is 3.20. This feature enables the possibility to reset group status.

  • Add the validation_resources module to tempest.lib. The module provides a set of helpers that can be used to provision and cleanup all the resources required to perform ping / ssh tests against a virtual machine: a keypair, a security group with targeted rules and a floating IP.

  • Add the proxy_url optional parameter to the get_credentials method in tempest/lib/auth.py so that that helper can be used when going through and HTTP proxy.

  • Add a new function called compare_version_header_to_response to tempest.lib.common.api_version_utils, which compares the API microversion in the response header to another microversion using the comparators defined in tempest.lib.common.api_version_request.APIVersionRequest.

    It is now possible to determine how to retrieve an attribute from a response body of an API call, depending on the returned microversion.

    Add a new exception type called InvalidParam to tempest.lib.exceptions, allowing the possibility of raising an exception if an invalid parameter is passed to a library function.

  • Adds a new config options, proxy_url. This options is used to configure running tempest through a proxy server.

  • The RestClient class in tempest.lib.rest_client has a new kwarg parameters, proxy_url, that is used to set a proxy server.

  • A new class was added to tempest.lib.http, ClosingProxyHttp. This behaves identically to ClosingHttp except that it requires a proxy url and will establish a connection through a proxy

  • A new boolean config option domain_specific_drivers is added to the section identity-feature-enabled. This option must be enabled when testing an environment that is configured to use domain-specific identity drivers.

  • Define below object storage service clients as libraries. Add new service clients to the library interface so the other projects can use these modules as stable libraries without any maintenance changes.

    • account_client

    • container_client

    • object_client

  • Two extra modules are now marked as stable for plugins, test.py and clients.py. The former includes the test base class with its automatic credentials provisioning and test resource managing fixtures. The latter is built on top of ServiceClients and it adds aliases and a few custom configurations to it.

Upgrade Notes

  • As of the Queens release, tempest no longer tests the identity v2.0 API because the majority of the v2.0 API have been removed from the identity project. Once the Queens release reaches end-of-life, we can remove the v2.0 tempest tests and clean up v2.0 testing cruft.

  • Remove deprecated APIs from volume v2 volumes_client, and the deprecated APIs are re-realized in volume v2 transfers_client.

    • create_volume_transfer

    • show_volume_transfer

    • list_volume_transfers

    • delete_volume_transfer

    • accept_volume_transfer

  • Remove two deprecated skip decorators in config module: skip_unless_config and skip_if_config.

  • Remove deprecated get_ipv6_addr_by_EUI64 method from data_utils. Use the same method from oslo_utils.netutils.

Bug Fixes

  • Allow to specify new domain parameters:

    • user_domain_name

    • user_domain_id

    • project_domain_name

    • project_domain_id

    for CLIClient class, whose values will be substituted to --os-user-domain-name, --os-user-domain-id, --os-project-domain-name and --os-project-domain-id respectively during command execution.

    This allows to prevent possible test failures with authentication in Keystone v3. Bug: #1719687

  • Fix list_group_snapshots API in v3 group_snapshots_client: Bug#1715786. The url path for list group snapshots with details API is changed from ?detail=True to /detail.

17.0.0

Prelude

This release marks the start of support for the Pike release in Tempest.

New Features

  • Add create_group_from_source to groups_client in the volume service library.

  • Implement the rest_client method is_resource_deleted in the network security group client.

  • The list_backups method of the v2 BackupsClient class now has an additional **params argument that enables passing additional information in the query string of the HTTP request.

  • Add show volume image metadata API to v2 volumes_client library. This feature enables the possibility to show volume’s image metadata.

  • Add update_group to groups_client in the volume service library.

  • Add group_snapshots client for the volume service as library. Add tempest tests for create group snapshot, delete group snapshot, show group snapshot, and list group snapshots volume APIs.

  • Add list_group_type and show_group_type in the group_types client for the volume service. Add tests for create/delete/show/list group types.

  • The credentials_factory.py module is now marked as stable for Tempest plugins. It provides helpers that can be used by Tempest plugins to obtain test credentials for their test cases in a format that honors the Tempest configuration in use. Credentials may be provisioned on the fly during the test run, or they can be setup in advance and fed to test via a YAML file; they can be setup for identity v2 or identity v3.

  • Add the disable_log_reason and the update_forced_down API endpoints to the compute services_client. Add ‘2.11’ compute validation schema for compute services API.

  • Enhances the v3 identity client with the check_token_existence endpoint, allowing users to check the existence of tokens

  • The tempest module tempest.common.dynamic creds which is used for dynamically allocating credentials has been migrated into tempest lib.

  • Define below object storage service clients as libraries. Add new service clients to the library interface so the other projects can use these modules as stable libraries without any maintenance changes.

    • bulk_middleware_client

    • capabilities_client

  • The tempest module tempest.common.preprov_creds which is used to provide credentials from a list of preprovisioned resources has been migrated into tempest lib at tempest.lib.common.preprov_creds.

  • The InvalidTestResource exception class from tempest.exceptions has been migrated into tempest.lib.exceptions

  • The tempest module tempest.common.fixed_network which provided utilities for finding fixed networks by and helpers for picking the network to use when multiple tenant networks are available has been migrated into tempest lib at tempest.lib.common.fixed_network.

  • When registering service clients from installed plugins, all registrations are now processed, even if one or more fails. All exceptions encountered during the registration process are recorded. If at least one exception was encountered, the registration process fails and all interim errors are reported.

  • The __repr__ method is now implemented for the base tempest.Exception class, its implementation is identical to __str__: it reports the error message merged with input parameters.

  • Add a new identity catalog client. At this point, the new client contains a single functionality, “show_catalog”, which returns a catalog object.

Upgrade Notes

  • Tempest checks a volume delete by waiting for NotFound(404) on show_volume(). Sometime a volume delete fails and the volume status becomes error_deleting which means the delete is failed. So Tempest doesn’t need to wait anymore. A new release of Tempest raises an exception DeleteErrorException instead of waiting.

Deprecation Notes

  • Remove the support of python3.4, because in Ubuntu Xenial only python3.5 is available (python3.4 is restricted to <= Mitaka).

Bug Fixes

  • Add more accurate ip version check in addresses schema which will limit the ip version value in [4, 6].

  • Add a missing return statement to the retype_volume API in the v2 volumes_client library: Bug#1703997

    This changes the response body from None to an empty dictionary.

  • Fix RemoteClient default ssh_shell_prologue: Bug#1707478

    The default ssh_shell_proloque has been modified from specifying erroneous PATH=$$PATH:/sbin to PATH=$PATH:/sbin.

Other Notes

  • OpenStack Releases supported after this release are Pike, Ocata, and Newton. The release under current development of this tag is Queens, meaning that every Tempest commit is also tested against master during the Queens cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Queens (or future release) cloud.

16.1.0

Prelude

This is an intermediate release during the Pike development cycle to make new functionality available to plugins and other consumers.

New Features

  • Add a new client to handle the OAUTH token feature from the identity API.

  • A new boolean config option serial_console is added to the section compute-feature-enabled. If enabled, tests, which validate the behavior of Nova’s serial console feature (an alternative to VNC, RDP, SPICE) can be executed.

  • Add a new client to handle the domain configuration feature from the identity v3 API.

  • A new config option in the network-feature-enabled section, floating_ips, to specify whether floating ips are available in the cloud under test. By default this is set to True.

  • Add force detach volume feature API to v2 volumes_client library. This feature enables the possibility to force a volume to detach, and roll back an unsuccessful detach operation after you disconnect the volume.

  • Defines the identity v3 OS-EP-FILTER EndPoint Groups API client. This client manages Create, Get, Update, Check, List, and Delete of EndPoint Group.

  • Defines the identity v3 OS-EP-FILTER extension API client. This client manages associations between endpoints, projects along with groups.

  • The delete_volume method of the VolumesClient class now has an additional **params argument that enables passing additional information in the query string of the HTTP request.

  • Add list volume transfers with details API to v2 transfers_client library. This feature enables the possibility to list volume transfers with details.

  • A new config option ‘manage_snapshot_ref’ is added in the volume section, to specify snapshot ref parameter for different storage backend drivers when managing an existing snapshot. By default it is set to fit the LVM driver.

  • The list_endpoints method of the v3 EndPointsClient class now has an additional **params argument that enables passing additional information in the query string of the HTTP request.

  • Add --save-state option to allow saving state of cloud before tempest run.

  • Add validation schema for Nova server diagnostics API

  • Add show host API to the volume v2 hosts_client library. This feature enables the possibility to show details for a host.

  • Add show snapshot metadata item API to v2 snapshots_client library. This feature enables the possibility to show a snapshot’s metadata for a specific key.

  • Add show volume metadata item API to v2 volumes_client library. This feature enables the possibility to show a volume’s metadata for a specific key.

  • Define v3 volumes_client for the volume service as a library interface, allowing other projects to use this module as a stable library without maintenance changes. Add show volume summary API to v3 volumes_client library, min_microversion of this API is 3.12.

    • volumes_client(v3)

  • Define v3 backups_client for the volume service as a library interface, allowing other projects to use this module as a stable library without maintenance changes. Add update backup API to v3 backups_client library, min_microversion of this API is 3.9.

    • backups_client(v3)

  • Add groups and group_types clients for the volume service as library. Add tempest tests for create group, delete group, show group, and list group volume APIs.

  • Define v2 quota_classes_client for the volume service as library interfaces, allowing other projects to use this module as stable libraries without maintenance changes.

    • quota_classes_client(v2)

  • A new configuration flag api_v2_admin is introduced in the identity feature flag group to allow for enabling/disabling all identity v2 admin tests. The new flag only applies when the existing api_v2 flag is set to True

  • Add additional API endpoints to the identity v2 client token API: - list_endpoints_for_token - check_token_existence

  • A new attr decorator has been added in the tempest.lib.decorators module. For example, use it to tag specific tests, which could be leveraged by test runners to run only a subset of Tempest tests.

  • A new related_bug decorator has been added to tempest.lib.decorators. Use it to decorate and tag a test that was added in relation to a launchpad bug report.

  • Move base_client from tempest.lib.services.volume.v3 to tempest.lib.services.volume, so if we want to add new interfaces based on a v2 client, we can make that v2 client inherit from volume.base_client.BaseClient to get microversion support, and then to make the new v3 client inherit from the v2 client, thus to avoid the multiple inheritance.

  • Define v2.0 tags_client for the network service as a library interface, allowing other projects to use this module as a stable library without maintenance changes.

    • tags_client(v2.0)

  • Pause teardown When pause_teardown flag in tempest.conf is set to True a pdb breakpoint is added to tearDown and tearDownClass methods in test.py. This allows to pause cleaning resources process, so that used resources can be examined. Closer examination of used resources may lead to faster debugging.

  • Added tempest workspace remove --name <workspace_name> --rmdir feature to delete the workspace directory as well as entry.

Upgrade Notes

  • Switch to use Glance v2 APIs in volume tests, by adding the Glance v2 client images_client.

  • The Heat API tests have been removed from tempest, they were unmaintained. The future direction of api test for heat is their in-tree Gabbi tests

  • The volume config option ‘api_v3’ default is changed to True because the volume v3 API is CURRENT.

  • verify_tempest_config command starts using extension_client of cinder v2 API only, because cinder v3 API is current and v2 and v1 are deprecated and v3 extension API is the same as v2. Then we can reuse the v2 client for v3 API also.

Deprecation Notes

  • Image APIs in compute are deprecated, Image native APIs are recommended. And Glance v1 APIs are deprecated and v2 APIs are current. Image client compute_images_client and Glance v1 APIs are removed in volume tests.

  • The config option forbid_global_implied_dsr from the IdentityFeature group is now deprecated. This feature flag was introduced to support testing of old OpenStack versions which are not supported anymore.

  • Deprecate default value for configuration parameter v3_endpoint_type of identity section in OpenStack Pike and modify the default value to publicURL in OpenStack Q release.

  • Deprecate class BaseClient from volume.v3.base_client and move it to volume.base_client. tempest.lib.services.volume.v3.base_client.BaseClient (new tempest.lib.services.volume.base_client.BaseClient)

Bug Fixes

  • When receiving nullable list as a response body, tempest.lib rest_client module raised an exception without valid json deserialization. A new release fixes this bug.

16.0.0

Prelude

This release indicates end of support for Mitaka in Tempest.

New Features

  • Add a new client to handle the OAUTH consumers feature from the identity API.

  • Add missing API call, list all role inference rules, to the roles_client library. This feature enables the possibility of listing all role inference rules in the system.

  • Add cascade parameter to volumes_client. This option provides the ability to delete a volume and have Cinder handle deletion of snapshots associated with that volume by passing an additional argument to volume delete, “cascade=True”.

  • Define the compute server evacuate client method in the servers_client library.

  • Add the list auth projects API to the identity client library. This feature enables the possibility to list projects that are available to be scoped to based on the X-Auth-Token provided in the request.

  • Add versions_client module for image service. This new module provides list_versions() method which shows API versions from Image service.

  • Add the list security groups by server API to the servers_client library. This feature enables the possibility to list security groups for a server instance.

  • Add versions_client module for identity service. This new module provides list_versions() method which shows API versions from Identity service.

  • Add versions_client module for volume service. This new module provides list_versions() method which shows API versions from Volume service.

  • Interface show_quota_set of compute quotas_client has been extended to include the argument “detail”, which allows for detailed quota set information for a project to be retrieved, if set to True.

  • Add remote_client under tempest.lib. This remote_client under tempest.lib is defined as stable interface, and now this module provides the following essential methods.

    • exec_command

    • validate_authentication

    • ping_host

  • Adds a new cli option to tempest run, --combine, which is used to indicate you want the subunit stream output combined with the previous run’s in the testr repository

  • Add update encryption type API to the v2 encryption_types_client library. This feature enables the possibility to update an encryption type for an existing volume type.

  • Add the unmanage volume API service method in v2 volumes_client library. Define v2 volume_manage_client client for the volume service as library interfaces, allowing other projects to use this module as stable libraries without maintenance changes.

    • volume_manage_client(v2)

  • Add server tags APIs to the servers_client library. This feature enables the possibility of updating, deleting and checking existence of a tag on a server, as well as updating and deleting all tags on a server.

  • Define volume transfers service clients as libraries. The following volume transfers service clients are defined as library interface.

    • transfers_client(v2)

Upgrade Notes

  • The JSON_ENC and TXT_ENC option in the _error_checker section have been added with additional content-type which are defined in RFC7231 but missing in the current rest_client.py file. The lack of these additional content-type will cause defcore test to fail for OpenStack public cloud which uses tomcat module in the api gateway. The additions are application/json;charset=utf-8, text/html;charset=utf-8, text/plain;charset=utf-8

  • The default value of rand_name()’s prefix argument is changed to ‘tempest’ from None to identify resources are created by Tempest.

  • The volume config option ‘api_v1’ default is changed to False because the volume v1 API has been deprecated since Juno release.

  • The call_until_true of test module is removed because it was marked as deprecated and Tempest provides it from test_utils as a stable interface instead. Please switch to use test_utils.call_until_true if necessary.

  • Remove Cinder v1 API tests. Cinder v1 API has been deprecated since Juno release, and Juno is not supported by current Tempest. Then Cinder v1 API tests are removed from Tempest.

  • The deprecated config option allow_port_security_disabled from compute_feature_enabled group has been removed.

  • Below deprecated config options from compute group have been removed. Corresponding config options already been available in validation group.

    • compute.image_ssh_user (available as validation.image_ssh_user)

    • compute.ssh_user (available as validation.image_ssh_user)

    • scenario.ssh_user (available as validation.image_ssh_user)

    • compute.network_for_ssh (available as validation.network_for_ssh)

    • compute.ping_timeout (available as validation.ping_timeout)

  • The deprecated config option ‘dvr_extra_resources’ from network group has been removed. This option was for extra resources which were provisioned to bind a router to Neutron L3 agent. The extra resources need to be provisioned in Liberty release or older, and are not required since Mitaka release. Current Tempest doesn’t support Liberty, so this option has been removed from Tempest.

  • The deprecated config option ‘reseller’ from identity_feature_enabled group has been removed.

  • The deprecated volume_services option in the volume_feature_enabled section has now been removed.

  • Tempest now defaults to using Keystone v3 API for the authentication, because Keystone v3 API is CURRENT and the v2 API is deprecated.

Deprecation Notes

  • The deactivate_image configuration switch from the config module is deprecated. It was added to support the older-than-kilo releases which we don’t support anymore.

  • The dvr_extra_resources configuration switch from the config module is deprecated. It was added to support the Liberty Release which we don’t support anymore.

  • Glance v1 APIs are deprecated and v2 are current. Tempest should tests only v2 APIs. Below API version selection config options for glance have been deprecated and will be removed in future.

    • CONF.image_feature_enabled.api_v2

    • CONF.image_feature_enabled.api_v1

  • The resources_prefix is marked as deprecated because it is enough to set ‘tempest’ as the prefix on rand_name() to identify resources which are created by Tempest and no projects set this option on OpenStack dev community.

  • The skip_unless_attr decorator in lib/decorators.py has been deprecated, please use the standard testtools.skipUnless and testtools.skipIf decorators.

  • The skip_unless_config and skip_if_config decorators in the config module have been deprecated and will be removed in the Queens dev cycle. Use the testtools.skipUnless (or a variation of) instead.

  • Volume v1 API is deprecated and the v3 are CURRENT. Tempest doesn’t need to test the v1 API as the default. The volume config option ‘api_v1’ has been marked as deprecated.

  • Deprecate volume v2 transfers resource methods from volumes_client(v2) libraries. Same methods are available in new transfers service client: transfers_client(v2) The following methods of volume v2 volumes_clients have been deprecated:

    • create_volume_transfer (v2.volumes_client)

    • show_volume_transfer (v2.volumes_client)

    • list_volume_transfers (v2.volumes_client)

    • delete_volume_transfer (v2.volumes_client)

    • accept_volume_transfer (v2.volumes_client)

Bug Fixes

  • Fix below volume v2 service clients to make v2 API call: Bug#1667354

    • SchedulerStatsClient

    • CapabilitiesClient

  • The ‘sahara’ config option in the ‘service-available’ group has been moved to the sahara plugin (openstack/sahara-tests) along with tests and service client during the Ocata timeframe. A ‘sahara’ config option was left over on Tempest side, and it’s removed now. As long as the sahara plugin is installed, this change as no impact on users of sahara tests.

Other Notes

  • OpenStack Releases Supported after this release are Newton and Ocata

    The release under current development as of this tag is Pike, meaning that every Tempest commit is also tested against master branch during the Pike cycle. However, this does not necessarily mean that using Tempest as of this tag will work against Pike (or future releases) cloud.

15.0.0

Prelude

This release is marking the start of Ocata release support in Tempest

New Features

  • Add the implied roles feature API to the roles_client library. This feature enables the possibility to create inferences rules between roles (a role being implied by another role).

  • Define v2 snapshot_manage_client client for the volume service as library interfaces, allowing other projects to use this module as stable libraries without maintenance changes.

    • snapshot_manage_client(v2)

  • Added customized JSON schema format checker for ‘date-time’ format. Compute response schema will be validated against customized format checker.

Upgrade Notes

  • The default value for the allow_port_security_disabled option in the compute-feature-enabled section has been changed from False to True.

  • The default value for the reseller option in the identity-feature-enabled section has been changed from False to True.

  • The default value for the volume_services option in the volume_feature_enabled section has been changed from False to True.

  • The deprecated compute microversion config options from ‘compute-feature-enabled’ group have been removed. Those config options are available under ‘compute’ group to configure the min and max microversion for compute service. * CONF.compute.min_microversion * CONF.compute.max_microversion

  • Below deprecated config options from compute group have been removed. Corresponding config options already been available in validation group.

    • compute.use_floatingip_for_ssh (available as validation.connect_method)

    • compute.ssh_auth_method (available as validation.auth_method)

    • compute.image_ssh_password (available as validation.image_ssh_password)

    • compute.ssh_shell_prologue (available as validation.ssh_shell_prologue)

    • compute.ping_size `` (available as ``validation.ping_size)

    • compute.ping_count `` (available as ``validation.ping_count)

    • compute.floating_ip_range `` (available as ``validation.floating_ip_range)

  • The deprecated input-scenario config options and group have been removed. The input scenarios functionality already being removed from tempest and from this release, their corresponding config options too.

  • Below deprecated network config options have been removed. Those config options already been renamed to below meaningful names.

    • tenant_network_cidr (removed) -> project_network_cidr

    • tenant_network_mask_bits (removed) -> project_network_mask_bits

    • tenant_network_v6_cidr (removed) -> project_network_v6_cidr

    • tenant_network_v6_mask_bits (removed) -> project_network_v6_mask_bits

    • tenant_networks_reachable (removed) -> project_networks_reachable

Deprecation Notes

  • The allow_port_security_disabled option in the compute-feature-enabled section is now deprecated.

  • The reseller option in the identity-feature-enabled section is now deprecated.

  • The volume_services option in the volume_feature_enabled section is now deprecated.

Other Notes

  • OpenStack releases supported at this time are Mitaka, Newton, and Ocata.

    The release under current development as of this tag is Pike, meaning that every Tempest commit is also tested against master during the Pike cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Pike (or future releases) cloud.

14.0.0

Prelude

This release is marking the end of Liberty release support in Tempest

New Features

  • The cred_provider abstract class which serves as the basis for both of tempest’s cred providers, pre-provisioned credentials and dynamic credentials, is now a library interface. This provides the common signature required for building a credential provider.

  • The cred_client module was added to tempest.lib. This module provides a wrapper to the keystone services client which provides a uniform interface that abstracts out the differences between keystone api versions.

  • Define the identity service role_assignments_client as a library. Add role_assignments_client to the library interface so the other projects can use this module as a stable library without any maintenance changes.

  • A Neutron Service Providers client is added to deal with resources of the ‘/service-providers’ route.

  • A new optional parameter port for ssh client (tempest.lib.common.ssh.Client) to specify destination port for a host. The default value is 22.

  • Define the Volume v3 service clients as library interfaces, allowing other projects to use these modules as stable libraries without maintenance changes.

    • messages_client(v3)

  • The volume_limits client was added to tempest.lib.

  • Define volume service clients as libraries. The following volume service clients are defined as library interface, so the other projects can use these modules as stable libraries without any maintenance changes.

    • volumes_client(v1)

    • volumes_client(v2)

    • capabilities_client(v2)

    • scheduler_stats_client(v2)

Upgrade Notes

  • Add an error translation to list_versions() of versions_client of both compute and network. This can affect users who are expecting that these clients return error status code instead of the exception. It is needed to change the code for handling the exception like the other clients code.

  • The Stress tests framework and all the stress tests have been removed.

  • All tests for the Ironic project have been removed from Tempest. Those exist as a Tempest plugin in the Ironic project.

  • The Negative Tests Generator has been removed (it was not used by any Tempest tests).

  • All tests for the Sahara project have been removed from Tempest. They now live as a Tempest plugin in the openstack/sahara-tests repository.

Deprecation Notes

  • The api_extensions config option in the compute-feature-enabled group is now deprecated. This option will be removed from tempest when all the OpenStack releases supported by tempest no longer support the API extensions mechanism. This was removed from Nova during the Newton cycle, so this will be removed at the Mitaka EOL.

  • The bootable config option in the volume_feature_enabled group is removed because the corresponding feature os-set_bootable has been implemented 2.5 years ago and all OpenStack versions which are supported by Tempest should support the feature.

Other Notes

  • OpenStack releases supported at this time are Mitaka and Newton.

    The release under current development as of this tag is Ocata, meaning that every Tempest commit is also tested against master during the Ocata cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Ocata (or future releases) cloud.

13.0.0

Prelude

This release is marking the start of Newton release support in Tempest

New Features

  • Define identity service clients as libraries. Add new service clients to the library interface so the other projects can use these modules as stable libraries without any maintenance changes.

    • identity_client(v2)

    • groups_client(v3)

    • trusts_client(v3)

    • users_client(v3)

    • identity_client(v3)

    • roles_client(v3)

    • inherited_roles_client(v3)

    • credentials_client(v3)

  • Define volume service clients as libraries. The following volume service clients are defined as library interface, so the other projects can use these modules as stable libraries without any maintenance changes.

    • backups_client

    • encryption_types_client (v1)

    • encryption_types_client (v2)

    • qos_clients (v1)

    • qos_clients (v2)

    • snapshots_client (v1)

    • snapshots_client (v2)

  • Define the v1 and v2 types_client clients for the volume service as library interfaces, allowing other projects to use these modules as stable libraries without maintenance changes.

Upgrade Notes

  • the already deprecated tempest-cleanup standalone command has been removed. The corresponding functionalities can be accessed through the unified tempest command (tempest cleanup).

Deprecation Notes

  • Oslo.utils provides same method get_ipv6_addr_by_EUI64, so deprecate it in Newton and remove it in Ocata.

  • The call_until_true function is moved from the tempest.test module to the tempest.lib.common.utils.test_utils module. Backward compatibility is preserved until Ocata.

Other Notes

  • OpenStack releases supported at this time are Liberty, Mitaka, and Newton.

    The release under current development as of this tag is Ocata, meaning that every Tempest commit is also tested against master during the Ocata cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Ocata (or future releases) cloud.

12.2.0

New Features

  • RestClient now supports setting timeout in urllib3.poolmanager. Clients will use CONF.service_clients.http_timeout for timeout value to wait for http request to response.

  • KeystoneAuthProvider will accept http_timeout and will use it in get_credentials.

  • Define identity service clients as libraries. The following identity service clients are defined as library interface, so the other projects can use these modules as stable libraries without any maintenance changes.

    • endpoints_client(v3)

    • policies_client (v3)

    • regions_client(v3)

    • services_client(v3)

    • projects_client(v3)

  • The Tempest plugin interface contains a new optional method, which allows plugins to declare and automatically register any service client defined in the plugin.

  • tempest.lib exposes a new stable interface, the clients module and ServiceClients class, which provides a convenient way for plugin tests to access service clients defined in Tempest as well as service clients defined in all loaded plugins. The new ServiceClients class only exposes for now the service clients which are in tempest.lib, i.e. compute, network and image. The remaining service clients (identity, volume and object-storage) will be added in future updates.

  • A new optional interface TempestPlugin.get_service_clients is available to plugins. It allows them to declare any service client they implement. For now this is used by tempest only, for auto-registration of service clients in the new class ServiceClients.

  • A new singleton class clients.ClientsRegistry is available. It holds the service clients registration data from all plugins. It is used by ServiceClients for auto-registration of the service clients implemented in plugins.

  • A new helper method service_client_config has been added to the stable module config.py that returns extracts from configuration into a dictionary the configuration settings relevant for the initialization of a service client.

  • Define volume service clients as libraries The following volume service clients are defined as library interface, so the other projects can use these modules as stable libraries without any maintenance changes.

    • availability_zone_client(v1)

    • availability_zone_client(v2)

    • extensions_client(v1)

    • extensions_client(v2)

    • hosts_client(v1)

    • hosts_client(v2)

    • quotas_client(v1)

    • quotas_client(v2)

    • services_client(v1)

    • services_client(v2)

Upgrade Notes

  • The nova_cert option default is changed to False. The nova certification management APIs were a hold over from ec2, and are not used by any other parts of nova. They are deprecated for removal in nova after the newton release. This makes false a more sensible default going forward.

  • The previously deprecated Javelin utility has been removed from Tempest. As an alternative Ansible can be used to construct similar yaml workflows to what Javelin used to provide.

Deprecation Notes

  • The new clients module provides a stable alternative to tempest classes manager.Manager and clients.Manager. manager.Manager only exists now to smoothen the transition of plugins to the new interface, but it will be removed shortly without further notice.

12.1.0

New Features

  • Adds a network version client for querying Neutron’s API version discovery URL (“GET /”).

  • Tempest library auth interface now supports scope. Scope allows to control the scope of tokens requested via the identity API. Identity V2 supports unscoped and project scoped tokens, but only the latter are implemented. Identity V3 supports unscoped, project and domain scoped token, all three are available.

  • Adds the tempest run command to the unified tempest CLI. This new command is used for running tempest tests.

  • Adds tempest workspaces command and WorkspaceManager. This is used to have a centralized repository for managing different tempest configurations.

  • Adds subunit-describe-calls. A parser for subunit streams to determine what REST API calls are made inside of a test and in what order they are called.

    • Input can be piped in or a file can be specified

    • Output is shortened for stdout, the output file has more information

  • Tempest library auth interface now supports filtering with catalog name. Note that filtering by name is only successful if a known service type is provided.

  • Define identity service clients as libraries The following identity service clients are defined as library interface, so the other projects can use these modules as stable libraries without any maintenance changes.

    • endpoints_client(v2)

    • roles_client(v2)

    • services_client(v2)

    • tenants_client(v2)

    • users_client(v2)

  • Define image service clients as libraries The following image service clients are defined as library interface, so the other projects can use these modules as stable libraries without any maintenance changes.

    • image_members_client(v1)

    • images_client(v1)

    • image_members_client(v2)

    • images_client(v2)

    • namespaces_client(v2)

    • resource_types_client(v2)

    • schemas_client(v2)

  • A new test_utils module has been added to tempest.lib.common.utils. It should hold any common utility functions that help writing Tempest tests.

  • A new utility function called call_and_ignore_notfound_exc has been added to the test_utils module. That function call another function passed as parameter and ignore the NotFound exception if it raised.

  • Define routers_client as stable library interface. The routers_client module is defined as library interface, so the other projects can use the module as stable library without any maintenance changes.

  • The RestClient (in tempest.lib.common.rest_client) now supports POSTing and PUTing data with chunked transfer encoding. Just pass an iterable object as the body argument and set the chunked argument to True.

  • A new generator called chunkify is added in tempest.lib.common.utils.data_utils that yields fixed-size chunks (slices) from a Python sequence.

Upgrade Notes

  • The input scenarios functionality no longer exists in tempest. This caused a large number of issues for limited benefit and was only used by a single test, test_server_basic_ops. If you were using this functionality you’ll now have to do it manually with a script and/or tempest workspaces

  • The integrated dashboard scenario test has been removed and is now in a separate tempest plugin tempest-horizon. The removed test coverage can be used by installing tempest-horizon on the server where you run tempest.

  • The deprecated legacy credential provider has been removed. The only way to configure credentials in tempest now is to use the dynamic or preprovisioned credential providers

  • All tests for the Trove project have been removed from tempest. They now live as a tempest plugin in the trove project.

  • The location on disk that the tempest init command looks for has changed. Previously it would attempt to use python packaging’s data files to guess where setuptools/distutils were installing data files, which was incredibly unreliable and depended on how you installed tempest and which versions of setuptools, distutils, and python you had installed. Instead, now it will use either /etc/tempest, $XDG_CONFIG_PATH/.config/tempest, or ~/.tempest/etc (attempted in that order). If none of these exist it will create an empty ~/.tempest/etc directory. If you were relying on the previous behavior and none of these directories were being used you will need to move the files to live in one of these directories.

Deprecation Notes

  • tempest.lib.common.utils.misc.find_test_caller has been moved into the tempest.lib.common.utils.test_utils module. Calling the find_test_caller function with its old location is deprecated.

  • All the options in the input-scenario group are now deprecated. These were only used in tree by the now removed input scenarios functionality in test_server_basic_ops. They were only deprecated because there could be external consumers via plugins. They will be removed during the Ocata cycle.

12.0.0

Prelude

This release is marking the end of Kilo release support in Tempest

Other Notes

  • OpenStack Releases Supported after this release are Liberty and Mitaka The release under current development as of this tag is Newton, meaning that every Tempest commit is also tested against master during the Newton cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Newton (or future releases) cloud.

11.0.0

Prelude

This release is marking the start of Mitaka release support in tempest

New Features

  • Tempest library interface addition(API Microversion testing interfaces).

  • Compute Microversion testing support in Service Clients.

Other Notes

  • OpenStack Releases Supported at this time are Kilo, Liberty, Mitaka The release under current development as of this tag is Newton, meaning that every Tempest commit is also tested against master during the Newton cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Newton (or future releases) cloud.

10.0.0

Prelude

This release includes the addition of the stable library interface for tempest. This behaves just as tempest-lib did prior to this, but instead it lives directly in the tempest project. For more information refer to the library docs.

New Features

  • Tempest library interface

Other Notes

  • OpenStack Releases Supported at this time are the same as in the previous release 9, Kilo and Liberty.

    The release under current development as of this tag is Mitaka, meaning that every Tempest commit is also tested against master during the Mitaka cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Mitaka (or future releases) cloud.

  • Start using reno for managing release notes.

Creative Commons Attribution 3.0 License

Except where otherwise noted, this document is licensed under Creative Commons Attribution 3.0 License. See all OpenStack Legal Documents.