Train Series Release Notes

15.0.0

Prelude

SolidFire cinder driver deprecate sf_allow_template_caching

New Features

  • Added MacroSAN drivers that allows cinder to manage volumes in ISCSI and FC environment

  • Zadara VPSA Driver: Added new driver authentication method to use VPSA API access key, and deprecate exisiting authentication method that used username and password combination. The deprecated config inputs will be removed in the next official release after Train.

  • When an encrypted volume is cloned, a new encryption key is generated for the new volume. This is currently implemented only for iSCSI/FC backends.

  • When uploading qcow2 images to Glance, image data will be compressed. This will generally result in less data transferred to Glance at the expense of higher CPU usage. This behavior is controlled by the “image_compress_on_upload” boolean option, which defaults to True.

  • Added Peer Persistence support in HPE 3PAR cinder driver.

  • Enabled multiattach capability for hpe3par driver.

  • A general framework to accommodate hardware compression accelerators for compression of volumes uploaded to the Image service (Glance) as images and decompression of compressed images used to create volumes is introduced.

    The only accelerator supported in this release is Intel QuickAssist Technology (QAT), which produces a compressed file in gzip format. Refer to this Cinder documentation for more information about using this feature.

    Additionally, the framework provides software-based compression using GUNzip tool if a suitable hardware accelerator is not available. Because this software fallback could cause performance problems if the Cinder services are not deployed on sufficiently powerful nodes, the default setting is not to enable compression on image upload or download.

    The compressed image of a volume will be stored in the Image service (Glance) with the container_format image property of compressed. See the Image service documentation for more information about this image container format.

  • Support for multiattach is enabled for HPE MSA Storage

  • NEC Driver: Added support to revert a volume to a snapshot.

  • NEC Driver: Added multiattach support.

  • NetApp SolidFire now reports QoS and efficiency stats allowing operators to use those values in consideration for weighting and filtering of their backends.

  • Added new configuration options to allow more specific control over some periodic processes. See the ‘Upgrade’ section for details.

  • Added revert to snapshot support for NexentaStor5 iSCSI and NFS drivers.

  • NexentaStor5 iSCSI and NFS drivers multiattach capability enabled.

  • Added support for creating, deleting, and updating consistency groups for NexentaStor5 iSCSI and NFS drivers.

  • Added support for taking, deleting, and restoring consistency group snapshots for NexentaStor5 iSCSI and NFS drivers.

  • Added consistency group capability to generic volume groups for NexentaStor5 iSCSI and NFS drivers.

  • Added volume manage/unmanage support for NexentaStor5 iSCSI and NFS drivers.

  • Added snapshot manage/unmanage support for NexentaStor5 iSCSI and NFS drivers.

  • Added the ability to list manageable volumes and snapshots for NexentaStor5 iSCSI and NFS drivers.

  • PowerMax for Cinder driver now supports extending in-use Metro RDF enabled volumes.

  • PowerMax driver - Volume deallocate and volume delete functionality have been combined into a single workflow.

  • All volumes and snapshots created using the PowerMax for Cinder driver now have additional metadata included pertaining to the details of the asset on the backend storage array.

  • Pure Storage FlashArray driver has added configuration option pure_host_personality for setting the host personality upon host creation (existing hosts are not affected).

  • Pure Storage FlashArray driver has added configuration option pure_iscsi_cidr for setting a network CIDR for iSCSI target connection. The default value will allow connections to all iSCSI targets.

  • Re-added Infortrend Cinder volume driver. The Infortrend driver, removed in Cinder 12.0.0 (Queens), has been restored in this release.

  • Added a new Cinder driver for RackScale Design NVMe-oF storage solution.

  • New Cinder driver for Seagate FC and iSCSI storage arrays.

  • The StorPool driver enables the multiattach and thin_provisioning capabilities.

  • Dell EMC Unity driver: Add consistent group support. Users could create a group type supporting consistent groups with specification ‘consistent_group_snapshot_enabled’: <is> True, then any groups created of that group type are consistent groups, otherwise they are generic groups. The supported operations are: create/delete consistent groups, add volumes to and remove volumes from consistent groups, create/delete consistent group snapshots, create consistent groups from snapshots, clone consistent groups.

  • Added support for UC-Series model to Synology Cinder driver.

  • Dell EMC Unity Driver: Added volume replication support.

  • Added a new default volume type __DEFAULT__ which will be used when

    • A new volume is created without a type

    • The default_volume_type option is unset in cinder.conf

    Then the volume will be assigned the __DEFAULT__ type.

  • VxFlex OS driver now supports VxFlex OS 3.0 features: storage pools with fine granularity layout, volume compression(SPEF).

Known Issues

  • In the Image service (Glance), the compressed container format identifier does not indicate a particular compression technology; it is up to the image consumer to determine what compression has been used, and there is no requirement that OpenStack services must support arbitrary compression technologies. For the upload and download of compressed images, Cinder supports only the gzip format.

    While you may expect that Cinder will be able to consume any image in compressed container format that Cinder has created, you should not expect Cinder to be able to successfully use an image in compressed format that it has not created itself.

  • SmartCompression feature is disabled for the NexentaStor5 NFS driver. Thick provisioned volumes created as files containing zeros are not being compressed with standard compression if SmartCompression feature is enabled. This functionality will be fixed in a later release.

Upgrade Notes

  • Add a new config option ‘zadara_access_key’: Zadara VPSA access key.

  • Added config option backup_mount_attempts to specify the number of attempts to mount NFS share in the NFS backup driver.

  • A new check is added to the cinder-status upgrade check CLI to check for the use of backup driver module path instead of full driver class path in the backup_driver configuration setting.

  • A warning has been added to the cinder-status upgrade check CLI if a policy.json file is present. Documentation has been updated to correct the file as policy.yaml if any policies need to be changed from their defaults.

  • A new check is added to the cinder-status upgrade check CLI to check for the configuration of CoprHD, HGST or ITRI DISCO drivers. These drivers were removed in the Stein release and should not be configured at the time of upgrade.

  • A new check is added to the cinder-status upgrade check CLI to check for the use of cinder.volume.drivers.windows.windows.WindowsDriver and a message is reported that the user needs to update the setting to cinder.volume.drivers.windows.iscsi.WindowsISCSIDriver if it is encountered.

  • The driver for Datera’s Storage Systems has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it.

  • The Cinder database can now only be upgraded with changes since the Queens release. In order to upgrade from a version prior to that, you must now upgrade to at least Queens first.

  • A new check is added to the cinder-status upgrade check CLI to check for the use of the deprecated cinder.quota.NestedDbQuotaDriver. This driver will be replaced by a new, OpenStack-wide, nested quota management.

  • DellEMC Unity: The fix of bug 1825469 changes the default value of the force_delete_lun_in_storagegroup option from False to True, which means luns will always be force deleted after upgrade.

  • The HPE MSA driver options hpmsa_backend_name and hpmsa_backend_type options were deprecated in favor of hpmsa_pool_name and hpmsa_pool_type to avoid confusion, and the hpmsa_api_protocol, hpmsa_verify_certificate, and hpmsa_verify_certificate_path options were deprecated in favor of the standard driver_use_ssl, driver_ssl_cert_verify, and driver_ssl_cert_path options. To retain the default behavior, add driver_use_ssl = true to back-end entries in cinder.conf before the deprecated options are removed in a future release.

  • The Huawei Fusionstorage driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use the driver.

  • The IBM Flashsystem drivers have been marked as unsupported and are now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use them.

  • The IBM GPFS driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it.

  • The IBM Storage drivers (XIV & DS8k) have been marked as unsupported and are now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use them.

  • The IBM Storwize drivers have been marked as unsupported and are now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use them.

  • The Lenovo driver options lenovo_backend_name and lenovo_backend_type options were deprecated in favor of lenovo_pool_name and lenovo_pool_type to avoid confusion, and the lenovo_api_protocol, lenovo_verify_certificate, and lenovo_verify_certificate_path options were deprecated in favor of the standard driver_use_ssl, driver_ssl_cert_verify, and driver_ssl_cert_path options. To retain the default behavior, add driver_use_ssl = true to back-end entries in cinder.conf before the deprecated options are removed in a future release.

  • Added string config option compression_format in [default] section of cinder.conf to specify image compression format. Currently the only legal value for this option is gzip.

  • Added boolean config option allow_compression_on_image_upload in [default] section of cinder.conf to enable/disable image compression on image upload. The default value of this option is false, which means image compression is disabled.

  • The HPE LeftHand driver has been marked as unsupported and is now deprecated. enable_unsupported_drivers will need to be set to True in cinder.conf to continue to use them.

  • NEC Driver: Added support of more than 4 iSCSI portals for a node.

  • SolidFire supports Synchronous, Asynchronous and SnapshotsOnly replication modes. This adds the config option solidfire:replication_mode to specify the mode to be used by Cinder. Its value can be Sync, Async or SnapshotsOnly.

  • The periodic_interval configuration option was being used in too many places, and as a result, it had become difficult to tune specific periodic tasks without affecting other functionality. The following configuration options should now be used in place of periodic_interval:

    • backup_driver_init_check_interval

    • backup_driver_status_check_interval

    • scheduler_driver_init_wait_time

    • backend_stats_polling_interval

    See the help text for these options for more information. The default value of each option is 60, which has been the default value of periodic_interval.

    • If you have not modified periodic_interval, you should see no differences from current behavior.

    • If you have modified periodic_interval, please review the new options to determine which one(s) should be adjusted. Also, you should consider setting periodic_interval back to its default value of 60.

    A warning has been added to the cinder-status upgrade check CLI to detect whether the periodic_interval option has been modified from its default value to remind you which of the above situations currently applies to you.

    The periodic_interval configuration option still exists but its use is now restricted to providing a default periodicity for objects created from the cinder.service.Service class.

  • The Nexenta Edge storage driver has been removed after completion of its deprecation period without a reliable 3rd Party CI system being supported. Customers using the Nexenta Edge driver should not upgrade Cinder without first migrating all volumes from their Nexenta backend to a supported storage backend. Failure to migrate volumes will result in no longer being able to access volumes back by the Nexenta Edge storage backend.

  • Added a new config option nexenta_rest_connect_timeout. This option specifies the time limit (in seconds), within which the connection to NexentaStor management REST API server must be established.

  • Added a new config option nexenta_rest_read_timeout. This option specifies the time limit (in seconds), within which NexentaStor management REST API server must send a response.

  • Added a new config option nexenta_rest_backoff_factor. This option specifies the backoff factor to apply between connection attempts to NexentaStor management REST API server.

  • Added a new config option nexenta_rest_retry_count. This option specifies the number of times to repeat NexentaStor management REST API call in case of connection errors and NexentaStor appliance EBUSY or ENOENT errors.

  • Added a new config option nexenta_origin_snapshot_template. This option specifies template string to generate origin name of clone.

  • Added a new config option nexenta_group_snapshot_template. This option specifies template string to generate group snapshot name.

  • The Nimble driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it.

  • Two new checks are added to the cinder-status upgrade check CLI to ensure that online data migrations from Queens onward have been completed.

  • The Oracle ZFSSA drivers have been marked as unsupported and are now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use them.

  • The PowerMax Cinder driver has removed the environment configuration option san_rest_port in favour of the Cinder standard option san_api_port.

  • The DataCore drivers were marked as unsupported in the Rocky release and have now been removed.

  • The DRBDManage driver is now removed. Customers using the DRBDManage driver should not upgrade Cinder without first migrating all volumes from their DRBDManage backend to a supported storage backend such as LINSTOR. Failure to migrate volumes will result in not being able to access volumes backed by the DRBDManage storage backend.

  • The Veritas HyperScale storage driver has been removed after completion of its deprecation period without a reliable 3rd Party CI system being supported. Customers using the Veritas HyperScale driver should not upgrade Cinder without first migrating all volumes from their Veritas backend to a supported storage backend. Failure to migrate volumes will result in no longer being able to access volumes backed by the Veritas HyperScale storage backend.

  • Dell EMC ScaleIO has been rebranded to VxFlex OS. The drivers cinder.volume.drivers.dell_emc.scaleio.driver.ScaleIODriver will now be updated to cinder.volume.drivers.dell_emc.vxflexos.driver.VxFlexOSDriver in cinder.conf. Driver configuration options that start with sio should also be updated to vxflexos. Existing sio configuration options will continue to work but will be removed in the V release. Online documentation will also change to reflect these changes.

  • The Sheepdog driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use the driver.

  • New config option spdk_max_queue_depth is added for SPDK NVMe-oF target. It allows users to specify max queu depth.

  • The Tintri storage driver has been removed after completion of its deprecation period without a reliable 3rd Party CI system being supported. Customers using the Tintri driver should not upgrade Cinder without first migrating all volumes from their Tintri backend to a supported storage backend. Failure to migrate volumes will result in no longer being able to access volumes backed by the Tintri storage backend.

  • The Prophetstor driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it.

  • The Veritas Access driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it.

  • The db migration script will create a volume type named __DEFAULT__ The online migration will migrate all existing untyped volumes, snapshots to the __DEFAULT__ type. An invalid/non-existent type specified with default_volume_type option in cinder.conf will result in VolumeTypeNotFoundByName exception.

  • The Virtuozzo driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it.

  • VxFlex OS (ScaleIO) driver drops support for options, which were marked as deprecated in Pike release. Remove config options: sio_protection_domain_id, sio_protection_domain_name, sio_storage_pool_name, sio_storage_pool_id. Remove volume type options: sio:sp_name, sio:sp_id, sio:pd_name, sio:pd_id, sio:provisioning_type, sio:iops_limit, sio:bandwidth_limit.

Deprecation Notes

  • The driver for Datera’s Storage Systems has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it. If its support status does not change, it will be removed in the ‘U’ development cycle.

  • The cinder.quota.NestedDbQuotaDriver quota driver for handling nested projects is now deprecated. There is an OpenStack-wide effort to move to “unified limits” that will require changes in how quotas are handled for these types of configurations. The NestedDbQuotaDriver will continue to work until it is replaced with this new mechanism.

  • The configuration option sf_allow_template_caching for the SolidFire cinder driver has been removed. Use image_volume_cache_enabled equals True for a better template image cache that is managed from cinder.

  • The HPE MSA driver options hpmsa_backend_name and hpmsa_backend_type options were deprecated in favor of hpmsa_pool_name and hpmsa_pool_type to avoid confusion, and the hpmsa_api_protocol, hpmsa_verify_certificate, and hpmsa_verify_certificate_path options were deprecated in favor of the standard driver_use_ssl, driver_ssl_cert_verify, and driver_ssl_cert_path options. To retain the default behavior, add driver_use_ssl = true to back-end entries in cinder.conf before the deprecated options are removed in a future release.

  • The Huawei Fusionstorage driver has been marked as unsupported due to a lack of Python3.7 support and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use them. If Python3.7 support is not demonstrated, the driver will be removed in the ‘U’ development cycle.

  • The IBM Flashsystem drivers have been marked as unsupported and are now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use them. If the support status does not change, the drivers will be removed in the ‘U’ development cycle.

  • The IBM GPFS driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it. If its support status does not change, it will be removed in the ‘U’ development cycle.

  • The IBM Storage drivers (XIV & DS8k) have been marked as unsupported and are now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use them. If the support status does not change, the drivers will be removed in the ‘U’ development cycle.

  • The IBM Storwize drivers have been marked as unsupported and are now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use them. If the support status does not change, they will be removed in the ‘U’ development cycle.

  • The Lenovo driver options lenovo_backend_name and lenovo_backend_type options were deprecated in favor of lenovo_pool_name and lenovo_pool_type to avoid confusion, and the lenovo_api_protocol, lenovo_verify_certificate, and lenovo_verify_certificate_path options were deprecated in favor of the standard driver_use_ssl, driver_ssl_cert_verify, and driver_ssl_cert_path options. To retain the default behavior, add driver_use_ssl = true to back-end entries in cinder.conf before the deprecated options are removed in a future release.

  • The HPE LeftHand driver has been marked as unsupported and is now deprecated. enable_unsupported_drivers will need to be set to True in cinder.conf to continue to use them. The driver will be removed in the Ussuri release.

  • NEC Driver: Deprecated nec_iscsi_portals_per_cont config option. The option was used to limit number of portals and is no longer needed.

  • The Nimble driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it. If its support status does not change, it will be removed in the ‘U’ development cycle.

  • The Oracle ZFSSA drivers have been been marked as unsupported and are now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use them. Oracle has indicated that they don’t plan to continue to support the drivers so they will be removed in the ‘U’ development cycle.

  • The DRBDManage driver is deprecated as of the Stein release and is removed in the Train release. Users should use the new LINSTOR driver instead.

  • The Sheepdog driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use the driver. The driver is scheduled for removal in the ‘U’ release.

  • The Prophetstor driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it. If its support status does not change, it will be removed in the ‘U’ development cycle.

  • The Veritas Access driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it. If its support status does not change, it will be removed in the ‘U’ development cycle.

  • The Virtuozzo driver has been marked as unsupported and is now deprecated. enable_unsupported_driver will need to be set to True in the driver’s section in cinder.conf to continue to use it. If its support status does not change, it will be removed in the ‘U’ development cycle.

  • The config option vmware_storage_profile is now deprecated and ignored. Setting this option results in performance degradation of the controller and put lot of load on vCenter server.

Bug Fixes

  • Solidfire fix extend volume with qos-Scaling to honor the increased size with increased iops on the extended volume.

  • Now cinder will be rollback the quota_usages table when failed to create an incremental backup if there doesn’t exist a parent backup or the backup is not in available state.

  • Fix python 3 incompatibility issues preventing NetApp cDOT driver from generating EMS logging messages (Bug #1833115).

  • Fixes a bug that prevented distributed file system drivers from creating snapshots during volume clone operations (NFS, WindowsSMBFS, VZstorage and Quobyte drivers). Fixing this allows creating snapshot based backups.

  • Fix DetachedInstanceError is not bound to a Session for VolumeAttachments. This affected VolumeList.get_all, and could make a service fail on startup and make it stay in down state.

  • DellEMC Unity: Fix bug 1825469. The fix enables the force_delete_lun_in_storagegroup option to True by default, which makes sure that luns can deleted even when they are still in storage groups.

  • The SolidFire replication was fixed. Several bugs were addressed (creating replicated volumes from snapshots, from volumes, retype a volume to a replicated type, managing a volume to a replicated type, correctly updating portal info on failover/failback and some minor other fixes). Closes bugs #1834013, #1751932.

  • This change fixes bug 1845483 - 3PAR: For Peer Persistence, add policy options in RCG. Following options are added after Remote Copy Group (RCG) is created: autoFailover, pathManagement, autoRecover

  • Bug 1809249 - 3PAR driver adds the config option hpe3par_target_nsp that can be set to the 3PAR backend to use when multipath is not enabled and the Fibre Channel Zone Manager is not used.

  • Fixed HPE MSA driver issue where a multi-attached volume could be unmapped while still in use.

  • Kaminario FC and iSCSI drivers: Fixed bug 1829398 where force detach would fail.

  • Fixed Lenovo driver issue where a multi-attached volume could be unmapped while still in use.

  • LVM iSCSI driver fix for IPv6 addresses for the different targets, IET, LIO, TGT, CXT, and SCST.

  • NetApp iSCSI drivers no longer use the discovery mechanism for multipathing and they always return all target/portals when attaching a volume. Thanks to this, volumes will be successfully attached even if the target/portal selected as primary is down, this will be the case for both, multipath and single path connections.

  • Rbd replication secondary device could set different user and keyring with primary cluster. Secondary secret_uuid value is configed in libvirt secret, and libvirtd using secondary secret reconnect to secondary cluster after Cinder failover host.

  • Dell EMC SC Driver: Fixes bug 1822229 to handle the volume mappings in the backend when a volume is attached to multiple instances on the same host.

  • Fixed issue where all Ceph RBD backups would be incremental after the first one. The driver now honors whether --incremental is specified or not.

  • Dell EMC VNX Driver: Fix bug 1796825, adding an option named vnx_async_migrate to accept the default setting for async migration.

  • Dell EMC VNX Cinder Driver: Fixes bug 1794646 to delete the LUN from the VNX storage. Because a temporary snapshot is created from the LUN during creating a volume from a snapshot and isn’t deleted, the LUN cannot be deleted before its snapshot is deleted. The fix makes sure the temp snapshot is deleted.

Other Notes

  • The Nexenta Edge storage driver was marked unsupported in Stein due to 3rd Party CI not meeting Cinder’s requirements. As a result the driver is removed starting from the Train release.

  • PowerMax driver - the minimum version of Unisphere for PowerMax required for Train is 9.1, so all the latest 91 REST endpoints will be used.

  • The PowerMax for Cinder driver now implements noCopy mode for links between SnapVX source and target. This change will improve space efficiency by using pointers instead of copied tracks when source and target volumes are linked.

  • The Veritas HyperScale storage driver was marked unsupported in Stein due to 3rd Party CI not meeting Cinder’s requirements. As a result the driver is removed starting from the Train release.

  • The Tintri storage driver was marked unsupported in Stein due to 3rd Party CI not meeting Cinder’s requirements. As a result the driver is removed starting from the Train release.