OpenStack Distributed QA

James E. Blair <corvus@inaugust.com>
Monty Taylor <mordred@inaugust.com>

OpenStack's Gated Trunk

Types of Tests

Unit tests
Functional tests
- Can be run on real or virtual servers
- Easy for developers to run
Integration tests
- May be able to run on virtual servers, should run on real servers
- Difficult or impossible for a developer to run

Test Process

Each test:

PXE boot
Install Ubuntu
Install OpenStack
Run test suite

Test Process Improved

One time (Orchestra driven):

PXE boot
Install Ubuntu
Install OpenStack dependencies
Snapshot LVM volume

Each test:

Kexec boot into LVM snapshot
Install OpenStack
Run test suite

OpenStack Projects

Testing as a Service [TaaS]

Common Interface: Jenkins
Inputs: commits to openstack projects
Outputs: test results

Troubleshooting Test Jobs

Focus for Next Cycle

Add more trunk gating jobs
Collaborate with vendors on distributed testing