Skip to content

This repo stores tools, and aim to auto the errata steps, run test cases and report test results smoothly so that ship high quality payload in a short time.

License

Notifications You must be signed in to change notification settings

openshift/release-tests

Repository files navigation

ERT (Errata Reliability Team)

ERT makes QE tasks of z-stream releases more efficient by improving test coverage and automating processes. This frees up release leaders, managers, and component teams from repetitive z-stream release tasks.

Features

  • Automates interactions with multiple systems (Errata, Jira, Google Docs, Slack, Jenkins)
  • Provides Prow job execution capabilities
  • Comprehensive testing framework
  • CLI interface for common release tasks

Tools

OAR (Openshift Automatic Release)

The OAR tool provides CLI commands for:

  • Advisory management (create, update, check status)
  • Bug tracking and management
  • Test report generation
  • Image consistency and signing checks
  • Notification handling
  • Integration with Jenkins for CI/CD

Prow Jobs

The QE job controller system handles:

  • Running and monitoring Prow jobs via Gangway
  • Artifact collection and analysis
  • Test result processing
  • Job selection and filtering

Installation

  1. Clone this repository:
git clone https://github.com/openshift/release-tests.git
cd release-tests
  1. Install dependencies:
pip3 install -e .

Command Samples

Here are some common OAR command examples:

# Create test report
oar -r [release] create-test-report

# Change advisory status
oar -r [release] change-advisory-status

# Update bug list and notify the QA Contact
oar -r [release] update-bug-list
...

More details can be found in oar/README.md

Prow job command examples:

# Run specific Prow job
job run [job_name] --payload $image_pullspec

# Check job results
job get_results [job_id]

# Start job controller
jobctl start-controller -r [release] --nightly --arch [amd64|arm64|multi|ppc64le|s390x]

# Start test results aggregator
jobctl start-aggregator --arch [amd64|arm64|multi|ppc64le|s390x]

License

This project is licensed under the terms of the LICENSE file.

About

This repo stores tools, and aim to auto the errata steps, run test cases and report test results smoothly so that ship high quality payload in a short time.

Resources

License

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 17

Languages