Long Term Testing Compliance between Redhat and GCP

[sjswerdlow]

At Google, we have launched an initiative to ensure that RHOS is stable and performant on both Production and Staging (to catch any regressions from dependencies).

Initially we saw OPCT testing as a great way to ensure that everything was stable. After talking with Marco Braga (@mtulio) he told us that OPCT testing was good, but that the OCP CI testing was more exhaustive. And that the 'Product Workflow / Partner Ecosystem Program' may be what we're actually looking for.

We were then directed here to discuss further.

So there are few big questions right now:

1. What testing is done on GCP for OCP exactly? Is there performance testing?
2. Is there a way for us to run it? What about within our own projects?
3. What is the Product Workflow / Partner Ecosystem Program?

Thanks,

Sam

[mtulio]

Hi @sjswerdlow - GCP is an integrated cloud-provider on OpenShift, and Google is a Red Hat partner. Maybe OPCT tooling is not the better way to long term testing compliance of an OpenShift-integrated platform. We've sent you an email to close the loop with the partner team to follow you closely in your goals.

[MCloudinC]

What testing is done on GCP for OCP exactly? Is there performance testing?
OPCT does not provide any perf testing but rather a collection of existing tools that have been integrated for easier use.
OPCT was build on top of Sonobuoy (https://sonobuoy.io/) and openshift-tests (https://github.com/openshift/origin#end-to-end-e2e-and-extended-tests) utilities. The openshift-tests tool is used to run conformance test suites across the CI Jobs, and also the Kubernetes Certification Program (https://www.cncf.io/certification/software-conformance/). The sonobuoy tool is used to automate the certification environment, running many custom plugins implemented to meet the requirements of OpenShift Provider Certification Program.

Is there a way for us to run it? What about within our own projects?
Sure, here is a link to the docs to assist - https://redhat-openshift-ecosystem.github.io/opct/user/

What is the Product Workflow / Partner Ecosystem Program?
See above link

As @mtulio Pointed out, OPCT is really positioned towards SI and SAS providers that want to ensure thier products run on top of OCP. For your needs in GCP its likely OPCT CI https://docs.providers.openshift.org/continuous-integration-and-testing/ this provides many of the same test (or functionally the same) as well as some performance testing. It does this continuously and therefore is usually better for a long term Service provider schedule.

[sjswerdlow]

@mtulio I don't see an email, whats the subject? Also who is this partner team that you're syncing me with?

I have a good guess, but for clarities sake, what precisely does it mean that "GCP is an integrated cloud-provider on OpenShift" and "Google is a Red Hat partner"?

[mtulio]

OPCT project may not be the right place to discuss Red Hat partnership programs. I looped the stakeholders by email. :)