Flaky tests

[pavel-jares-bcm]

The aim of this issue is to collect all flaky tests in GA to be fixed:

#GatewayCentralRegistry

Test [2] io.restassured.internal.RequestSpecificationImpl@715efe8f FAILED

java.lang.AssertionError: 1 expectation failed.
JSON path headers.x-forwarded-proto doesn't match.
Expected: is "https,https"
  Actual: https
    at org.zowe.apiml.integration.proxy.XForwardHeadersProxyTest.fromUntrustedProxy_throughCGW_throughGW_xForwardHeadersProvided_untrustedXForwardHeadersNotForwarded(XForwardHeadersProxyTest.java:117)

XForwardHeadersProxyTest > fromUntrustedProxy_throughCGW_throughGW_xForwardHeadersProvided_untrustedXForwardHeadersNotForwarded(RequestSpecification) > [2] io.restassured.internal.RequestSpecificationImpl@715efe8f FAILED
java.lang.AssertionError: 1 expectation failed.
JSON path headers.x-forwarded-proto doesn't match.
Expected: is "https,https"
Actual: https
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:500)
at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:481)
at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:73)
at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:60)
at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:86)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277)
at io.restassured.internal.ResponseSpecificationImpl$HamcrestAssertionClosure.validate(ResponseSpecificationImpl.groovy:512)
at io.restassured.internal.ResponseSpecificationImpl$HamcrestAssertionClosure$validate$1.call(Unknown Source)
at io.restassured.internal.ResponseSpecificationImpl.validateResponseIfRequired(ResponseSpecificationImpl.groovy:696)
at io.restassured.internal.ResponseSpecificationImpl.this$2$validateResponseIfRequired(ResponseSpecificationImpl.groovy)
at jdk.internal.reflect.GeneratedMethodAccessor63.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:575)
at org.codehaus.groovy.runtime.callsite.PlainObjectMetaMethodSite.doInvoke(PlainObjectMetaMethodSite.java:43)
at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:198)
at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:62)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185)
at io.restassured.internal.ResponseSpecificationImpl.body(ResponseSpecificationImpl.groovy:270)
at io.restassured.specification.ResponseSpecification$body$1.callCurrent(Unknown Source)
at io.restassured.internal.ResponseSpecificationImpl.body(ResponseSpecificationImpl.groovy:117)
at io.restassured.internal.ValidatableResponseOptionsImpl.body(ValidatableResponseOptionsImpl.java:244)
at org.zowe.apiml.integration.proxy.XForwardHeadersProxyTest.fromUntrustedProxy_throughCGW_throughGW_xForwardHeadersProvided_untrustedXForwardHeadersNotForwarded(XForwardHeadersProxyTest.java:117)

CITestsModulith*

org.zowe.apiml.integration.ha.AuthenticationHaTest

GivenMultipleInstances

WhenUserLogOut

  Test thenTokenIsInvalidatedInBoth() FAILED

  java.lang.AssertionError: 1 expectation failed.
  Expected status code <401> but was <200>.
      at org.zowe.apiml.integration.ha.AuthenticationHaTest$GivenMultipleInstances$WhenUserLogOut.thenTokenIsInvalidatedInBoth(AuthenticationHaTest.java:61)

AuthenticationHaTest > GivenMultipleInstances > WhenUserLogOut > thenTokenIsInvalidatedInBoth() FAILED
java.lang.AssertionError: 1 expectation failed.
Expected status code <401> but was <200>.
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:500)
at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:481)
at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:73)
at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:60)
at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:86)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:57)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:263)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277)
at io.restassured.internal.ResponseSpecificationImpl$HamcrestAssertionClosure.validate(ResponseSpecificationImpl.groovy:512)
at io.restassured.internal.ResponseSpecificationImpl$HamcrestAssertionClosure$validate$1.call(Unknown Source)
at io.restassured.internal.ResponseSpecificationImpl.validateResponseIfRequired(ResponseSpecificationImpl.groovy:696)
at io.restassured.internal.ResponseSpecificationImpl.this$2$validateResponseIfRequired(ResponseSpecificationImpl.groovy)
at jdk.internal.reflect.GeneratedMethodAccessor63.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:575)
at org.codehaus.groovy.runtime.callsite.PlainObjectMetaMethodSite.doInvoke(PlainObjectMetaMethodSite.java:43)
at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:198)
at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:62)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185)
at io.restassured.internal.ResponseSpecificationImpl.statusCode(ResponseSpecificationImpl.groovy:135)
at io.restassured.specification.ResponseSpecification$statusCode$1.callCurrent(Unknown Source)
at io.restassured.internal.ResponseSpecificationImpl.statusCode(ResponseSpecificationImpl.groovy:143)
at io.restassured.internal.ValidatableResponseOptionsImpl.statusCode(ValidatableResponseOptionsImpl.java:89)
at org.zowe.apiml.util.SecurityUtils.assertIfLogged(SecurityUtils.java:578)
at org.zowe.apiml.integration.ha.AuthenticationHaTest$GivenMultipleInstances$WhenUserLogOut.thenTokenIsInvalidatedInBoth(AuthenticationHaTest.java:61)

E2EUITests

GrpahQL - a component was not found

[pablocarle]

org.zowe.apiml.functional.gateway.ServiceHaModeTest

GivenTwoServices

OneReturns503

  verifyThatGatewayRetriesGet(Method)

    Test [1] GET FAILED

    org.opentest4j.AssertionFailedError: Return should be 200 or 503 but it is: 404
        at app//org.zowe.apiml.functional.gateway.ServiceHaModeTest$GivenTwoServices$OneReturns503.lambda$routeAndVerifyRetries$0(ServiceHaModeTest.java:198)

ServiceHaModeTest > GivenTwoServices > OneReturns503 > verifyThatGatewayRetriesGet(Method) > [1] GET FAILED
org.opentest4j.AssertionFailedError: Return should be 200 or 503 but it is: 404
at app//org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:38)
at app//org.junit.jupiter.api.Assertions.fail(Assertions.java:138)
at app//org.zowe.apiml.functional.gateway.ServiceHaModeTest$GivenTwoServices$OneReturns503.lambda$routeAndVerifyRetries$0(ServiceHaModeTest.java:198)
at java.base@17.0.15/java.util.stream.Streams$RangeIntSpliterator.forEachRemaining(Streams.java:109)
at java.base@17.0.15/java.util.stream.IntPipeline$Head.forEach(IntPipeline.java:645)
at app//org.zowe.apiml.functional.gateway.ServiceHaModeTest$GivenTwoServices$OneReturns503.routeAndVerifyRetries(ServiceHaModeTest.java:193)
at app//org.zowe.apiml.functional.gateway.ServiceHaModeTest$GivenTwoServices$OneReturns503.verifyThatGatewayRetriesGet(ServiceHaModeTest.java:181)

  verifyThatGatewayNotRetriesPost(Method)

    Test [1] POST FAILED

    org.opentest4j.AssertionFailedError: Return should be 200 or 503 but it is: 404
        at app//org.zowe.apiml.functional.gateway.ServiceHaModeTest$GivenTwoServices$OneReturns503.lambda$routeAndVerifyRetries$0(ServiceHaModeTest.java:198)

ServiceHaModeTest > GivenTwoServices > OneReturns503 > verifyThatGatewayNotRetriesPost(Method) > [1] POST FAILED
org.opentest4j.AssertionFailedError: Return should be 200 or 503 but it is: 404
at app//org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:38)
at app//org.junit.jupiter.api.Assertions.fail(Assertions.java:138)
at app//org.zowe.apiml.functional.gateway.ServiceHaModeTest$GivenTwoServices$OneReturns503.lambda$routeAndVerifyRetries$0(ServiceHaModeTest.java:198)
at java.base@17.0.15/java.util.stream.Streams$RangeIntSpliterator.forEachRemaining(Streams.java:109)
at java.base@17.0.15/java.util.stream.IntPipeline$Head.forEach(IntPipeline.java:645)
at app//org.zowe.apiml.functional.gateway.ServiceHaModeTest$GivenTwoServices$OneReturns503.routeAndVerifyRetries(ServiceHaModeTest.java:193)
at app//org.zowe.apiml.functional.gateway.ServiceHaModeTest$GivenTwoServices$OneReturns503.verifyThatGatewayNotRetriesPost(ServiceHaModeTest.java:187)
Test [2] PUT FAILED

[nxhafa]

org.zowe.apiml.integration.ha.GatewayMultipleInstancesTest

GivenMultipleGatewayInstances

WhenSendingRequest

  Test gatewayInstancesAreRegistered() FAILED

  java.lang.AssertionError: 
  Expected: is <2>
       but: was <1>
      at org.zowe.apiml.integration.ha.GatewayMultipleInstancesTest$GivenMultipleGatewayInstances$WhenSendingRequest.gatewayInstancesAreRegistered(GatewayMultipleInstancesTest.java:58)

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[balhar-jakub]

This one is going to be taken in first half of November