Automatic podman login does not work

[ibuziuk]

Describe the bug

Automatic podman login does not work on dogfooding / developer sandbox even though quai creds are configured correctly:

Che version

7.120@latest

Steps to reproduce

1. configure quay creds from UD
2. start an empty workspace
3. podman pull private repo
4. ERROR: projects $ podman pull quay.io/ibuziuk/udi:fuse
   Trying to pull quay.io/ibuziuk/udi:fuse...
   Error: unable to copy from source docker://quay.io/ibuziuk/udi:fuse: initializing source docker://quay.io/ibuziuk/udi:fuse: reading manifest fuse in quay.io/ibuziuk/udi: unauthorized: access to the requested resource is not authorized

Expected behavior

podman pull of the private repo works

Runtime

OpenShift

Screenshots

No response

Installation method

OperatorHub

Environment

Azure, Amazon

Eclipse Che Logs

Swagger endpoint does not seem to work consistently - dashboard/swagger#/Podman%20Login/post_dashboard_api_namespace__namespace__devworkspaceId__devworkspaceId__podmanlogin

204 is returned but nothing is injected

Additional context

[agiertli]

Some further notes:

If I create NEW workspace - podman pull works:

podman login --verbose --get-login quay.io
agiertli

But when I start EXISTING workspace (which was idled), it does not work:

podman login --verbose --get-login quay.io
Error: not logged into quay.io

It's not clear whether this is a result of race condition or an actual pattern.

Also, this code:
externalDockerRegistriesPodmanLoginCommand += podman login ${registry} -u '${username}' -p '${password}' || true\n;

specifically " || true " means the failures will be silent. podman login can fail due to many issues - certificates, typo in url, proxy - we should always log failures for troubleshooting purposes