Skip to content

feat(datahub): add global.datahub.tls PEM bundle with fan-out to all Kafka/SR consumers#692

Open
manuschillerdev wants to merge 3 commits intoacryldata:masterfrom
manuschillerdev:feat/global-tls-block
Open

feat(datahub): add global.datahub.tls PEM bundle with fan-out to all Kafka/SR consumers#692
manuschillerdev wants to merge 3 commits intoacryldata:masterfrom
manuschillerdev:feat/global-tls-block

Conversation

@manuschillerdev
Copy link
Copy Markdown

Broader context via RFC: datahub-project/datahub#16975

Adds global.datahub.tls — a single PEM-only operator input that fans out into each runtime's native env vars across every DataHub component that talks to Kafka, Schema Registry, or GMS. It is intended not to introduce any breaking changes. Operators on credentialsAndCertsSecrets + springKafkaConfigurationOverrides should see zero change. global.datahub.tls is additive. Comment on the RFC for overall guidance would be much appreciated!

Side fix

acryl-datahub-actions previously forwarded springKafkaConfigurationOverrides straight into KAFKA_PROPERTIES_*, cross-pollinating Kafka Java vocabulary into librdkafka. Replaced with the existing
datahub.python.kafka.*.with.fallback helpers. global.pythonKafkaConfigurationOverrides and global.pythonKafkaSecretsOverrides are now actually wired and documented.

Related

Test plan

  • helm template with TLS enabled: 44 TLS anchors across 6 components
  • helm template with TLS unset: zero TLS output
  • Deploy against PEM-configured Kafka/SR and confirm handshakes

…alues.yaml

The values.yaml comment block for global.datahub.tls previously claimed Java
mTLS was "not yet wired" — but the helpers in this branch do wire it via the
init-container-produced bundle.pem. Update the comment to reflect actual
behavior and list SPRING_KAFKA_PROPERTIES_SSL_KEYSTORE_* under the emitted
env vars.

Bump chart version so ct lint's version-bump gate passes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant