Redshift destination IAM support#3
Open
prakhar0042 wants to merge 8 commits into
Open
Conversation
…e_arn field Support IAM role-based authentication (IRSA / instance profile) by making access_key_id and secret_access_key optional. Add iam_role_arn for explicit Redshift COPY IAM role specification.
Use IAM_ROLE syntax for DefaultAWSCredentialsProviderChain (IRSA/instance profile), CREDENTIALS for static keys, and handle ASSUME_ROLE with session token. Exhaustive when-branch prevents silent breakage if S3CredentialType grows.
Extract iam_role_arn from S3 options in both check() and getSerializedMessageConsumer() and pass it to RedshiftStagingStorageOperation.
access_key_id and secret_access_key are now optional for IRSA users, so they should not be checked in anyOfS3FieldsAreNullOrEmpty.
…ration Cover ACCESS_KEY, DEFAULT_PROFILE (with and without explicit ARN), ASSUME_ROLE with and without session token, ARN validation, and precedence when both static keys and IAM role ARN are configured.
…nd iam_role_arn Verify that configs without access_key_id/secret_access_key pass validation, and that iam_role_arn is accepted in the spec.
Add support for IAM role-based authentication (IRSA / instance profile) for S3 staging and Redshift COPY commands.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Enables IAM role support for authentication in staging process.
How
Review guide
User Impact
Can this PR be safely reverted and rolled back?