Merge upstream turbot v1.31.0 into catio fork (SDK v5→v6, Go 1.26)#8
Merge upstream turbot v1.31.0 into catio fork (SDK v5→v6, Go 1.26)#8samsar wants to merge 165 commits into
Conversation
…on table (turbot#2158) Co-authored-by: misraved <ved@turbot.com> Co-authored-by: ParthaI <partha@turbot.com>
…ws_transfer_server Closes turbot#2483 (turbot#2484)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.36.0 to 0.38.0. - [Commits](golang/net@v0.36.0...v0.38.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-version: 0.38.0 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
… and update Parliament IAM permissions to latest
…o in other tables (turbot#2493)
Co-authored-by: ParthaI <partha@turbot.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…elegated_services_for_account tables (turbot#2421) (turbot#2477) (turbot#2496) Co-authored-by: Muhammad Fuad Bin Abdullah <67743055+FuadAbdullah@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Keep Focused <partha@turbot.com>
Co-authored-by: ParthaI <partha@turbot.com>
Co-authored-by: Ved misra <47312748+misraved@users.noreply.github.com>
…table_bucket` tables (turbot#2498)
…eriod_end as optional quals) in all the table aws_cost_* tables (turbot#2168) Co-authored-by: misraved <ved@turbot.com>
…2_finding table definition
* Add CHANGELOG for v1.30.3 * Add Dependencies section noting SDK v6 + Go 1.26 requirement
…istent formatting (turbot#2742) This commit also includes: - Fix tags for `aws_secretsmanager_secret` table - Fix logging output string in `aws_cloudtrail_trail` table
Co-authored-by: ppapishe <praneeth.papishetty@wbd.com>
…date `aws_ecr_registry`, `aws_eks_pod_identity_association`, `aws_msk_topic` tables with various fixes
…s columns - Return the nested Canary from getSyntheticsCanary so get queries populate - Change success_retention_period_in_days from JSON to INT - Add not-found IgnoreConfig and title/akas standard columns - Add turbot test plus aws_region and canary_arn outputs
…log groups due to unsupported API calls closes turbot#2758
…ixes awsCommercialRegionPrefixes was missing the il and mx prefixes, so region wildcards like il-* or mx-* fell through to an unknown partition instead of resolving to the commercial partition. Added both prefixes and a unit test covering all commercial/gov/china/iso prefixes.
Add new tables `aws_ecr_registry`, `aws_eks_pod_identity_association`, `aws_msk_topic`, `aws_rds_global_cluster`, and `aws_synthetics_canary`. This commit also fixes bugs with the `aws_cloudwatch_log_subscription_filter` table and wildcard resolution for the `il` and `mx` regions.
…2746) urllib3 2.6.3 -> 2.7.0 in generate_parliament_iam_permissions. Security fix (HIGH), version-only diff, codegen tooling not shipped in plugin.
urllib3 2.6.3 -> 2.7.0 in generate_aws_supported_endpoints. Security fix (HIGH), version-only diff, codegen tooling not shipped in plugin.
lodash 4.17.23 -> 4.18.1 in aws-test. Security fix (HIGH). tint.js _.template usage verified unaffected; 4.18.1 includes the fix for the 4.18.0 template regression.
idna 3.7 -> 3.15 in generate_parliament_iam_permissions. Security fix (MEDIUM), version-only diff, codegen tooling not shipped in plugin.
requests 2.32.4 -> 2.33.0 in generate_aws_supported_endpoints. Security fix (MEDIUM), version-only diff, codegen tooling not shipped in plugin.
picomatch 2.3.1 -> 2.3.2 in aws-test. Security fix (HIGH), lock-file-only diff, test harness not shipped in plugin.
…#2722) requests 2.32.4 -> 2.33.0 in generate_parliament_iam_permissions. Security fix (MEDIUM), version-only diff, codegen tooling not shipped in plugin.
Bumps [github.com/go-jose/go-jose/v4](https://github.com/go-jose/go-jose) from 4.1.3 to 4.1.4. - [Release notes](https://github.com/go-jose/go-jose/releases) - [Commits](go-jose/go-jose@v4.1.3...v4.1.4) --- updated-dependencies: - dependency-name: github.com/go-jose/go-jose/v4 dependency-version: 4.1.4 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Brings the fork current with upstream (162 commits), including the steampipe-plugin-sdk v5 -> v6 major bump, Go 1.23 -> 1.26, and removal of the aws-sdk-go (v1) dependency. Conflict resolutions (5 files): - go.mod / go.sum: took upstream (v6 + Go 1.26 + dep overhaul), then 'go mod tidy' re-added our extra deps (pganalyze/pg_query_go/v6, testify). - Makefile: kept both our 'docker-build-steampipe' and upstream 'dev' targets. - table_aws_availability_zone.go: kept our region-scoping design (GetMatrixItemFunc + EC2Client, no ParentHydrate); dropped dead aws-sdk-go v1 import; ec2v1.EndpointsID -> AWS_EC2_SERVICE_ID. Upstream's shouldIgnoreErrorPluginDefault handling auto-merged and retained. - table_aws_vpc_flow_log_event.go: kept our columns/hydrate additions on upstream's v6 imports + IgnoreConfig + AWS_LOGS_SERVICE_ID. Silent (non-conflict) fixes required by the SDK bump: - Migrated operations_analyzer.go and build_filter_test.go from steampipe-plugin-sdk/v5 -> v6. Verified: go build ./... , go vet ./... , go test ./aws/vpcflowlogs/... all pass. Our aws-package unit tests pass except TestAnalyzeQueriesFromJSON, which is pre-existing and environmental (reads a sibling repo only present in the CI pipeline). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
go.mod now requires 'go 1.26.0' (raised by the upstream merge), so the plugin-builder stage must use golang:1.26 — golang:1.23 would refuse to build the module. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
golangci-lint (errcheck) flagged unchecked error returns on 8 io/gzip Close() calls in our fork-specific aws/vpcflowlogs/flow_log_events_s3.go. All are cleanup-path closes where the error is safe to discard, so make that explicit with '_ ='. Fixed all 8 (CI only surfaced 6 due to golangci-lint's default max-same-issues=3). golangci-lint v2.12.2 (CI-identical) now reports 0 issues. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
New test.yml workflow runs go test ./... on every pull request and push to main. TestAnalyzeQueriesFromJSON now skips (instead of failing) when the sibling extractor-steampipe fixture is absent, so the suite is green on plugin-only checkouts and in this repo's CI. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
The installer previously fetched latest at build time, making image rebuilds non-reproducible and exposing us to untested CLI releases. v2.4.4 is the current stable release (2026-05-25) and what recent unpinned builds shipped; plugin-sdk v6 is compatible with CLI v2.x. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
All verification is complete, including the changelog review and the SRE pass. Here's the full picture. Verdict: safe to merge ✅PR #8 is a faithful, well-executed sync. Every check I ran came back clean, with one systemic (not merge-blocking) CI gap and a short list of post-merge watch items. Merge integrity — verified
One correction to my interim note: Upstream behavior changes worth knowing (v1.12.0 → v1.31.0)No tables or columns were removed or renamed across the entire range, no breaking config changes, and ~60 new tables are purely additive. The changes that could surprise a downstream consumer:
|
What this does
Brings the catio fork current with upstream
turbot/steampipe-plugin-awsv1.31.0 (162 upstream commits), while preserving all 52 of our fork-specific commits. To see only our changes on top of the upstream, see this view.Merge (not rebase) so conflicts are resolved once in the final state and there's no history rewrite / force-push on a branch our pipelines depend on.
The big upstream changes this pulls in
steampipe-plugin-sdkv5 → v6 (major bump — repo-wide import change)godirective ingo.mod)aws-sdk-go(v1) dependency removed upstream;xxxv1.EndpointsIDreplaced by constants (AWS_EC2_SERVICE_ID,AWS_LOGS_SERVICE_ID)Conflicts resolved (5 files)
go.mod/go.sumgo mod tidyre-added our extra deps (pganalyze/pg_query_go/v6,testify)Makefiledocker-build-steampipeand upstream'sdevtargettable_aws_availability_zone.goGetMatrixItemFunc+EC2Client, noParentHydrate); dropped dead aws-sdk-go v1 import;ec2v1.EndpointsID→AWS_EC2_SERVICE_ID. Upstream'sshouldIgnoreErrorPluginDefaulthandling auto-merged and retainedtable_aws_vpc_flow_log_event.goIgnoreConfig+AWS_LOGS_SERVICE_IDSilent (non-conflict) fixes the SDK bump required
These files merged clean but wouldn't compile against v6:
aws/operations_analyzer.goandaws/build_filter_test.gofromsteampipe-plugin-sdk/v5→v6.docker/steampipe/Dockerfilebuilder imagegolang:1.23→golang:1.26(go.mod now requiresgo 1.26.0).Verification
go build ./...— passgo vet ./...— passgo test ./aws/vpcflowlogs/...— passgo test ./aws/unit tests — pass exceptTestAnalyzeQueriesFromJSON, which is pre-existing/environmental (reads../../extractor-steampipe/..., a sibling repo only present in the CI pipeline — fails identically onmain)linux/amd64(matches CI) — pass;go buildcompletes ingolang:1.26container, image builds, andsteampipe plugin listrecognizes the builtturbot/aws@latestpluginNote
The AWS plugin shows no connections in
steampipe plugin listinside the image because noaws.spcis baked in — credentials/connection config are injected at runtime. Expected, not a regression.