-
Notifications
You must be signed in to change notification settings - Fork 127
pipelines: fix auto-selection in "pipelines run" #4245
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
| // Returns empty string if there's not exactly one pipeline. | ||
| func autoSelectSinglePipeline(b *bundle.Bundle) string { | ||
| completions := resources.Completions(b, run.IsRunnable) | ||
| completions := resources.Completions(b, isPipeline) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
just a drive by comment since I got tagged: this was an intentional decision at the time from some one-off discussion. I think the product decision at the time was to still to expose anything that can still be run. Just curious if we've changed this decision.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Our template includes a job and a pipeline, so "run" command doesn't work because there are 2 runnable resources. Given that we are exposing the same "run" command in "databricks pipelines run", it should behave differently from "databricks bundles run", similar to how "databricks app run" and "databricks jobs run" should filter by their resource type.
|
Commit: 6af4dad
41 interesting tests: 13 KNOWN, 13 FAIL, 12 RECOVERED, 2 MISS, 1 SKIP
Top 26 slowest tests (at least 2 minutes):
|
lennartkats-db
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 I'm fine with this refinement, thanks Gleb!
| Deploying resources... | ||
| Updating deployment state... | ||
| Deployment complete! | ||
| View your job my_job here: [DATABRICKS_URL]/jobs/[NUMID]?o=[NUMID] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Non-blocking: I don't think we should show all URLs for many-resource DABs projects. We still don't have a good "single" URL for deployments yet. The alternative I think we discussed way back was to show a hint to use the summary command whenever there is >1 resource. But 1 pipeline + 1 job could also be treated as a special case.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Makes sense. Do I understand correctly, that this suggestion applies generically to DABs, and not special to pipelines?
Changes
Fix auto-selection in "pipelines run" command.
Previously, if bundle had a job and a pipeline, auto-selection didn't work because both are considered runnable. This is true, for example, for lakeflow-pipelines template. It's not intended because "pipelines run" command should only be applicable to pipelines.
Why
Fixing not correct behaviour
Tests
Acceptance tests