Exclude jline from transitive dependencies of hadoop - #4148
Conversation
Summary of ChangesHello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed! This pull request cleans up the project's dependency graph by removing an unnecessary transitive dependency. By explicitly excluding jline from hadoop-yarn-client, the build environment is streamlined, reducing the risk of dependency conflicts and keeping the project's classpath lean. Highlights
Using Gemini Code AssistThe full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips. Invoking Gemini You can request assistance from Gemini at any point by creating a comment using either
Customization To customize the Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a Limitations & Feedback Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counterproductive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here. Footnotes
|
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #4148 +/- ##
============================================
- Coverage 55.89% 55.87% -0.03%
+ Complexity 7426 7425 -1
============================================
Files 1132 1132
Lines 69667 69667
Branches 7918 7918
============================================
- Hits 38941 38926 -15
- Misses 28231 28244 +13
- Partials 2495 2497 +2
🚀 New features to boost your workflow:
|
|
This won't pass until rebased on #4143 , which is failing to get green (unknown cause currently). |
6cf8418 to
336bcd6
Compare
336bcd6 to
3ad5d7d
Compare
jline was being pulled in transitively via hadoop-yarn-client, which is used by several hadoop dependencies (hadoop-common, hadoop-client, hadoop-mapreduce-client-core). This CL excludes jline from hadoop-yarn-client in dependencyManagement in the root pom.xml to prevent it from being included. Verified that jline is no longer in the dependency tree and that unit tests in v1 (classic-templates) and v2/common pass.
3ad5d7d to
2095354
Compare
|
Yeah DataStream test is not relevant to this change, trying to fix in #4159 |
|
OK - if you think it is safe to merge, then I will do so after approval. My understanding is that jline is only used in a hadoop CLI that someone made, so it is not needed for use of the library. I think the transitive dep on hadoop is from kafka and those tests are green. |

jline was being pulled in transitively via hadoop-yarn-client, which is used by several hadoop dependencies (hadoop-common, hadoop-client, hadoop-mapreduce-client-core).