Skip to content

[SPARK-57857] Exclude com.ning dependency#730

Closed
dongjoon-hyun wants to merge 1 commit into
apache:mainfrom
dongjoon-hyun:SPARK-57857
Closed

[SPARK-57857] Exclude com.ning dependency#730
dongjoon-hyun wants to merge 1 commit into
apache:mainfrom
dongjoon-hyun:SPARK-57857

Conversation

@dongjoon-hyun

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR excludes the transitive com.ning:compress-lzf dependency from the shaded operator jar.

Why are the changes needed?

compress-lzf is pulled in via spark-core as a shuffle/broadcast compression codec. The operator only builds driver/submission specs and never runs it, like the other already-excluded runtime codecs (org.lz4, org.xerial.snappy, com.github.luben, org.roaringbitmap).

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Opus 4.8

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Thank you always, @peter-toth !

@dongjoon-hyun dongjoon-hyun added this to the 1.0.0 milestone Jul 1, 2026
@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Merged to main

@dongjoon-hyun dongjoon-hyun deleted the SPARK-57857 branch July 1, 2026 16:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants