Skip to content

Fixed packing error#182

Open
berserkr wants to merge 2 commits into
NVIDIA-NeMo:mainfrom
berserkr:packing_fix_pr
Open

Fixed packing error#182
berserkr wants to merge 2 commits into
NVIDIA-NeMo:mainfrom
berserkr:packing_fix_pr

Conversation

@berserkr
Copy link
Copy Markdown

@berserkr berserkr commented May 2, 2026

We experienced an issue where during packing a blend with multiple json files would create shard symlinks with the same name, this means that the last parquet was always overwriting previous files in blends with multiple json files. The fix is simple, add a prefix instead, keep all files as intended.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants