This repository was archived by the owner on Apr 18, 2026. It is now read-only.
Improve Tabular Training Speed with FastTensorDataLoader for Large Datasets - #19
Open
daksh777f wants to merge 2 commits into
Open
Improve Tabular Training Speed with FastTensorDataLoader for Large Datasets#19daksh777f wants to merge 2 commits into
daksh777f wants to merge 2 commits into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
#Description
This PR addresses a major performance bottleneck in training tabular models on large datasets using FastAI. The default DataLoader implementation introduces significant overhead when working with torch.Tensor inputs, particularly for large, in-memory tabular datasets.
To resolve this, we integrate the FastTensorDataLoader, a lightweight and efficient DataLoader alternative that directly batches tensors without additional indexing or worker overhead. This change dramatically improves training speed (up to 20x faster in tests) without affecting model accuracy or API ergonomics.
Fix #9