Repository navigation

feat: Push down offset/skip to TableScan - #25404

Merged

martin-g merged 49 commits into

apache:mainfrom

martin-g:TableProvider-recommend-scan_with_args

Oct 1, 2026

Commits on Sep 17, 2026
- Deprecate TableProvider::scan() in favor of ::scan_with_args()
  martin-g
  committed
  b1a51f2
- Update all callers of TableProvider::scan() with ::scan_with_args()
  martin-g
  committed
  9a48bf3
- Revert unnecessary changes from scan() to scan_with_args()
  martin-g
  committed
  5003d14
- Optimize imports
  martin-g
  committed
  1ffbcd9
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  authored
  bf33559
- Add support for pushing down the offset to push_down_limit
  martin-g
  committed
  741424d
- prettier
  martin-g
  committed
  513630d
- Prevent usize overflows, fix test assertion, fix example in a comment
  martin-g
  committed
  861a55f
Commits on Sep 18, 2026
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  authored
  6f44746
- Minor improvements and adding comments
  martin-g
  committed
  16d6669
- Add SqlLogicTests for the offset pushdown functionality
  martin-g
  committed
  4b67a6e
- fmt && prettier
  martin-g
  committed
  ef43a12
Commits on Sep 21, 2026
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  committed
  620af5e
- Rename `offset` to `skip` for consistency
  martin-g
  committed
  5786305
- Add `Evaluation Order` documentation to TableProvider::scan_with_args()
  martin-g
  committed
  4de77e9
- Update the generated Protobuf files
  martin-g
  committed
  8c05e34
- fmt
  martin-g
  committed
  ac2a928
Commits on Sep 22, 2026
- Rename back `skip \d+` to `OFFSET $1` in .slt
  martin-g
  committed
  938861f
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  authored
  97c7268
- clippy
  martin-g
  committed
  e2fa85b
Commits on Sep 24, 2026
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  authored
  757ef3f
Commits on Sep 25, 2026
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  authored
  51b8974
Commits on Sep 28, 2026
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  authored
  9f1dd85
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  committed
  d157b8a
- Introduce LogicalPlanBuilder::table_scan(TableScan) to avoid adding more ::scan_with_xyz(...) methods
  martin-g
  committed
  5a84bd3
- fmt
  martin-g
  committed
  4ae9cba
- Add fuzz tests for skip_pushdown
  martin-g
  committed
  21432be
Commits on Sep 29, 2026
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  authored
  f7a6a63
Commits on Sep 30, 2026
- datafusion-physical-plan: handles nulls correctly in aggregate dynamic filters (#25579)
  
  authored and
  martin-g
  committed
  6e1dafd
- chore(deps): bump thiserror from 2.0.20 to 2.0.21 in the all-other-cargo-deps group (#25869)
  
  dependabot[bot]
  authored and
  martin-g
  committed
  d3fbae7
- chore(deps): bump astral-sh/setup-uv from 10.1.0 to 10.2.0 (#25868)
  
  dependabot[bot]
  authored and
  martin-g
  committed
  6d4009e
- chore(deps): bump taiki-e/install-action from 2.87.16 to 2.87.21 (#25867)
  
  dependabot[bot]
  authored and
  martin-g
  committed
  ac7815f
- chore(deps): bump the codeql-actions group across 1 directory with 2 updates (#25866)
  
  dependabot[bot]
  authored and
  martin-g
  committed
  cfc602f
- fix: preserve uncertainty in singleton filter statistics (#25863)
  
  kumarUjjawal
  authored and
  martin-g
  committed
  b39f3af
- docs: Add narwhals-datafusion to integrations list (#25387)
  
  authored and
  martin-g
  committed
  56734c5
- fix: unparser drops ORDER BY of ordered aggregates (#25803)
  
  authored and
  martin-g
  committed
  c7e04c6
- chore(deps): bump webpack-dev-middleware from 8.0.4 to 8.3.0 in /datafusion/wasmtest/datafusion-wasm-app (#25879)
  
  dependabot[bot]
  authored and
  martin-g
  committed
  fc83cfc
- benchmarks: draw simulated object store latency at random, not round-robin (#25809)
  
  authored and
  martin-g
  committed
  93c8fa7
- perf: use one null-aware mark join for hashable IN subqueries in projections (#25338)
  
  authored and
  martin-g
  committed
  8aac62a
- bench: add AND conjunction benchmarks to binary_op (#25870)
  
  Abhisheklearn12
  authored and
  martin-g
  committed
  ca51523
- feat: log drift between MemoryPool reservations and allocated bytes in SLT (#25651)
  
  andygrove
  authored and
  martin-g
  committed
  8de965a
- perf(parquet): skip Bloom reads for fully matched row groups (#25854)
  
  xudong963
  authored and
  martin-g
  committed
  6d4acad
- fix: apply pushed-down fetch to filter statistics (#25862)
  
  kumarUjjawal
  authored and
  martin-g
  committed
  be37c75
- Support SQL unparsing for skip/offset
  martin-g
  committed
  9836d23
- Delete the Fuzz test for skip pushdown
  martin-g
  committed
  9032867
- Add more edge case tests to skip_pushdown.slt
  
  martin-g
  and
  adriangb
  authored
  6d56397
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  authored
  018ed46
Commits on Oct 1, 2026
- Merge branch 'main' into TableProvider-recommend-scan_with_args
  martin-g
  authored
  f7f3c2f
- Rename one more occurrence of Offset with Skip
  martin-g
  committed
  d08eacb

Commits

Commits on Sep 17, 2026

Commits on Sep 18, 2026

Commits on Sep 21, 2026

Commits on Sep 22, 2026

Commits on Sep 24, 2026

Commits on Sep 25, 2026

Commits on Sep 28, 2026

Commits on Sep 29, 2026

Commits on Sep 30, 2026

Commits on Oct 1, 2026