fix(mem_wal): reconcile a schema change through one plan - #9143

Open

xuanyu-z wants to merge 49 commits into

lance-format:mainfrom

xuanyu-z:memwal-replay-schema-drift

Commits on Sep 16, 2026

fix(mem_wal): replay a WAL entry whose schema has since moved
xuanyu-z
committed
5a4f387
fix(mem_wal): carry field ids into the memtable schema, so a rename keeps its rows
xuanyu-z
committed
3d89650
fix(mem_wal): cast a replayed column whose type changed
xuanyu-z
committed
effa6dc
test(mem_wal): cover a struct column matched by its own field id
xuanyu-z
committed
26c5004
docs(mem_wal): say what a schema without field ids costs a caller
xuanyu-z
committed
176827b
fix(mem_wal): open a shard whose maintained index is gone
xuanyu-z
committed
6f2256f
fix(mem_wal): reconcile union arms across a schema change
xuanyu-z
committed
568c525
fix(mem_wal): refuse a computed add_columns while a MemWAL is attached
xuanyu-z
committed
9d3d03d
Revert "fix(mem_wal): refuse a computed add_columns while a MemWAL is attached"
xuanyu-z
committed
3cdcd20
docs(mem_wal): say what the code is, in this repo's vocabulary
xuanyu-z
committed
35732ae
fix(mem_wal): keep a renamed column's values across the union
xuanyu-z
committed
eecf433
fix(mem_wal): keep a renamed nested field's values across the union
xuanyu-z
committed
bb6242d
fix(mem_wal): never relabel a generation-only column onto a base name
xuanyu-z
committed
51b5089
fix(mem_wal): never rename a generation-only column onto a base name
xuanyu-z
committed
287d3ca
test(mem_wal): cover the relabel's collision rules directly
xuanyu-z
committed
51c6a5e
fix(mem_wal): resolve a generation's columns by identity before reading them
xuanyu-z
committed
afa7e0d
fix(mem_wal): let one stored column answer to one schema column
xuanyu-z
committed
85f6c17
fix(mem_wal): resolve a schema change through one plan, and refuse a retype
xuanyu-z
committed
64fabb1
fix(mem_wal): ask a generation for its own column names on the search paths
xuanyu-z
committed
37f41dd
docs(mem_wal): describe the union's reconciliation as it now stands
xuanyu-z
committed
384e0e5
refactor(mem_wal): drop what the shared plan made unnecessary
xuanyu-z
committed
2842ce1
test(mem_wal): drop the fixtures the removed mapping tests used
xuanyu-z
committed
58a9d7a
fix(mem_wal): make identity reach every nested field, and the batch match it
xuanyu-z
committed
8c22476
fix(mem_wal): read every sealed generation through one resolution
xuanyu-z
committed
5438c15
fix(mem_wal): resolve the full-text index's column per generation too
xuanyu-z
committed
83d7689
refactor(mem_wal): push a predicate down under the names a generation has
xuanyu-z
committed
64b1b45
fix(mem_wal): make the reconciliation's contracts hold off the happy path
xuanyu-z
committed
554b2b4
test(mem_wal): cover the nested shapes the relabel has to preserve
xuanyu-z
committed
b75b727
docs(mem_wal): state the invariant the memtable arm rests on
xuanyu-z
committed
3d9fa2b
fix(mem_wal): do not truncate a search before a deferred predicate runs
xuanyu-z
committed
fc35ace
fix(mem_wal): refuse tightening a column to non-null on a WAL-backed table
xuanyu-z
committed
ccd229a
fix(mem_wal): refuse renaming a nested field onto a sibling's name
xuanyu-z
committed
dfa75eb
refactor(mem_wal): one test module for the relabel, and narrow what it exports
xuanyu-z
committed
60fbdb3
docs(mem_wal): describe the memtable and tightening contracts in Lance's terms
xuanyu-z
committed
9bc5453
style(mem_wal): satisfy the workspace's denied lints
xuanyu-z
committed
c3e59b2
fix(mem_wal): keep the generation arms' futures inside the recursion limit
xuanyu-z
committed
c02751c
fix(mem_wal): keep ReconcileExec out of the public surface
xuanyu-z
committed
8c29607
docs(mem_wal): say why the search arms box their plan build
xuanyu-z
committed
c96d883
fix(mem_wal): box the scan planner's per-source arm
xuanyu-z
committed
9534bf4
fix(mem_wal): type-erase each source arm's future
xuanyu-z
committed
6949a19
fix(mem_wal): type-erase the search arms, and drop an out-of-scope doc link
xuanyu-z
committed
9922e48
fix(mem_wal): carry the recursive contract through maps and quoted paths
xuanyu-z
committed
0237dd4
docs(mem_wal): describe the skipped index in Lance's own terms
xuanyu-z
committed
8f89f5a
refactor(mem_wal): name the two schemas for whose they are
xuanyu-z
committed
c0b1498
feat(mem_wal): offer the generation resolution to a caller that compacts
xuanyu-z
committed
d6fb921
fix(mem_wal): keep a generation's own ids out of the resolution
xuanyu-z
committed
29423eb
test(mem_wal): fold the struct push-down cases into one table
xuanyu-z
committed
0f4e079
Merge origin/main into the MemWAL schema-drift branch
xuanyu-z
committed
c0acabb

Commits on Sep 17, 2026

docs(mem_wal): state the field-id invariant the resolution rests on
xuanyu-z
committed
4be7051