You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Estimate distinct counts after a filter with the survival formula in FilterExec #26052
Is your feature request related to a problem or challenge?
FilterExec::statistics_from_inputs caps each column's distinct count at the filtered row count. When values repeat, this overestimates. For example, 1000 rows with 100 distinct values (10 rows per value) filtered to 200 rows gives min(100, 200) = 100, while the expected number of surviving values is about 89.
The deprecated FilterStatisticsProvider (#25969) implements a better estimate, but only as an opt-in provider.
Describe the solution you'd like
Apply the survival formula in FilterExec itself, for columns the predicate does not constrain:
Activity
asolimando commentedon Oct 5, 2026
take
refactor: deprecate the bundled statistics providers (apache#25969)
refactor: deprecate the bundled statistics providers (apache#25969)