You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Return a zero-copy slice from the filter kernel when the predicate selects one contiguous run #11255
#10859 adds a small special case in narrow_batch in the parquet reader: when the boolean filter selects exactly one contiguous run of rows, the batch is narrowed with a zero-copy RecordBatch::slice instead of filter_record_batch.
fnnarrow_batch(batch:&RecordBatch,filter:&BooleanArray,true_count:usize) -> Result<RecordBatch,ArrowError>{letmut slices = SlicesIterator::new(filter);let(start, end) = slices.next().expect("a partially selected filter has a true slice");if end - start == true_count {Ok(batch.slice(start, end - start))}else{filter_record_batch(batch, filter)}}
This optimization only helps that one call site, but could also be applied to the filter kernel in arrow_select.
Activity
Abhisheklearn12 commentedon Sep 28, 2026
take