I suspect that Wordlist::UniqueFilter's performance decreases as the number of words it has seen increases. I also suspect we could modestly improve the performance by splitting up the String#hash integers into multiple bit-fields and store them in a multi-level b-tree.
I suspect that
Wordlist::UniqueFilter's performance decreases as the number of words it has seen increases. I also suspect we could modestly improve the performance by splitting up theString#hashintegers into multiple bit-fields and store them in a multi-level b-tree.