Skip to content
This repository was archived by the owner on May 2, 2025. It is now read-only.
This repository was archived by the owner on May 2, 2025. It is now read-only.

Method to speed up fulltext search indexes #43

Description

@michwill

Since all text ranking is approximate anyway, we can save something like int(log(rank)/log(k)) per word (where k is constant). And we can have, say, 20-50 of these "rank buckets". So, word rank would be OOBTree(logranks -> IITreeSet(docids)). This is needed to make indexing new documents faster. It is especially relevant when working with backups: much fewer amount of info should be read from the disk when indexing a bulk of new documents in this case

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions