Skip to content

[M2] Multi-threaded indexing with Rayon #7

Description

@Fosurero

Description

Parallelize index building using Rayon for multi-core utilization.

Tasks

  • Add rayon dependency
  • Shard-parallel indexing (one thread per shard)
  • Thread-safe index merging
  • Benchmark: single-threaded vs multi-threaded index build
  • Configurable thread count

Acceptance Criteria

  • Index build is ≥2× faster on 4-core machine
  • Results are identical to single-threaded mode

Metadata

Metadata

Assignees

No one assigned

    Labels

    M2Milestone 2: Live NEAR Lake IntegrationenhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions