Add segmented index workflow for INVERTED and FTS

[everySympathy]

Summary

This PR updates daft-lance to use Lance's public scalar segment-index workflow for distributed scalar index creation.

It bumps the Lance dependency to the Lance 8.0.0 release line and removes the prerelease Lance Fury index configuration that was only needed for beta wheels.

The existing distributed scalar index path for BTREE, INVERTED, and FTS is migrated away from the legacy metadata merge flow. Workers now build uncommitted fragment-local index segments with create_index_uncommitted(..., fragment_ids=...), and the coordinator commits those segments with commit_existing_index_segments(...).

For INVERTED / FTS, worker-built segments are merged with merge_existing_index_segments(...) before the final commit.

Because Lance's public commit_existing_index_segments(...) API does not currently expose atomic replacement of an existing committed index, the segmented workflow now rejects attempts to reuse an existing index name before workers build new segments. Worker-side segment creation always uses replace=False, so an existing committed index is not modified during distributed segment construction.

Why

The old partitioned metadata merge path is not compatible with Lance 8 for BTREE, and can produce indices whose deprecated list_indices() type appears as Unknown.

Using the public segment-index workflow gives committed indices with usable describe_indices() details and matches the newer Lance scalar indexing API.

Changes

• Bump pylance to >=8.0.0
• Remove the Lance Fury package index configuration for prerelease Lance wheels
• Use public create_index_uncommitted(...) for scalar segment creation
• Commit worker-built segments via commit_existing_index_segments(...)
• Merge INVERTED / FTS segments before commit
• Make BTREE and INVERTED use the segment-index workflow by default
• Reject existing index-name replacement in the segmented workflow before workers build new segments
• Update scalar index tests to validate committed index details with describe_indices() and full-text queries

Validation

• uv run pytest -q tests/io/lancedb/test_lancedb_scalar_index.py
• uv run ruff check daft_lance/lance_scalar_index.py daft_lance/_lance.py tests/io/lancedb/test_lancedb_scalar_index.py
• git diff --check
• uv lock --check