Skip to content

Support local Qwen VLM reranking for search results#82

Merged
ssrajadh merged 1 commit into
ssrajadh:masterfrom
Binary67:qwen-rerank
Jul 7, 2026
Merged

Support local Qwen VLM reranking for search results#82
ssrajadh merged 1 commit into
ssrajadh:masterfrom
Binary67:qwen-rerank

Conversation

@Binary67

@Binary67 Binary67 commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add a local Qwen3-VL Instruct reranker for sentrysearch search --rerank when searching local Qwen indexes.
  • Share rerank prompt construction, response schema, JSON parsing, and fenced JSON handling across Gemini and local VLM rerankers.
  • Route reranking by backend: local searches use the Qwen reranker, while Gemini and qwen-cloud searches continue using Gemini Flash.
  • Preserve embedding-ranked results when reranking cannot load or score candidates.
  • Update CLI behavior, README docs, and unit tests for local reranking.

Testing

  • uv run --group test pytest tests/test_reranker.py tests/test_qwen_reranker.py tests/test_gemini_reranker.py tests/test_cli.py -q
  • git show --check --no-color HEAD

Related Issue

Related to #71

@ssrajadh
ssrajadh merged commit e6d9a9a into ssrajadh:master Jul 7, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants