Skip to content

Vector search and RAG feature#2233

Open
KinyaElGrande wants to merge 17 commits into
2024.9.xfrom
2024.9.x-feat-vector-search
Open

Vector search and RAG feature#2233
KinyaElGrande wants to merge 17 commits into
2024.9.xfrom
2024.9.x-feat-vector-search

Conversation

@KinyaElGrande
Copy link
Copy Markdown
Contributor

@KinyaElGrande KinyaElGrande commented Oct 28, 2025

This PR introduces vector search and RAG (Retrieval-Augmented Generation) capabilities to Corteza discovery.

Feature overview

  • Vector data indexing, storage, and querying is handled by OpenSearch
  • Enables semantic search across Corteza records on discovery
  • Provides AI-powered assistant for querying and understanding data

For these features to work, the following environment variables must be configured.

Embeddings generation

EMBEDDINGS_API_URL and EMBEDDINGS_API_KEY configs for the embeddings API server which is required for converting text into vector embeddings for semantic search

RAG

LLM_BASE_URL, LLM_MODEL(the default model is mistral-medium-latest) and LLM_API_KEYfor the LLM access which is required for the AI assistant to generate natural language responses

Copy link
Copy Markdown
Member

@tjerman tjerman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, looks good

Comment thread extra/server-discovery/indexer/service.go Outdated
Comment thread extra/server-discovery/pkg/es/mapping/mapping.go Outdated
Comment thread extra/server-discovery/pkg/es/reindex/reindex.go
Comment thread extra/server-discovery/pkg/es/reindex/reindex.go Outdated
Comment thread extra/server-discovery/pkg/es/reindex/reindex.go Outdated
Comment thread extra/server-discovery/pkg/es/reindex/reindex.go Outdated
Comment thread extra/server-discovery/pkg/es/reindex/reindex.go Outdated
Comment thread extra/server-discovery/pkg/es/reindex/reindex.go Outdated
Comment thread extra/server-discovery/pkg/es/reindex/reindex.go Outdated
Comment thread extra/server-discovery/pkg/es/reindex/reindex.go Outdated
@Fajfa Fajfa linked an issue Nov 18, 2025 that may be closed by this pull request
@KinyaElGrande KinyaElGrande force-pushed the 2024.9.x-feat-vector-search branch from 5b84272 to c9e6986 Compare November 19, 2025 07:34
Copy link
Copy Markdown
Member

@tjerman tjerman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm 👍

@@ -73,12 +75,19 @@ func (app *CortezaDiscoveryApp) InitServices(ctx context.Context) (err error) {
return fmt.Errorf("could not set token verifier")
}

//initialize Elastic search client
esClient, err := es.Connect(app.Opt.ES)
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to make this optional or is this ES parameter now required?

Comment thread extra/server-discovery/pkg/es/reindex/reindex.go Outdated
@sonarqubecloud
Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed

Failed conditions
D Security Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

@KinyaElGrande KinyaElGrande force-pushed the 2024.9.x-feat-vector-search branch from a72cc53 to f1e4062 Compare January 8, 2026 15:04
@KinyaElGrande KinyaElGrande force-pushed the 2024.9.x-feat-vector-search branch from e4b2d07 to d870756 Compare January 16, 2026 13:46
@sonarqubecloud
Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed

Failed conditions
D Security Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 1, 2026

Stale pull request message

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Vector Search Integration Research

2 participants