This project implements a hybrid Retrieval-Augmented Generation (RAG) system that uses BERT and GPT-2 to deliver more accurate and contextually relevant responses.
β
Intelligent Information Retrieval: Uses BERT + FAISS for fast and precise document search.
β
Optimized Response Generation: Combines retrieved information with the original query and leverages GPT-2 for response generation.
β
Efficient Vector Processing: Stores and searches documents in a vector index using FAISS.
Libraries used in this project:
torchtransformersfaiss-gpunumpyscipy
jupyter notebook hybrid-rag.ipynb1οΈβ£ Embedding:
- Scientific texts and documents are converted into embeddings.
2οΈβ£ Indexing: - Vectors are stored in a FAISS Index for searchability.
3οΈβ£ Retrieval: - When a query is received, the most relevant documents are searched and retrieved.
4οΈβ£ Augmentation: - The original query + retrieved texts are combined.
5οΈβ£ Generation: - The GPT-2 model uses the new input to generate a precise and relevant response.
- If you have suggestions for improving the project, please submit a Pull Request.
- To report issues, please open an Issue.