Skip to content

mateusnishimura/summpaper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

8 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸ“„ summpaper

πŸ“ Project Overview

This project explores an approach that combines RAG (Retrieval-Augmented Generation) and LLMs to generate structured summaries of research papers. The goal is to automatically extract the most relevant passages and organize the summary into the following sections:

  • Introduction
  • Context
  • Results
  • Conclusion
  • Relevance

βš™οΈ How It Works

1️⃣ Paper Vectorization β†’ The document is divided into chunks (smaller segments) with overlap to ensure context retention. 2️⃣ Information Retrieval β†’ The system retrieves the most relevant excerpts based on predefined topics. 3️⃣ Summary Generation β†’ LLaMA 3 processes the retrieved excerpts and generates a structured and concise summary.

▢️ Running the Script

The main script can be executed as follows:

python main.py --pdf_file data/sample.pdf --output_file output/summa.txt --database_dir chroma_db

πŸ›  Script Parameters

Parameter Description
-pdf, --pdf_file Path to the input PDF file (required).
-o, --output_file Path to save the extracted text (default: ./summa.txt).
-db, --database_dir Directory where ChromaDB will be stored (default: ./chroma_db).

πŸ”§ Future Improvements

  • πŸ“Œ Enhance section extraction, vectorizing chunks by section.
  • ⚑ Optimize LLM response time.
  • πŸ–Ό Extract images from papers to enrich summaries.

About

No description, website, or topics provided.

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages