Overhaul database architecture and management - #17

Draft

sheikhPHD wants to merge 47 commits into

mainfrom

feature/move-to-pure-sql

Commits on May 4, 2026

feat: Update README
sheikhPHD
committed
85eb853

Commits on May 5, 2026

feat: database creation script in SQL
sheikhPHD
committed
9e4067f
Move SQL instructions to database_schema.sql, make create_database.py a pure Python runner
sheikhPHD
committed
c6df0d4

Commits on May 6, 2026

chore: Make schema and database creation DuckDB-compatible
sheikhPHD
committed
6acf313
chore: remove SQL parsing, use native DB inspection
sheikhPHD
committed
9a98e1d

Commits on May 13, 2026

feat:Add SQLite ingestion pipeline for MDverse database
sheikhPHD
committed
584ce70

Commits on May 18, 2026

Commits on May 20, 2026

feat: add DuckDB deletion script for datasets and data sources
sheikhPHD
committed
a085fa8

Commits on May 21, 2026

feat: add DuckDB deletion script for datasets and data sources
sheikhPHD
committed
df10bf9

Commits on May 22, 2026

chore: add duckdb>=1.5.3 dependency (fixes deletion bug in delete script)
sheikhPHD
committed
002d918

Commits on May 26, 2026

Commits on May 30, 2026

Commits on Jul 29, 2026

Commits on Jul 30, 2026

Commits on Aug 1, 2026

refactor(test): Update tests to use DuckDB for in-memory database connections
Essmaw
committed
5f1c880

Commits on Aug 2, 2026

Merge branch 'main' into feature/move-to-pure-sql
Essmaw
authored
4409b33