NELA: Added web scraping support#64

Merged

Amoghk04 merged 22 commits into

devfrom

May 31, 2026

Commits on May 18, 2026

NELA: Added Benchmarking
Amoghk04
committed

Commits on May 19, 2026

NELA: Benching changes
Amoghk04
committed
fix: surface chat_complete errors and unexpected response JSON
Amoghk04
committed
fix: ChatServer parallel=1 for bench (ctx_size/parallel was giving 512 tokens per slot)
Amoghk04
committed
fix: swap raptor_trust_all/-inf and raptor_expand_all/+inf thresholds (were inverted)
Amoghk04
committed
fix(beir): bump embed ubatch-size 512→2048; add per-doc progress to BEIR ingest
Amoghk04
committed
fix(beir): skip oversized docs on embed failure; stable BEIR workspace across runs
Amoghk04
committed
fix(bench): surface llama-server crash reason on embed server startup failure
Amoghk04
committed
fix(bench): drop --log-disable; add GPU diagnostic after embed server startup
Amoghk04
committed
fix(bench): warn explicitly when CUDA detected but no layers offloaded to GPU
Amoghk04
committed
fix(bench): accept 'fitting params to device' as GPU-active signal
Amoghk04
committed
perf(bench): parallel BEIR ingest — embed 8 docs concurrently
Amoghk04
committed
perf(bench): defer BM25 commit to end of ingest — fix O(N²) slowdown
Amoghk04
committed
perf(bench): BM25 periodic checkpoint every 500 docs — crash safety + O(N²) fix
Amoghk04
committed
perf: parallel embed in ingest_corpus_with_config and cmd_scale
Amoghk04
committed
perf: pre-embed queries once in run_recall_bench and ablate-rrf-k
Amoghk04
committed
perf: defer BM25 commits to end of ingest in corpus_with_config and scale
Amoghk04
committed
feat: add --max-docs to ablate-chunking and ablate-quant for corpus subsetting
Amoghk04
committed
feat: make ablation workspaces persistent and resumable
Amoghk04
committed
feat: add --max-qa to ablation commands to cap QA pairs per grid point
Amoghk04
committed

Commits on May 20, 2026

NELA: Final benchmark figures for Claude code
Amoghk04
committed

Commits on May 31, 2026

NELA: Added web scraping
Amoghk04
committed