offline-rag

Run llama-server

~/src/ggerganov/llama.cpp/build/bin/llama-server -m models/mistral/7b-instruct.Q4_K_M.gguf --ctx-size 8192 --embedding --port 8081

Run rag-server

uvicorn rag.main:app --reload --port 8080

Run UI

cargo tauri dev --manifest-path desktop/src-tauri/Cargo.toml

Updating chat-ui

git subtree pull --prefix ui/chat-ui chat-ui main --squash