-
Notifications
You must be signed in to change notification settings - Fork 0
LLM py
peter-olai edited this page May 7, 2025
·
3 revisions
This page details the src/LLM.py module. For a higher-level overview of LLM integration, see LLM Integration.
The src/LLM.py file is responsible for all interactions with Large Language Models (LLMs).
- Connecting to LLM APIs (e.g., OpenAI, Hugging Face).
- Formatting prompts.
- Sending requests to LLMs.
- Receiving and parsing responses.
- Handling errors and retries.
- Configuration for LLMs is managed via
config.py.
(Describe the supported LLMs, how to configure them, and key methods for interaction.)
Authors:
Peter Olai Johnsen
Tobias Fremming
Erik Le Blanc Pleym
About Chat-Service
Core Components
Development
Codebase Details
- Codebase Architecture
- Routes
- Command-py
- Config-py
- Context Upload-py
- LLM-py
- Main-py
- Pipeline-py
- Streaming WS-py
- Transcribe-py
Deployment and Operations