Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first approach
-
Updated
Jan 15, 2024 - Python
#
preference-data
Here are 5 public repositories matching this topic...
Generate conversational, tool-calling, structured-output, and preference datasets — easily and at scale
conversational persona structured-output afterimage multi-turn dpo synthetic-dataset preference-data tool-calling
-
Updated
May 13, 2026 - Python
MCP server for human-in-the-loop surveys, A/B preference tests, ratings, and rankings. Get real human feedback inside Claude Code, Claude Desktop, Cursor, Windsurf, and any MCP client — powered by Datapoint AI.
annotation mcp cursor surveys datapoint human-in-the-loop ai-agents claude windsurf data-labeling ai-evaluation human-feedback rlhf anthropic llm-evaluation preference-data claude-desktop model-context-protocol mcp-server claude-code
-
Updated
May 19, 2026 - Python
Curated tools, papers, datasets, and practices for LLM training data engineering.
annotation data-quality synthetic-data training-data data-governance llm rlhf financial-ai rag-evaluation preference-data
-
Updated
May 22, 2026 - Python
This repository contains all artifacts produced during my bachelor's thesis on data modeling for collective decision-making.
-
Updated
Apr 15, 2026 - Jupyter Notebook
Improve this page
Add a description, image, and links to the preference-data topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the preference-data topic, visit your repo's landing page and select "manage topics."