Skip to content

fix(llm): 从MiniMax的响应内容中移除<think>标签 #55

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
kksty wants to merge 1 commit into
base: main
Choose a base branch
from
Open

fix(llm): 从MiniMax的响应内容中移除<think>标签 #55

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions app/llm/client.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,16 @@

logger = logging.getLogger("autohunter.llm")

# MiniMax-M3 是 thinking 模型，chat template 把思考过程嵌在 content 字段而非放独立 reasoning 字段，污染 reviewer/worker 对结构化 JSON 的解析。剥掉 <think> 块后保留实际回答，模型内部推理不受影响（API 已生成完才剥）。
_THINK_TAG_RE = re.compile(r"<think>.*?\s*", re.DOTALL)


def _strip_thinking_tags(text: str) -> str:
if not text:
return text
return _THINK_TAG_RE.sub("", text).strip()


_SECRET_RE = re.compile(
r"(?:\bsk-[A-Za-z0-9_-]{8,}\b"
r"|\b(?:Bearer|Basic)\s+[A-Za-z0-9._~+/=-]{8,}"
Expand Down Expand Up @@ -575,6 +585,8 @@ def _dict_to_message(msg: dict[str, Any]) -> SimpleNamespace:
elif isinstance(p, str):
parts.append(p)
content = "".join(parts)
if isinstance(content, str):
content = _strip_thinking_tags(content)
tool_calls = msg.get("tool_calls")
ns_calls = None
if isinstance(tool_calls, list) and tool_calls:
Expand Down Expand Up @@ -657,6 +669,8 @@ def _coerce_chat_message(resp: Any) -> Any:
first = choices[0]
msg = getattr(first, "message", None)
if msg is not None:
if hasattr(msg, "content") and isinstance(msg.content, str):
msg.content = _strip_thinking_tags(msg.content)
return msg
if isinstance(first, str):
return SimpleNamespace(content=first, tool_calls=None, role="assistant")
Expand Down