-
Notifications
You must be signed in to change notification settings - Fork 0
[trade-off] 泄密检测使用子串匹配,存在假阳性/假阴性 #27
Copy link
Copy link
Closed
Labels
trade-offIntentional design trade-off, deferred optimizationIntentional design trade-off, deferred optimizationworldbuildingWorldbuilding novel agent featureWorldbuilding novel agent feature
Description
Activity
Metadata
Metadata
Assignees
Labels
trade-offIntentional design trade-off, deferred optimizationIntentional design trade-off, deferred optimizationworldbuildingWorldbuilding novel agent featureWorldbuilding novel agent feature
现状
SecretStore::check_leak_risk()用draft_text.find(secret.truth)做检测,且truth.size() < 3时跳过。假阳性示例:
truth="他是好人"→ 草稿中"大家都说他是好人"(角色引用谣言)也会触发。假阴性示例:
truth="艾琳是骑士团教官"→ 草稿中"艾琳训练过王都骑士"(换说法)检测不到。当前取舍
size() >= 3阈值防止单字词海量误报SceneWrapUp.leak_risks),而非自动拦截升级触发条件
接入本地小模型做语义相似度判断,或使用 embedding 向量比较 truth 和 draft text 的语义距离。