fix(chat): booking card on file requests, complaints, pending certifications and role acknowledgment - #475
Merged
Conversation
…ly the search rewrite
With history, the meeting check read the search rewrite, which can come back as
keywords ('datasheet and demo booking next week') that name no request. The
production smoke test after PR #474 sent 'send me your datasheet and also book a
demo for next week' on Eventus and CleanStart and got the file cards without the
booking card. The raw message now counts as well as the rewrite.
…a support alert 'this is useless, you never answer anything' matched the unanswered-customer vocabulary, the classifier said yes, and both bots alerted the team with the support reply (production smoke test, 2026-09-17). The router now reads 'you never answer anything' as frustration, alone or after a verdict, and the support route stands down for any message the router answers as frustration or abuse.
CleanStart's vendor-risk page says 'ISO 27001 certification in progress;
expected completion Q2 2026'. The credential check accepted a quote cut from
that sentence ('ISO 27001 certification') as proof, and the bot told a visitor
'We hold ISO 27001 certification' (post-deploy evaluation, 2026-09-17). A HELD
quote now verifies only from a sentence with no pending wording (in progress,
expected, planned, once the audit completes), the fallback rules skip such
sentences, and the classifier prompt names the case.
…able example The role acknowledgment rule carried the example 'Good to know you're the one signing off', and the model pasted it onto an MSP, a head of IT and a visitor filling in a form, none of whom said they approve the purchase (7 replies in the post-deploy evaluation, 2026-09-17). The rule now asks for the visitor's own words and forbids reading a decision role into a company type, task or form.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes from the production smoke test and the 163-case evaluation run after PR #474 (reviewed pass rate on the 120 comparable cases: CleanStart 77% to 82%, Eventus 80% to 83%).
What changes for visitors
Deploy notes
QA_PROMPT_VERSIONis unchanged: the canonical prompt fingerprint does not include the qualification section.Checks
test_superadmin_impersonate_mint::test_redirect_url_uses_the_shared_app_url_setting, a known local ordering failure).Not in this PR