data: clarify operative-vs-baseline SLA values in the Growth/Enterprise MSA schedules - #30
Open
shyan-ai wants to merge 1 commit into
Open
data: clarify operative-vs-baseline SLA values in the Growth/Enterprise MSA schedules#30shyan-ai wants to merge 1 commit into
shyan-ai wants to merge 1 commit into
Conversation
…se MSA schedules Adds an 'Operative terms convention' note to internal_docs/msa_growth_tier.md and msa_enterprise_tier.md (inside artifacts/data.zip): bold tier values are the operative commitments; (std: ...) values are Maple's standard baselines, for comparison only; where they differ the bold tier value governs. Cross-referenced from the response/resolution (3.2) and billing-dispute (4.1) schedules, where the ambiguity most affects retrieval. Enterprise-Bench v1.1 source-document clarity fix. Operative thresholds, tasks, scoring, and the support-l2-a answer set are UNCHANGED: 27 breaches (16 Enterprise / 11 Growth), independently recomputed. Only the 2 MSA docs change; the other 77 dataset files are byte-identical; canary preserved.
shyan-ai
requested review from
jonmaaku-rev,
mira-mohammad,
nimit2801,
roycabezas and
sumisunz
as code owners
August 10, 2026 02:59
Contributor
|
First-touch impression: dataset/source-document clarity change. This updates only Checks: no GitHub status checks are reported on this branch yet, so maintainers should run the repo validation locally before merge. Risk: low semantic intent, but zip-only dataset edits can hide canary drift, answer leakage, or reproducibility changes if not independently inspected. Maintainer verification points:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Clarifies the meaning of the bold tier-specific values and parenthetical
(std: …)values in theGrowth and Enterprise MSA schedules.
The documents currently show values such as:
(std: 1 hr).(std: 1 hr).Because
std:is not defined, a reader or agent can reasonably interpret the one-hour standard valueas the operative commitment. This PR makes the intended convention explicit:
Changes
The MSA source documents are packaged in
artifacts/data.zip(internal_docs/), so the edits are madeinside the archive:
internal_docs/msa_growth_tier.mdandinternal_docs/msa_enterprise_tier.md, immediately before §3.2 "Response & Resolution Targets".schedules, where the ambiguity affects benchmark retrieval most directly.
the
CANARY.mdsidecar is preserved.Intentionally unchanged
support-l2-aanswer set: 27 qualifying breaches, including the current16 Enterprise / 11 Growth split.
Validation
the convention text is present in each, with §3.2 and §4.1 cross-references.
support-l2-awith the existing tier thresholds (Enterprise 0.5 h, Growth 2.0 h,reference date 2026-04-13): 27 breaches, 16 Enterprise / 11 Growth — unchanged.
Context
Addresses a source-document clarity issue identified during independent benchmark validation. Some
agent/harness traces distinguished the tier-specific values correctly, while others treated the generic
Standard one-hour value as a contractual account tier and mapped Growth accounts to it. The
clarification removes that interpretation variance without changing benchmark semantics.
Exact text added (immediately before §3.2 in each of the two MSA docs):
Operative terms convention
Values shown in bold are the tier-specific commitments negotiated for and operative under this
agreement. Values marked
(std: …)are Maple's standard published baseline values, included forcomparison only. Where the two differ, the bold tier-specific value governs this agreement.