Skip to content

Commit 5ed7f87

Browse files
committed
docs(skills): the dashboards evals no longer escalate to a Cube
Eval 2's expected output escalates a rolling window to a stored or materialized rolling field or app code, not a Cube: a cube member's sql is a column reference. Its must_contain drops "Cube", which a correct answer no longer needs to name. The evals README names the same escalation: a stored field or app code. Both files shrink. Claude-Session: https://claude.ai/code/session_01Sfe5YjBLwB9J3y8fvm2xq1 Co-authored-by: Claude <noreply@anthropic.com>
1 parent 68593d4 commit 5ed7f87

2 files changed

Lines changed: 3 additions & 3 deletions

File tree

‎skills/objectstack-ui/evals/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ view / page / dashboard / report metadata.
77

88
- `analytics-inline-vs-dataset.json` — dataset-envelope decisions for
99
dashboard/report widgets: when a data need fits a `defineDataset`, when it
10-
must escalate to a Cube or a stored rollup field, and when an ad-hoc
10+
must escalate to a stored field or app code, and when an ad-hoc
1111
in-page `<ObjectChart>` needs no dataset at all.
1212
- `views-apps-actions-pages.json` — `defineView` containers, `App.create`
1313
navigation, `defineAction` surfaces, record / interface pages, package

‎skills/objectstack-ui/evals/analytics-inline-vs-dataset.json‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,11 +15,11 @@
1515
{
1616
"id": 2,
1717
"prompt": "Add a dashboard chart showing 30-day rolling revenue (a moving average / running total over time). Model the data need.",
18-
"expected_output": "Recognizes that a window/rolling calculation is BEYOND the dataset envelope (a dataset has no window/having grammar and compareTo only does previous-period/year). Escalates to a hand-authored Cube (raw SQL) or a stored/materialized rolling field — it does not pretend a dataset date-bucket or a plain measure expresses a moving window.",
18+
"expected_output": "Recognizes that a window/rolling calculation is BEYOND the dataset envelope (a dataset has no window/having grammar and compareTo only does previous-period/year). Escalates to a stored/materialized rolling field or app code, not a Cube — it does not pretend a dataset date-bucket or a plain measure expresses a moving window.",
1919
"note": "The must_not_contain on 'dateGranularity' is deliberately strict: proposing date bucketing as the fix is the classic wrong answer. It can flag an otherwise-correct answer that merely mentions the field in passing — treat such a flag as a review cue, not an automatic fail.",
2020
"files": [],
2121
"assertions": {
22-
"must_contain": ["window", "Cube"],
22+
"must_contain": ["window"],
2323
"must_not_contain": ["dateGranularity"]
2424
}
2525
},

0 commit comments

Comments
 (0)