chore(parity): re-read hermiq's six competitor columns from source code and docs, add 53 demand rows - #958
Merged
Conversation
…s changelog and feature requests
…ine rows mined from its changelog and issues
… and nine rows mined from its discussions and releases; record the Nextcloud-phrased row rule
…n rows mined from its releases and forum
…reading, its sources object and ten rows mined from its issues and 4.0.0
…rces object and ten rows mined from What's new
…n limit (hermiq on 53 demand rows, hermes-agent 45, dify 10)
…gs on dify's responses-api and native-pdf cells
Contributor
Author
|
Rating change log, part 1 of 8 nextcloud-assistant: every rating change (before → after, evidence)
hermes-agent: every rating change (before → after, evidence)
|
Contributor
Author
|
Rating change log, part 2 of 8 hermes-agent (continued)
|
Contributor
Author
|
Rating change log, part 3 of 8 hermes-agent (continued)
copilot-studio: every rating change (before → after, evidence)
|
Contributor
Author
|
Rating change log, part 4 of 8 copilot-studio (continued)
dify: every rating change (before → after, evidence)
|
Contributor
Author
|
Rating change log, part 5 of 8 dify (continued)
n8n: every rating change (before → after, evidence)
|
Contributor
Author
|
Rating change log, part 6 of 8 n8n (continued)
open-webui: every rating change (before → after, evidence)
|
Contributor
Author
|
Rating change log, part 7 of 8 open-webui (continued)
|
Contributor
Author
|
Rating change log, part 8 of 8 open-webui (continued)
|
Contributor
Quality Report — ConductionNL/hermiq @
|
| Check | PHP | Vue | Security | License | Tests |
|---|---|---|---|---|---|
| lint | ✅ | ||||
| phpcs | ✅ | ||||
| phpmd | ✅ | ||||
| psalm | ✅ | ||||
| phpstan | ✅ | ||||
| phpmetrics | ✅ | ||||
| eslint | ✅ | ||||
| stylelint | ✅ | ||||
| build | ✅ | ||||
| check-specs | ✅ | ||||
| check-manifest | ✅ | ||||
| test-l10n | ✅ | ||||
| format | ✅ | ||||
| check-l10n-js | ✅ | ||||
| check-schema-l10n | ✅ | ||||
| check-bundle-budget | ✅ | ||||
| composer | ✅ | ✅ 123/123 | |||
| npm | ✅ | ✅ 843/843 | |||
| app:check-code | ⏭️ | ||||
| info.xml | ✅ | ||||
| REUSE | ❌ | ||||
| lockfile sync | ✅ | ||||
| PHPUnit | ⏭️ not run for this diff — no file in this diff matches the code globs, and none carries a source extension — the heavy tier has nothing to decide about it. | ||||
| Newman | ✅ | ||||
| Playwright | ⏭️ deferred: E2E runs locally and on the promotion path only. This pull request targets development, so the suite is asked once per promotion into beta and main rather than once per push per open pull request. Run it on any branch from the Actions tab, or locally with npx playwright test. |
||||
| Hydra gates | ✅ |
Quality workflow — 2026-09-26 21:16 UTC
Download the full PDF report from the workflow artifacts.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Wave 5: hermiq's competitor columns re-read from source code
Data file only:
openspec/parity/capabilities.json. No page is wired and no code changes, so the product's suites cannot be affected; they were not run. Read against development at 5277c0d (the base of this branch).What changed. Every competitor column is re-rated. The five open-source systems were read from their source at a release tag (shallow clones), with
path:lineevidence for each cell:Microsoft Copilot Studio is closed source and was read from its public documentation only, with no trial account.
Grades. No instance was booted, so every column is graded
docs-onlywithreadOn2026-09-26. A source-read cell says "source read at , not driven"; the grade enum has no value for a source read. Every system now carries asourcesobject in the hydra#706 shape: absent fields arenull, with the reason undernullReasons. Every row mined from demand signals carriesoriginandoriginUrl. Hermiq's own column is rated from its code on every new row, withbuilt.evidence,reachedOnandbuilt.state.Rulings applied across columns (also recorded in the file's
_commentand each system'sreadHow):Per-system grade and counts, before (development 5277c0d) and after
Rating deltas per column (rows that existed before)
The full change log (every changed cell, before, after, evidence) is posted as comments on this PR, because it exceeds the body limit. Rows new in this PR are not in the delta table; they are listed below.
Demand-signal rows added (63)
td-no-trainingtd-explaintd-validated-sourcestd-ai-literacytd-bias-testdm-task-boarddm-standing-goaldm-model-ensembledm-key-rotationdm-backup-restoredm-remote-agentdm-rate-capdm-temperaturedm-project-memorydm-cross-channeldm-build-snapshotdm-install-cli-tooldm-sandbox-choicedm-approval-apidm-named-approversdm-context-meterdm-foldersdm-run-comparedm-claimed-tool-calldm-deep-researchdm-second-factordm-user-key-encryptiondm-mcp-user-authdm-responses-apidm-prompt-cachedm-ask-mid-rundm-agent-form-fieldsdm-fork-chatdm-flow-change-reviewdm-log-redaction-policydm-agent-workspacedm-native-pdfdm-browser-usedm-tool-call-capdm-tool-error-recoverydm-subscription-logindm-failed-run-fixdm-builtin-tabledm-bulk-delete-chatsdm-prompt-placeholdersdm-ai-labeldm-skill-searchdm-app-toolsdm-mcp-oauthdm-show-reasoningdm-speech-translatedm-subtitlesdm-image-chatdm-computer-usedm-custom-metricsdm-question-themesdm-savings-trackingdm-call-consentdm-async-flow-stepdm-builder-upgradedm-metadata-filterdm-eval-in-pipelinedm-agent-as-codeThe five
td-*rows come from TenderNed requirements in the intelligence database;originNotenames the tender and requirement ids. Thedm-*rows were mined per system: Hermes 10 (4 changelog, 6 feature requests), Dify 9 (4 changelog, 5 feature requests), Open WebUI 9 (3 changelog, 6 feature requests), n8n 10 (7 changelog, 3 forum requests), Nextcloud 10 (4 changelog PRs, 6 enhancement issues), Copilot Studio 10 (What's new).Sources object per system
The full objects, URLs included, are in the file.
Verifier (hydra development, fetched fresh; hydra#707 made
origina free string)Before, on development 5277c0d, report profile:
Before,
--strict:After,
--strict(exits 1 on the unknown-cells census only):After, report profile:
Images pulled
None. No lab was booted in this lane, so there is nothing to remove afterwards and there is no market-intelligence lab PR. Every column stays
docs-only. Driving the rows the code reading could not settle is left to a lab wave.Where the method was harder
🤖 Generated with Claude Code