test: add comprehensive tests for issues 588, 587, 586, 585 - #2
Open
lolandriley-wq wants to merge 9 commits into
Open
test: add comprehensive tests for issues 588, 587, 586, 585#2lolandriley-wq wants to merge 9 commits into
lolandriley-wq wants to merge 9 commits into
Annotations
9 errors, 2 warnings, and 1 notice
|
Run accessibility tests (WCAG 2.1 AA gate)
Process completed with exit code 1.
|
|
Run accessibility tests (WCAG 2.1 AA gate):
e2e/a11y.spec.ts#L75
4) [chromium] › e2e/a11y.spec.ts:71:5 › @a11y New Invoice form fields are all keyboard-reachable and labelled
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toBeVisible() failed
Locator: getByLabel(/token address|token contract address/i)
Expected: visible
Timeout: 5000ms
Error: element(s) not found
Call log:
- Expect "toBeVisible" with timeout 5000ms
- waiting for getByLabel(/token address|token contract address/i)
73 | await page.waitForLoadState('networkidle').catch(() => undefined);
74 |
> 75 | await expect(page.getByLabel(/token address|token contract address/i)).toBeVisible();
| ^
76 |
77 | const results = await runAxe(page);
78 | const seriousOrCritical = results.violations.filter(
at /home/runner/work/split-app/split-app/e2e/a11y.spec.ts:75:74
|
|
Run accessibility tests (WCAG 2.1 AA gate):
e2e/a11y.spec.ts#L75
4) [chromium] › e2e/a11y.spec.ts:71:5 › @a11y New Invoice form fields are all keyboard-reachable and labelled
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toBeVisible() failed
Locator: getByLabel(/token address|token contract address/i)
Expected: visible
Timeout: 5000ms
Error: element(s) not found
Call log:
- Expect "toBeVisible" with timeout 5000ms
- waiting for getByLabel(/token address|token contract address/i)
73 | await page.waitForLoadState('networkidle').catch(() => undefined);
74 |
> 75 | await expect(page.getByLabel(/token address|token contract address/i)).toBeVisible();
| ^
76 |
77 | const results = await runAxe(page);
78 | const seriousOrCritical = results.violations.filter(
at /home/runner/work/split-app/split-app/e2e/a11y.spec.ts:75:74
|
|
Run accessibility tests (WCAG 2.1 AA gate):
e2e/a11y.spec.ts#L47
3) [chromium] › e2e/a11y.spec.ts:38:7 › @a11y Analytics (/analytics) has no critical or serious axe violations
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: [serious] document-title: Documents must have <title> element to aid in navigation (https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright)
- html
Fix any of the following:
Document does not have a non-empty <title> element
[serious] html-has-lang: <html> element must have a lang attribute (https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright)
- html
Fix any of the following:
The <html> element does not have a lang attribute
expect(received).toEqual(expected) // deep equality
- Expected - 1
+ Received + 86
- Array []
+ Array [
+ Object {
+ "description": "Ensure each HTML document contains a non-empty <title> element",
+ "help": "Documents must have <title> element to aid in navigation",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright",
+ "id": "document-title",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": null,
+ "id": "doc-has-title",
+ "impact": "serious",
+ "message": "Document does not have a non-empty <title> element",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ Document does not have a non-empty <title> element",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.text-alternatives",
+ "wcag2a",
+ "wcag242",
+ "TTv5",
+ "TT12.a",
+ "EN-301-549",
+ "EN-9.2.4.2",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.5.1",
+ ],
+ },
+ Object {
+ "description": "Ensure every HTML document has a lang attribute",
+ "help": "<html> element must have a lang attribute",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright",
+ "id": "html-has-lang",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": Object {
+ "messageKey": "noLang",
+ },
+ "id": "has-lang",
+ "impact": "serious",
+ "message": "The <html> element does not have a lang attribute",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ The <html> element does not have a lang attribute",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.language",
+ "wcag2a",
+ "wcag311",
+ "TTv5",
+ "TT11.a",
+ "EN-301-549",
+ "EN-9.3.1.1",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.3.1",
+ ],
+ },
+ ]
45 | );
46 |
> 47 | expect(seriousOrCritical, formatViolations(seriousOrCritical)).toEqual([]);
| ^
48 | });
49 | }
|
|
Run accessibility tests (WCAG 2.1 AA gate):
e2e/a11y.spec.ts#L47
3) [chromium] › e2e/a11y.spec.ts:38:7 › @a11y Analytics (/analytics) has no critical or serious axe violations
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: [serious] document-title: Documents must have <title> element to aid in navigation (https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright)
- html
Fix any of the following:
Document does not have a non-empty <title> element
[serious] html-has-lang: <html> element must have a lang attribute (https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright)
- html
Fix any of the following:
The <html> element does not have a lang attribute
expect(received).toEqual(expected) // deep equality
- Expected - 1
+ Received + 86
- Array []
+ Array [
+ Object {
+ "description": "Ensure each HTML document contains a non-empty <title> element",
+ "help": "Documents must have <title> element to aid in navigation",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright",
+ "id": "document-title",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": null,
+ "id": "doc-has-title",
+ "impact": "serious",
+ "message": "Document does not have a non-empty <title> element",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ Document does not have a non-empty <title> element",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.text-alternatives",
+ "wcag2a",
+ "wcag242",
+ "TTv5",
+ "TT12.a",
+ "EN-301-549",
+ "EN-9.2.4.2",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.5.1",
+ ],
+ },
+ Object {
+ "description": "Ensure every HTML document has a lang attribute",
+ "help": "<html> element must have a lang attribute",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright",
+ "id": "html-has-lang",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": Object {
+ "messageKey": "noLang",
+ },
+ "id": "has-lang",
+ "impact": "serious",
+ "message": "The <html> element does not have a lang attribute",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ The <html> element does not have a lang attribute",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.language",
+ "wcag2a",
+ "wcag311",
+ "TTv5",
+ "TT11.a",
+ "EN-301-549",
+ "EN-9.3.1.1",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.3.1",
+ ],
+ },
+ ]
45 | );
46 |
> 47 | expect(seriousOrCritical, formatViolations(seriousOrCritical)).toEqual([]);
| ^
48 | });
49 | }
|
|
Run accessibility tests (WCAG 2.1 AA gate):
e2e/a11y.spec.ts#L47
2) [chromium] › e2e/a11y.spec.ts:38:7 › @a11y Verify Invoice (/verify/1) has no critical or serious axe violations
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: [serious] document-title: Documents must have <title> element to aid in navigation (https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright)
- html
Fix any of the following:
Document does not have a non-empty <title> element
[serious] html-has-lang: <html> element must have a lang attribute (https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright)
- html
Fix any of the following:
The <html> element does not have a lang attribute
expect(received).toEqual(expected) // deep equality
- Expected - 1
+ Received + 86
- Array []
+ Array [
+ Object {
+ "description": "Ensure each HTML document contains a non-empty <title> element",
+ "help": "Documents must have <title> element to aid in navigation",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright",
+ "id": "document-title",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": null,
+ "id": "doc-has-title",
+ "impact": "serious",
+ "message": "Document does not have a non-empty <title> element",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ Document does not have a non-empty <title> element",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.text-alternatives",
+ "wcag2a",
+ "wcag242",
+ "TTv5",
+ "TT12.a",
+ "EN-301-549",
+ "EN-9.2.4.2",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.5.1",
+ ],
+ },
+ Object {
+ "description": "Ensure every HTML document has a lang attribute",
+ "help": "<html> element must have a lang attribute",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright",
+ "id": "html-has-lang",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": Object {
+ "messageKey": "noLang",
+ },
+ "id": "has-lang",
+ "impact": "serious",
+ "message": "The <html> element does not have a lang attribute",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ The <html> element does not have a lang attribute",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.language",
+ "wcag2a",
+ "wcag311",
+ "TTv5",
+ "TT11.a",
+ "EN-301-549",
+ "EN-9.3.1.1",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.3.1",
+ ],
+ },
+ ]
45 | );
46 |
> 47 | expect(seriousOrCritical, formatViolations(seriousOrCritical)).toEqual([]);
| ^
48 | });
49 |
|
|
Run accessibility tests (WCAG 2.1 AA gate):
e2e/a11y.spec.ts#L47
2) [chromium] › e2e/a11y.spec.ts:38:7 › @a11y Verify Invoice (/verify/1) has no critical or serious axe violations
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: [serious] document-title: Documents must have <title> element to aid in navigation (https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright)
- html
Fix any of the following:
Document does not have a non-empty <title> element
[serious] html-has-lang: <html> element must have a lang attribute (https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright)
- html
Fix any of the following:
The <html> element does not have a lang attribute
expect(received).toEqual(expected) // deep equality
- Expected - 1
+ Received + 86
- Array []
+ Array [
+ Object {
+ "description": "Ensure each HTML document contains a non-empty <title> element",
+ "help": "Documents must have <title> element to aid in navigation",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright",
+ "id": "document-title",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": null,
+ "id": "doc-has-title",
+ "impact": "serious",
+ "message": "Document does not have a non-empty <title> element",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ Document does not have a non-empty <title> element",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.text-alternatives",
+ "wcag2a",
+ "wcag242",
+ "TTv5",
+ "TT12.a",
+ "EN-301-549",
+ "EN-9.2.4.2",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.5.1",
+ ],
+ },
+ Object {
+ "description": "Ensure every HTML document has a lang attribute",
+ "help": "<html> element must have a lang attribute",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright",
+ "id": "html-has-lang",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": Object {
+ "messageKey": "noLang",
+ },
+ "id": "has-lang",
+ "impact": "serious",
+ "message": "The <html> element does not have a lang attribute",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ The <html> element does not have a lang attribute",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.language",
+ "wcag2a",
+ "wcag311",
+ "TTv5",
+ "TT11.a",
+ "EN-301-549",
+ "EN-9.3.1.1",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.3.1",
+ ],
+ },
+ ]
45 | );
46 |
> 47 | expect(seriousOrCritical, formatViolations(seriousOrCritical)).toEqual([]);
| ^
48 | });
49 |
|
|
Run accessibility tests (WCAG 2.1 AA gate):
e2e/a11y.spec.ts#L47
1) [chromium] › e2e/a11y.spec.ts:38:7 › @a11y Invoice Detail (/invoice/1) has no critical or serious axe violations
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: [serious] document-title: Documents must have <title> element to aid in navigation (https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright)
- html
Fix any of the following:
Document does not have a non-empty <title> element
[serious] html-has-lang: <html> element must have a lang attribute (https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright)
- html
Fix any of the following:
The <html> element does not have a lang attribute
expect(received).toEqual(expected) // deep equality
- Expected - 1
+ Received + 86
- Array []
+ Array [
+ Object {
+ "description": "Ensure each HTML document contains a non-empty <title> element",
+ "help": "Documents must have <title> element to aid in navigation",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright",
+ "id": "document-title",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": null,
+ "id": "doc-has-title",
+ "impact": "serious",
+ "message": "Document does not have a non-empty <title> element",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ Document does not have a non-empty <title> element",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.text-alternatives",
+ "wcag2a",
+ "wcag242",
+ "TTv5",
+ "TT12.a",
+ "EN-301-549",
+ "EN-9.2.4.2",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.5.1",
+ ],
+ },
+ Object {
+ "description": "Ensure every HTML document has a lang attribute",
+ "help": "<html> element must have a lang attribute",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright",
+ "id": "html-has-lang",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": Object {
+ "messageKey": "noLang",
+ },
+ "id": "has-lang",
+ "impact": "serious",
+ "message": "The <html> element does not have a lang attribute",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ The <html> element does not have a lang attribute",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.language",
+ "wcag2a",
+ "wcag311",
+ "TTv5",
+ "TT11.a",
+ "EN-301-549",
+ "EN-9.3.1.1",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.3.1",
+ ],
+ },
+ ]
45 | );
46 |
> 47 | expect(seriousOrCritical, formatViolations(seriousOrCritical)).toEqual([]);
| ^
48 | });
49
|
|
Run accessibility tests (WCAG 2.1 AA gate):
e2e/a11y.spec.ts#L47
1) [chromium] › e2e/a11y.spec.ts:38:7 › @a11y Invoice Detail (/invoice/1) has no critical or serious axe violations
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: [serious] document-title: Documents must have <title> element to aid in navigation (https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright)
- html
Fix any of the following:
Document does not have a non-empty <title> element
[serious] html-has-lang: <html> element must have a lang attribute (https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright)
- html
Fix any of the following:
The <html> element does not have a lang attribute
expect(received).toEqual(expected) // deep equality
- Expected - 1
+ Received + 86
- Array []
+ Array [
+ Object {
+ "description": "Ensure each HTML document contains a non-empty <title> element",
+ "help": "Documents must have <title> element to aid in navigation",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/document-title?application=playwright",
+ "id": "document-title",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": null,
+ "id": "doc-has-title",
+ "impact": "serious",
+ "message": "Document does not have a non-empty <title> element",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ Document does not have a non-empty <title> element",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.text-alternatives",
+ "wcag2a",
+ "wcag242",
+ "TTv5",
+ "TT12.a",
+ "EN-301-549",
+ "EN-9.2.4.2",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.5.1",
+ ],
+ },
+ Object {
+ "description": "Ensure every HTML document has a lang attribute",
+ "help": "<html> element must have a lang attribute",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.12/html-has-lang?application=playwright",
+ "id": "html-has-lang",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": Object {
+ "messageKey": "noLang",
+ },
+ "id": "has-lang",
+ "impact": "serious",
+ "message": "The <html> element does not have a lang attribute",
+ "relatedNodes": Array [],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ The <html> element does not have a lang attribute",
+ "html": "<html>",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "html",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.language",
+ "wcag2a",
+ "wcag311",
+ "TTv5",
+ "TT11.a",
+ "EN-301-549",
+ "EN-9.3.1.1",
+ "ACT",
+ "RGAAv4",
+ "RGAA-8.3.1",
+ ],
+ },
+ ]
45 | );
46 |
> 47 | expect(seriousOrCritical, formatViolations(seriousOrCritical)).toEqual([]);
| ^
48 | });
49
|
|
Complete job
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Upload Playwright report
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
Run accessibility tests (WCAG 2.1 AA gate)
4 failed
[chromium] › e2e/a11y.spec.ts:38:7 › @a11y Invoice Detail (/invoice/1) has no critical or serious axe violations
[chromium] › e2e/a11y.spec.ts:38:7 › @a11y Verify Invoice (/verify/1) has no critical or serious axe violations
[chromium] › e2e/a11y.spec.ts:38:7 › @a11y Analytics (/analytics) has no critical or serious axe violations
[chromium] › e2e/a11y.spec.ts:71:5 › @a11y New Invoice form fields are all keyboard-reachable and labelled
1 skipped
3 passed (1.1m)
|
background
wait
wait-all
cancel
parallel
Loading