CI/CD test pull request, not real #9
mvalancychaos-testing.yml
on: pull_request
Matrix: Chaos Testing - Edge Cases & Resilience
Chaos Testing Summary
3s
Annotations
31 errors and 30 warnings
|
tests/network-protocol-chaos.test.ts > Network Protocol Chaos Testing > Protocol Compliance and Validation > should validate MCP message format compliance:
packages/mcp-server/tests/network-protocol-chaos.test.ts#L204
AssertionError: expected 'Data size limit exceeded. Maximum 10M…' to match /required|format|invalid|mcp|message|…/i
- Expected:
/required|format|invalid|mcp|message|validation/i
+ Received:
"Data size limit exceeded. Maximum 10MB allowed, got 133.80MB"
❯ tests/network-protocol-chaos.test.ts:204:35
|
|
tests/multi-perspective-chaos.test.ts > MULTI-PERSPECTIVE CHAOS TESTING - Real Attack Vectors > 🧠 Memory & Resource Perspective - DoS Attacks > should handle resource exhaustion via massive arrays gracefully:
packages/mcp-server/tests/multi-perspective-chaos.test.ts#L312
AssertionError: expected 4395 to be less than 2000
❯ tests/multi-perspective-chaos.test.ts:312:28
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > Network I/O and Protocol Issues > should handle malformed protocol data:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L531
AssertionError: expected 'Converting circular structure to JSON…' to match /required|invalid|malformed|protocol|…/i
- Expected:
/required|invalid|malformed|protocol|validation/i
+ Received:
"Converting circular structure to JSON
--> starting at object with constructor 'Object'
| property 'metadata' -> object with constructor 'Object'
--- property 'circular' closes the circle"
❯ tests/filesystem-io-chaos.test.ts:531:35
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > Network I/O and Protocol Issues > should handle network timeouts in database connections:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L480
AssertionError: expected 'CPU exhaustion protection activated f…' to match /timeout|network|connection|unavailab…/i
- Expected:
/timeout|network|connection|unavailable/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 38.3% avg, 100.0% peak, trend: increasing"
❯ tests/filesystem-io-chaos.test.ts:480:25
❯ tests/filesystem-io-chaos.test.ts:479:16
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > File System Security Issues > should prevent directory traversal attacks:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L348
AssertionError: expected 'expected \'../../../etc/passwd\' not …' to match /path|traversal|invalid|security|forb…/i
- Expected:
/path|traversal|invalid|security|forbidden/i
+ Received:
"expected '../../../etc/passwd' not to contain '/etc/passwd'"
❯ tests/filesystem-io-chaos.test.ts:348:35
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > File System Resource Exhaustion > should handle temporary directory access issues:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L166
SyntaxError: Unexpected token N in JSON at position 0
❯ tests/filesystem-io-chaos.test.ts:166:35
❯ tests/filesystem-io-chaos.test.ts:161:19
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > File System Resource Exhaustion > should handle file descriptor exhaustion:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L120
AssertionError: expected 'CPU exhaustion protection activated f…' to match /descriptor|resource|connection|limit…/i
- Expected:
/descriptor|resource|connection|limit|too many/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 77.7% avg, 100.0% peak, trend: stable"
❯ tests/filesystem-io-chaos.test.ts:120:27
❯ tests/filesystem-io-chaos.test.ts:119:18
|
|
tests/distributed-systems-chaos.test.ts > Distributed Systems Chaos Testing > Eventual Consistency Testing > should handle concurrent reads during writes:
packages/mcp-server/tests/distributed-systems-chaos.test.ts#L296
AssertionError: expected 'Test Node' to be 'Concurrent Test Node' // Object.is equality
- Expected
+ Received
- Concurrent Test Node
+ Test Node
❯ tests/distributed-systems-chaos.test.ts:296:37
❯ tests/distributed-systems-chaos.test.ts:294:25
|
|
tests/distributed-systems-chaos.test.ts > Distributed Systems Chaos Testing > Network Partition Simulation > should handle connection pool exhaustion:
packages/mcp-server/tests/distributed-systems-chaos.test.ts#L100
AssertionError: expected 'CPU exhaustion protection activated f…' to match /connection|pool|limit|resource/i
- Expected:
/connection|pool|limit|resource/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 29.8% avg, 100.0% peak, trend: decreasing"
❯ tests/distributed-systems-chaos.test.ts:100:44
❯ tests/distributed-systems-chaos.test.ts:98:18
|
|
tests/concurrency-chaos.test.ts > Concurrency and Race Condition Chaos Testing > Race Condition Detection > should prevent lost updates in concurrent modifications:
packages/mcp-server/src/services/graph-service.ts#L1049
TypeError: Cannot read properties of null (reading 'type')
❯ src/services/graph-service.ts:1049:21
❯ src/services/graph-service.ts:1043:57
❯ Module.withReadConsistency src/utils/consistency-manager.ts:241:10
❯ src/services/graph-service.ts:978:14
❯ src/services/graph-service.ts:236:18
❯ Module.withConnectionPoolLimit src/utils/connection-pool.ts:271:12
❯ src/services/graph-service.ts:233:14
❯ CPUMonitor.executeWithThrottling src/utils/cpu-monitor.ts:141:24
|
|
tests/network-protocol-chaos.test.ts > Network Protocol Chaos Testing > Protocol Compliance and Validation > should validate MCP message format compliance:
packages/mcp-server/tests/network-protocol-chaos.test.ts#L204
AssertionError: expected 'Data size limit exceeded. Maximum 10M…' to match /required|format|invalid|mcp|message|…/i
- Expected:
/required|format|invalid|mcp|message|validation/i
+ Received:
"Data size limit exceeded. Maximum 10MB allowed, got 133.80MB"
❯ tests/network-protocol-chaos.test.ts:204:35
|
|
tests/multi-perspective-chaos.test.ts > MULTI-PERSPECTIVE CHAOS TESTING - Real Attack Vectors > 🧠 Memory & Resource Perspective - DoS Attacks > should handle resource exhaustion via massive arrays gracefully:
packages/mcp-server/tests/multi-perspective-chaos.test.ts#L312
AssertionError: expected 4061 to be less than 2000
❯ tests/multi-perspective-chaos.test.ts:312:28
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > Network I/O and Protocol Issues > should handle malformed protocol data:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L531
AssertionError: expected 'Converting circular structure to JSON…' to match /required|invalid|malformed|protocol|…/i
- Expected:
/required|invalid|malformed|protocol|validation/i
+ Received:
"Converting circular structure to JSON
--> starting at object with constructor 'Object'
| property 'metadata' -> object with constructor 'Object'
--- property 'circular' closes the circle"
❯ tests/filesystem-io-chaos.test.ts:531:35
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > Network I/O and Protocol Issues > should handle network timeouts in database connections:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L480
AssertionError: expected 'CPU exhaustion protection activated f…' to match /timeout|network|connection|unavailab…/i
- Expected:
/timeout|network|connection|unavailable/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 39.4% avg, 100.0% peak, trend: increasing"
❯ tests/filesystem-io-chaos.test.ts:480:25
❯ tests/filesystem-io-chaos.test.ts:479:16
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > File System Security Issues > should prevent directory traversal attacks:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L348
AssertionError: expected 'expected \'../../../etc/passwd\' not …' to match /path|traversal|invalid|security|forb…/i
- Expected:
/path|traversal|invalid|security|forbidden/i
+ Received:
"expected '../../../etc/passwd' not to contain '/etc/passwd'"
❯ tests/filesystem-io-chaos.test.ts:348:35
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > File System Resource Exhaustion > should handle temporary directory access issues:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L166
SyntaxError: Unexpected token 'N', "Node not found" is not valid JSON
❯ tests/filesystem-io-chaos.test.ts:166:35
❯ tests/filesystem-io-chaos.test.ts:161:19
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > File System Resource Exhaustion > should handle file descriptor exhaustion:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L120
AssertionError: expected 'CPU exhaustion protection activated f…' to match /descriptor|resource|connection|limit…/i
- Expected:
/descriptor|resource|connection|limit|too many/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 50.0% avg, 100.0% peak, trend: decreasing"
❯ tests/filesystem-io-chaos.test.ts:120:27
❯ tests/filesystem-io-chaos.test.ts:119:18
|
|
tests/distributed-systems-chaos.test.ts > Distributed Systems Chaos Testing > Eventual Consistency Testing > should handle concurrent reads during writes:
packages/mcp-server/tests/distributed-systems-chaos.test.ts#L296
AssertionError: expected 'Test Node' to be 'Concurrent Test Node' // Object.is equality
- Expected
+ Received
- Concurrent Test Node
+ Test Node
❯ tests/distributed-systems-chaos.test.ts:296:37
❯ tests/distributed-systems-chaos.test.ts:294:25
|
|
tests/distributed-systems-chaos.test.ts > Distributed Systems Chaos Testing > Network Partition Simulation > should handle connection pool exhaustion:
packages/mcp-server/tests/distributed-systems-chaos.test.ts#L100
AssertionError: expected 'CPU exhaustion protection activated f…' to match /connection|pool|limit|resource/i
- Expected:
/connection|pool|limit|resource/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 57.7% avg, 100.0% peak, trend: stable"
❯ tests/distributed-systems-chaos.test.ts:100:44
❯ tests/distributed-systems-chaos.test.ts:98:18
|
|
tests/concurrency-chaos.test.ts > Concurrency and Race Condition Chaos Testing > Race Condition Detection > should prevent lost updates in concurrent modifications:
packages/mcp-server/src/services/graph-service.ts#L1049
TypeError: Cannot read properties of null (reading 'type')
❯ src/services/graph-service.ts:1049:21
❯ src/services/graph-service.ts:1043:57
❯ Module.withReadConsistency src/utils/consistency-manager.ts:241:10
❯ src/services/graph-service.ts:978:14
❯ src/services/graph-service.ts:236:18
❯ Module.withConnectionPoolLimit src/utils/connection-pool.ts:271:12
❯ src/services/graph-service.ts:233:14
❯ CPUMonitor.executeWithThrottling src/utils/cpu-monitor.ts:141:24
|
|
tests/network-protocol-chaos.test.ts > Network Protocol Chaos Testing > Protocol Compliance and Validation > should handle HTTP protocol violations:
packages/mcp-server/tests/network-protocol-chaos.test.ts#L151
AssertionError: expected 'CPU exhaustion protection activated f…' to match /protocol|header|content|invalid|http/i
- Expected:
/protocol|header|content|invalid|http/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 88.9% avg, 100.0% peak, trend: increasing"
❯ tests/network-protocol-chaos.test.ts:151:35
|
|
tests/network-protocol-chaos.test.ts > Network Protocol Chaos Testing > Protocol Compliance and Validation > should handle malformed JSON payloads:
packages/mcp-server/tests/network-protocol-chaos.test.ts#L104
AssertionError: expected 'CPU exhaustion protection activated f…' to match /json|parse|invalid|malformed|syntax/i
- Expected:
/json|parse|invalid|malformed|syntax/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 0.0% avg, 0.0% peak, trend: stable"
❯ tests/network-protocol-chaos.test.ts:104:35
|
|
tests/multi-perspective-chaos.test.ts > MULTI-PERSPECTIVE CHAOS TESTING - Real Attack Vectors > 🧠 Memory & Resource Perspective - DoS Attacks > should handle resource exhaustion via massive arrays gracefully:
packages/mcp-server/tests/multi-perspective-chaos.test.ts#L312
AssertionError: expected 4245 to be less than 2000
❯ tests/multi-perspective-chaos.test.ts:312:28
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > Network I/O and Protocol Issues > should handle malformed protocol data:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L531
AssertionError: expected 'Converting circular structure to JSON…' to match /required|invalid|malformed|protocol|…/i
- Expected:
/required|invalid|malformed|protocol|validation/i
+ Received:
"Converting circular structure to JSON
--> starting at object with constructor 'Object'
| property 'metadata' -> object with constructor 'Object'
--- property 'circular' closes the circle"
❯ tests/filesystem-io-chaos.test.ts:531:35
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > File System Security Issues > should prevent directory traversal attacks:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L348
AssertionError: expected 'expected \'../../../etc/passwd\' not …' to match /path|traversal|invalid|security|forb…/i
- Expected:
/path|traversal|invalid|security|forbidden/i
+ Received:
"expected '../../../etc/passwd' not to contain '/etc/passwd'"
❯ tests/filesystem-io-chaos.test.ts:348:35
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > File System Resource Exhaustion > should handle temporary directory access issues:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L166
SyntaxError: Unexpected token 'N', "Node not found" is not valid JSON
❯ tests/filesystem-io-chaos.test.ts:166:35
❯ tests/filesystem-io-chaos.test.ts:161:19
|
|
tests/filesystem-io-chaos.test.ts > File System and I/O Chaos Testing > File System Resource Exhaustion > should handle file descriptor exhaustion:
packages/mcp-server/tests/filesystem-io-chaos.test.ts#L120
AssertionError: expected 'CPU exhaustion protection activated f…' to match /descriptor|resource|connection|limit…/i
- Expected:
/descriptor|resource|connection|limit|too many/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 58.5% avg, 100.0% peak, trend: increasing"
❯ tests/filesystem-io-chaos.test.ts:120:27
❯ tests/filesystem-io-chaos.test.ts:119:18
|
|
tests/distributed-systems-chaos.test.ts > Distributed Systems Chaos Testing > Eventual Consistency Testing > should handle concurrent reads during writes:
packages/mcp-server/tests/distributed-systems-chaos.test.ts#L296
AssertionError: expected 'Test Node' to be 'Concurrent Test Node' // Object.is equality
- Expected
+ Received
- Concurrent Test Node
+ Test Node
❯ tests/distributed-systems-chaos.test.ts:296:37
❯ tests/distributed-systems-chaos.test.ts:294:25
|
|
tests/distributed-systems-chaos.test.ts > Distributed Systems Chaos Testing > Network Partition Simulation > should handle connection pool exhaustion:
packages/mcp-server/tests/distributed-systems-chaos.test.ts#L100
AssertionError: expected 'CPU exhaustion protection activated f…' to match /connection|pool|limit|resource/i
- Expected:
/connection|pool|limit|resource/i
+ Received:
"CPU exhaustion protection activated for GraphService operation. Current CPU: 59.8% avg, 100.0% peak, trend: decreasing"
❯ tests/distributed-systems-chaos.test.ts:100:44
❯ tests/distributed-systems-chaos.test.ts:98:18
|
|
tests/concurrency-chaos.test.ts > Concurrency and Race Condition Chaos Testing > Race Condition Detection > should prevent lost updates in concurrent modifications:
packages/mcp-server/src/services/graph-service.ts#L1049
TypeError: Cannot read properties of null (reading 'type')
❯ src/services/graph-service.ts:1049:21
❯ src/services/graph-service.ts:1043:57
❯ Module.withReadConsistency src/utils/consistency-manager.ts:241:10
❯ src/services/graph-service.ts:978:14
❯ src/services/graph-service.ts:236:18
❯ Module.withConnectionPoolLimit src/utils/connection-pool.ts:271:12
❯ src/services/graph-service.ts:233:14
❯ CPUMonitor.executeWithThrottling src/utils/cpu-monitor.ts:141:24
|
|
Chaos Testing Summary
Unhandled error: HttpError: Resource not accessible by integration
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L1955
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L1795
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L1794
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L1785
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L1784
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L1746
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L1745
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L1738
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L1737
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (18):
packages/mcp-server/src/services/graph-service.ts#L541
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L1955
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L1795
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L1794
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L1785
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L1784
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L1746
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L1745
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L1738
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L1737
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (20):
packages/mcp-server/src/services/graph-service.ts#L541
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L1955
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L1795
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L1794
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L1785
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L1784
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L1746
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L1745
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L1738
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L1737
Unexpected any. Specify a different type
|
|
Chaos Testing - Edge Cases & Resilience (21):
packages/mcp-server/src/services/graph-service.ts#L541
Unexpected any. Specify a different type
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
chaos-test-results-node-18
Expired
|
381 Bytes |
sha256:29e7276a8bbcf54520771e9449fb143ed6c7fc9a9faa98caafbf4cfd6dffd67b
|
|
|
chaos-test-results-node-20
Expired
|
381 Bytes |
sha256:62bd4670c72b2a7265f34dbfb2a56aa4de0e20316a3c664202c4734c57d3f420
|
|
|
chaos-test-results-node-21
Expired
|
381 Bytes |
sha256:977fac5ac230352ff9f1f91fe7691420c395aeb876df374e7818b7a925bfa922
|
|