Skip to content

ci: add benchmark workflow#28

Open
Arvuno wants to merge 1 commit into
agentmail-to:mainfrom
Arvuno:ci/add-benchmark-workflow
Open

ci: add benchmark workflow#28
Arvuno wants to merge 1 commit into
agentmail-to:mainfrom
Arvuno:ci/add-benchmark-workflow

Conversation

@Arvuno
Copy link
Copy Markdown

@Arvuno Arvuno commented May 22, 2026

Summary

Adds benchmark workflow to CI.

Testing

CI passes.


Summary by cubic

Adds a benchmark CI workflow that builds the project and runs a lightweight TS benchmark on pushes and PRs to main. Reports total time, average per iteration, and ops/sec to help catch performance regressions early.

Written for commit 13213a8. Summary will update on new commits. Review in cubic

Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 2 files

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="node/bench.ts">

<violation number="1" location="node/bench.ts:12">
P2: Benchmark loop body assigns object properties to unused local variables, which allows JavaScript engines to eliminate the reads via dead code elimination, producing misleading timing metrics.</violation>
</file>

Reply with feedback, questions, or to request a fix.

Fix all with cubic | Re-trigger cubic

Comment thread node/bench.ts
const testObj = { name: 'test', description: 'test desc', schema: {} }

const start = performance.now()
for (let i = 0; i < iterations; i++) {
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot May 22, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2: Benchmark loop body assigns object properties to unused local variables, which allows JavaScript engines to eliminate the reads via dead code elimination, producing misleading timing metrics.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At node/bench.ts, line 12:

<comment>Benchmark loop body assigns object properties to unused local variables, which allows JavaScript engines to eliminate the reads via dead code elimination, producing misleading timing metrics.</comment>

<file context>
@@ -0,0 +1,26 @@
+const testObj = { name: 'test', description: 'test desc', schema: {} }
+
+const start = performance.now()
+for (let i = 0; i < iterations; i++) {
+    for (let j = 0; j < 20; j++) { // Simulate ~20 tools
+        const _name = testObj.name
</file context>
Fix with Cubic

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant