Skip to content

Adds benchmarking tools#171

Merged
arcanis merged 9 commits intomainfrom
mael/bench-codspeed
Jan 3, 2026
Merged

Adds benchmarking tools#171
arcanis merged 9 commits intomainfrom
mael/bench-codspeed

Conversation

@arcanis
Copy link
Copy Markdown
Member

@arcanis arcanis commented Jan 3, 2026

Note

Adds end-to-end benchmarking and CI perf checks.

  • CI: New Benchmarks workflow runs hyperfine on base vs head, caches builds, uses a local mock proxy, merges JSON results, and posts a PR comment with stats
  • CLI: New debug bench commands (prepare/iteration/cleanup/run) with modes (install-full-cold, etc.) and fixtures (gatsby, next); --silent added to install and add
  • Mock NPM proxy: New debug mock-proxy HTTP server (hyper) with response caching and URL rewriting for deterministic runs
  • Bench harness: Adds divan benchmark benches/cli.rs and fixture package.json; ignores /bench-*.json
  • Resolver tweak: Normalize npm tarball URLs (http→https, %2f handling) and use conventional vs URL locator accordingly
  • Plumbing: Allow run_default/extract_bin_meta to accept argv; new error variants and deps (hyper, http-body-util, codspeed-divan-compat)

Written by Cursor Bugbot for commit ab717ac. This will update automatically on new commits. Configure here.

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Jan 3, 2026

CodSpeed Performance Report

Congrats! CodSpeed is installed 🎉

🆕 1 new benchmark was detected.

You will start to see performance impacts in the reports once the benchmarks are run from your default branch.

Detected benchmark

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jan 3, 2026

⏱️ Benchmark Results

Metric Base Head Difference
Mean 5.515s 5.510s -0.08% ✅
Median 5.513s 5.503s -0.19% ✅
Min 5.447s 5.405s
Max 5.627s 5.645s
Std Dev 0.041s 0.055s
📊 Raw benchmark data

Base times: 5.493s, 5.516s, 5.546s, 5.540s, 5.513s, 5.627s, 5.508s, 5.531s, 5.481s, 5.447s, 5.463s, 5.491s, 5.581s, 5.552s, 5.500s, 5.478s, 5.526s, 5.497s, 5.452s, 5.538s, 5.459s, 5.477s, 5.556s, 5.513s, 5.572s, 5.503s, 5.491s, 5.563s, 5.519s, 5.515s

Head times: 5.615s, 5.536s, 5.590s, 5.557s, 5.531s, 5.465s, 5.483s, 5.510s, 5.503s, 5.568s, 5.405s, 5.487s, 5.494s, 5.511s, 5.507s, 5.538s, 5.442s, 5.443s, 5.510s, 5.466s, 5.462s, 5.477s, 5.609s, 5.495s, 5.443s, 5.503s, 5.501s, 5.538s, 5.645s, 5.475s


Benchmark: gatsby install-full-cold

@arcanis arcanis marked this pull request as ready for review January 3, 2026 20:44
@arcanis
Copy link
Copy Markdown
Member Author

arcanis commented Jan 3, 2026

@BugBot review

Copy link
Copy Markdown

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no bugs!

@arcanis arcanis merged commit 39f7b13 into main Jan 3, 2026
12 of 13 checks passed
@arcanis arcanis deleted the mael/bench-codspeed branch January 3, 2026 20:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant