v4.8.0

Release Notes

It is now possible to do consecutive CodSpeed run in the same GitHub job. This will allow using multiple instruments without having to spawn another job 🎉

jobs:
  codspeed:
    ...
    steps:
      ...
      - name: Build benchmarks
        run: cargo codspeed build -m analysis

      - name: Run benchmarks
        uses: CodSpeedHQ/action@v4
        with:
          run: cargo codspeed run
          mode: "simulation"

      - name: Run memory benchmarks
        uses: CodSpeedHQ/action@v4
        with:
          run: cargo codspeed run
          mode: "memory"

🚀 Features

• Allow defining targets in codspeed yaml by @GuillaumeLagrange in #197
• Add an stdin mode to provide multiple commands by @GuillaumeLagrange
• Add a run index suffix by @fargito in #199
• Make the config less strict about its config by @GuillaumeLagrange in #198
• Add support for analysis mode with memory instrument by @GuillaumeLagrange
• Reduce shared fifo timeout to end executor runs faster after the program has ended by @GuillaumeLagrange in #193
• Use a bufwriter to save unwind data by @GuillaumeLagrange
• Support dynamically and statically linked allocators by @not-matthias
• Track memalign calls by @not-matthias
• Accept IPC before creating tracker to avoid timeouts by @not-matthias
• Add integration tests for complex cli commands by @GuillaumeLagrange
• Add the full command to the uri and handle hyphens better by @GuillaumeLagrange
• Add yaml project config discovery and loading by @GuillaumeLagrange in #189
• Implement the walltime benchmarking algorithm by @GuillaumeLagrange
• Use rayon to collect perf walltime data by @GuillaumeLagrange
• Handle memory executor when displaying results by @GuillaumeLagrange in #190
• Do not draw a table if there is only one benchmark by @GuillaumeLagrange
• Stop using the deprecated time field and use value instead by @GuillaumeLagrange

🐛 Bug Fixes

• Fix behavior when multiple benchmarks are ran by @GuillaumeLagrange
• Simplify run_part_id computation by @fargito in #200
• Write perf map all at once instead of line by line by @GuillaumeLagrange
• Drop privileges when running commands under sudo by @not-matthias
• Make walltime results stat computation the same as pytest-codspeed by @GuillaumeLagrange in #185

🏗️ Refactor

• Move project config structs to interfaces mod by @GuillaumeLagrange
• Move all walltime benchmarking to its dedicated module by @GuillaumeLagrange

⚙️ Internals

• chore: bump runner version to 4.8.0 by @github-actions[bot] in #172
• Bump memtrack version
• Ignore .codspeed for exec-harness output by @GuillaumeLagrange
• Remove useless clone derive for project config by @GuillaumeLagrange
• Cleanup output by @not-matthias in #196
• Use simulation in codspeed action by @GuillaumeLagrange in #194
• Cache benchmark executable by @GuillaumeLagrange
• Add prelude and remove linter dead_code suppression by @GuillaumeLagrange
• Reduce logs verbosity of debug info and perf file serialization by @GuillaumeLagrange
• Remove unused execve event by @not-matthias in #192
• Add prelude by @not-matthias
• Print number of events written to disk by @not-matthias
• Switch to rust-cache to cache builds of the installed workspace binaries by @GuillaumeLagrange in #191
• Install exec-harness before runner tests tests by @GuillaumeLagrange
• Remove double metadata information by @GuillaumeLagrange
• Add link to relevant issue for codspeed-rust metadata by @GuillaumeLagrange
• Use fork supporting compressed events for linux-perf-data by @GuillaumeLagrange
• Run exec-harness tests in separate CI job to prevent fifo issues by @GuillaumeLagrange
• Downgrade flate because 1.1.7 was yanked by @GuillaumeLagrange

Install codspeed-runner 4.8.0

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.8.0/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.8.0

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.7.0...v4.8.0

v4.7.0

Release Notes

🚀 Features

• Check for perf compression and enable multi-events conditionally by @GuillaumeLagrange
• Enable perf data compression by @art049
• Add more events to perf monitoring by @GuillaumeLagrange
• Add zstd compression support by @not-matthias
• Add l2d cache events to perf command by @GuillaumeLagrange in #188

🐛 Bug Fixes

• Do not cat stdout from command to pipe.data by @GuillaumeLagrange in #182
• Drain events arriving after process terminated by @not-matthias
• Support non-x86 libc paths by @not-matthias in #183

⚙️ Internals

• Add instructions event, and use runner_shared for monitored events by @GuillaumeLagrange in #154
• Bump memtrack version by @not-matthias in #187
• Prevent gh release edit from automatically setting release as latest by @GuillaumeLagrange in #186
• Add memtrack serialization benchmark by @not-matthias in #184

Install codspeed-runner 4.7.0

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.7.0/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.7.0

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.5.2...v4.7.0

v4.5.2

Release Notes

🚀 Features

• Update release flow to make sure only runner releases are marked as latest (#180) by @GuillaumeLagrange in #180
• Improve UNAUTHENTICATED error message by @fargito in #181

⚙️ Internals

• Bump cargo dist to 0.30.3 by @art049
• chore: bump runner version to 4.5.2 by @github-actions[bot] in #167

Install codspeed-runner 4.5.2

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.5.2/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.5.2

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.5.1...v4.5.2

v4.5.1

Release Notes

🚀 Features

• Remove projects query from the exec polling by @GuillaumeLagrange in #173
• Fetch project from API when running outside of git repo by @GuillaumeLagrange
• Add get or create project repository query by @GuillaumeLagrange
• Automatically install exec-harness for exec subcommand by @GuillaumeLagrange
• Auto install codspeed-memtrack during executor setup by @GuillaumeLagrange
• Serialize events serially to allow streamed decoding by @not-matthias in #172
• Parse perf file for memmap events instead of relying on /proc/pid/maps by @GuillaumeLagrange
• Use the projects upload enpdoint in exec command by @GuillaumeLagrange
• Add exec subcommand and refactor run subcommand by @GuillaumeLagrange
• Add exec-harness binary by @GuillaumeLagrange
• Add memory executor by @not-matthias
• Add memtrack crate by @not-matthias
• Add artifact types by @not-matthias
• Add shared fifo by @not-matthias
• Add new fifo commands by @not-matthias
• Support simulation for free-threaded python by @adriencaccia in #167

🐛 Bug Fixes

• fix: specify package when using branch/ref by @not-matthias in #162
• fix: properly check for allow_empty input by @GuillaumeLagrange in #164
• Filter out arm debugging symbols by @GuillaumeLagrange in #179
• Filter out empty named symbols when building perf-map by @GuillaumeLagrange in #176
• Do not break support for no reason when changing integration hooks protocol version by @GuillaumeLagrange in #175
• Remove dirty retry on timeout and simply increase timeout for GQL client by @GuillaumeLagrange
• Stop hanging indefinitely if process fails to start in memory executor by @GuillaumeLagrange in #171
• Remove the password prompt from the run_with_sudo dialog by @GuillaumeLagrange
• Collect events in thread to avoid mutex overhead by @not-matthias
• Convert events in thread to avoid blocking at the end by @not-matthias
• Compress only when size exceeds threshold by @not-matthias
• Forward environment in memory executor by @not-matthias
• Fix plan test in CI by @GuillaumeLagrange in #165
• Prevent nextest from running valgrind and memcheck concurrently by @GuillaumeLagrange
• Stop ignoring samples by @GuillaumeLagrange
• Use correct name for unwind_data trait declaration by @GuillaumeLagrange
• Stop filtering out zero sized symbol by @GuillaumeLagrange
• Request OIDC token after creating profile archive by @fargito in #170
• Remove snapshots that were not part of lfs by @not-matthias in #166
• Always print memory mapping logs by @not-matthias

🏗️ Refactor

• Create a dedicated execution_context that holds runtime information by @GuillaumeLagrange
• Move executor and instruments modules out of run module by @GuillaumeLagrange

⚙️ Internals

• docs(examples): add go and cpp examples by @fargito in #161
• Ignore some tags in the changelog
• Bump protocol version by @not-matthias in #174
• Add CONTRIBUTING.md by @GuillaumeLagrange
• Add cargo-dist arguments for release by @GuillaumeLagrange
• Reset exec-harness and memtrack crate versions to 1.0.0 ahead of first release by @GuillaumeLagrange
• Switch to pr run mode plan only for pr by @GuillaumeLagrange
• Add test to ensure path is properly forwarded by @not-matthias in #169
• Make the exec command work outside of git repos by @GuillaumeLagrange
• Do not publish memtrack to crates.io by @adriencaccia
• Dont run valgrind and memory tests at the same time by @not-matthias in #164
• Add test-log to see output on failures by @not-matthias
• Add workspace dependencies by @not-matthias

Install codspeed-runner 4.5.1

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.5.1/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.5.1

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.4.1...v4.5.1

v4.4.1

Release Notes

🚀 Features

• Display oidc as announcement by @fargito
• Add --allow-empty run option by @GuillaumeLagrange in #160

🐛 Bug Fixes

• Do not espace trailing newlines in logger by @fargito
• Make multiline logs appear correctly in summary by @fargito in #162
• Request OIDC token just before upload by @fargito
• Update docs links to oidc by @fargito in #159

⚙️ Internals

• feat: make use of allow-empty in the ci of this action by @GuillaumeLagrange in #158
• chore: bump runner version to 4.4.1 by @github-actions[bot] in #159

Install codspeed-runner 4.4.1

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.4.1/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.4.1

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.4.0...v4.4.1

v4.4.0

Release Notes

🚀 Features

• Add support for oidc token authentication by @fargito in #156
  • You can now use OIDC to authenticate your CodSpeed workflow and remove CODSPEED_TOKEN from your repositories secret! Learn more in the dedicated changelog entry
• Accept simulation as runner mode by @GuillaumeLagrange in #152
• Add a comment explaining why we do not check for emptiness in valgrind teardown by @GuillaumeLagrange in #157
• Validate walltime results before uploading by @GuillaumeLagrange
• Import walltime_results from monorepo by @GuillaumeLagrange
• Accept both simulation and instrumentation as a mode input by @GuillaumeLagrange in #155

🐛 Bug Fixes

• Dont start perf unless it's not already started by @not-matthias in #158
• Use a line buffer when reading stdout/stderr streams by @GuillaumeLagrange

📚 Documentation

• docs: recommend OpenID Connect instead of static token by @fargito in #156

⚙️ Internals

• chore: bump runner version to 4.4.0 by @github-actions[bot] in #157

Install codspeed-runner 4.4.0

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.4.0/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.4.0

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.3.4...v4.4.0

v4.3.4

Release Notes

🚀 Features

• Make get_commit_hash different based on the provider by @GuillaumeLagrange in #151

🐛 Bug Fixes

• Use GITHUB_WORKSPACE env var when computing root path by @GuillaumeLagrange
• Ensure perf also fails when the command fails by @not-matthias in #150
• Ensure working directory is used when running the cmd by @not-matthias
• Use debug! instead of println for debug data by @art049

⚙️ Internals

• chore: bump runner version to 4.3.4 by @github-actions[bot] in #154

Install codspeed-runner 4.3.4

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.3.4/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.3.4

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.3.3...v4.3.4

v4.3.3

Release Notes

🚀 Features

• Update valgrind codspeed to 3.26.0-0codspeed0
• Add --config-name argument to allow multiple configs by @GuillaumeLagrange in #145
• Output perf data directly to profile folder by @GuillaumeLagrange in #138
• Emit perf data in pipe mode by @art049
• Properly handle sudo with a command builder (#143) by @art049 in #143

🐛 Bug Fixes

• Run cp with bash to expand glob patterns by @not-matthias in #148

⚙️ Internals

• Use info instead of warn for some cache and valgrind setup logs by @adriencaccia in #142

• chore: bump runner version to 4.3.3 by @github-actions[bot] in #152

Install codspeed-runner 4.3.3

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.3.3/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.3.3

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.3.1...v4.3.3

v4.3.1

Release Notes

🚀 Features

• Enable read-inline-info to support inlined frames by @not-matthias in #139
• Allow shorthand for selecting the mode by @art049
• Improve results display when running locally by @art049
• Bump to valgrind-codspeed 3.25.1-3codspeed2 by @art049 in #137
• Allow wider range of valgrind codspeed version usage by @art049
• Automatically open the auth URL by @art049 in #133
• Proper interactive sudo support by @art049
• Dump debug info of loaded modules by @not-matthias in #128

🐛 Bug Fixes

• Dont immediately add load_bias to symbol offset by @not-matthias
• Sudo behavior when root or not available (#141) by @art049 in #141

Install codspeed-runner 4.3.1

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.3.1/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.3.1

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.2.1...v4.3.1

v4.2.1

Release Notes

What's Changed

🚀 Features

• Use a prime number as frequency to avoid synchronization with periodic tasks by @adriencaccia
• Pin actions/cache by @edgarrmondragon in #143
• Fix action cache by @adriencaccia in #144

🐛 Bug Fixes

• Ensure perf is always found on the machine by @adriencaccia in #132
• Correctly check if perf is installed by @adriencaccia

⚙️ Internals

• Add a metadata file in the cache that lists the installed packages by @adriencaccia
• chore: bump runner version to 4.2.1 by @adriencaccia in #145

New Contributors

• @edgarrmondragon made their first contribution in #143

Install codspeed-runner 4.2.1

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/runner/releases/download/v4.2.1/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.2.1

File	Platform	Checksum
codspeed-runner-aarch64-unknown-linux-musl.tar.gz	ARM64 MUSL Linux	checksum
codspeed-runner-x86_64-unknown-linux-musl.tar.gz	x64 MUSL Linux	checksum

Full Runner Changelog: https://github.com/CodSpeedHQ/runner/blob/main/CHANGELOG.md

Full Changelog: v4.2.0...v4.2.1