Skip to content

Releases: Holmusk/benchtool

benchtool v0.1.0

01 Aug 07:06

Choose a tag to compare

First pip-installable release of BenchTool

This release introduces a new, user-friendly installation and usage workflow:

  • Install directly with pip from the GitHub Release wheel.
  • Run the benchmarking tool with the benchtool command.

Features:

  • Benchmark NLP models using HuggingFace, ONNX, or ORT.
  • Input data from CSV.
  • Configurable via a single YAML file (config.yml).
  • Outputs performance metrics (inference time, throughput, etc.).
  • Easy CLI usage: benchtool

How to install:

Create a virtual environment:

python3 -m venv env
source env/bin/activate  
pip install https://github.com/Holmusk/BenchMark/releases/download/v1.0.0/benchtool-1.0.0-py3-none-any.whl

How to use:

  1. Prepare your config.yml and input CSV in your working directory.
  2. Run:
    benchtool

Check the README for more details and an example config.