Install pytorch based on official website.
Install other dependencies with following command:
pip install -v -e .Create a YAML configure file (or use one of we provide under ./configs directory).
Start benchmark with following command:
python llmbenchmark/benchmark.py -c <path_to_config_file>Anything supported by hugging face.