Database Benchmarking Notes

Notes and scripts from benchmarking with YCSB, sysbench, and BenchmarkSQL.

Tool	What it's for
YCSB	NoSQL - MongoDB, Redis
sysbench	MySQL, PostgreSQL OLTP
BenchmarkSQL	TPC-C warehouse workload

What I picked up

Running these taught me how to set up a fair test and read the numbers properly. YCSB for read/write mixes on NoSQL. sysbench for relational OLTP and thread scaling. BenchmarkSQL for TPC-C and tpmC.

Run

cd ycsb/scripts && ./run.sh
cd sysbench/scripts && ./run.sh
cd benchmarksql/scripts && ./run.sh

Metrics I look at

Throughput (ops/sec or tpmC) and latency, especially p95/p99. Average latency alone hides the slow requests.

Environment

Mostly Ubuntu 22.04 and Windows WSL2. Your numbers will differ based on hardware.