Benchmarks are run nightly using pebble
bench ycsb on AWS c5d.4xlarge machines equipped with
local SSD storage. The AWS instances show remarkably high
instance to instance performance variability. In order to
smooth out that variability the benchmarks are run multiple
times each (using difference instances) and outliers are
excluded.