llama-bench is a CLI tool that is a part of a very popular llama.cpp inference engine. It is widely used in LLM community to benchmark models and allows to perform measurement at different context ...