Cutting down a tree can be quite an arduous undertaking, and how to kill a tree stump is a bit of a mystery. But if a tree is long in the tooth (or…branch?) and threatens to fall over, cut down it ...
Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.