Getting to Know LLM Benchmarks: How to Use Them in Evaluating Your Own AI Systems
I counted which benchmarks appeared in two months of major model announcements, then sorted out what each one measures and how it scores. It also covers Artificial Analysis's combined index, the limits of benchmarks, and what carries over to evaluating your own AI systems.