Compas

Study finds global LLM leaderboards misleading, proposes portfolio rankings

A new research paper argues that current leaderboards for large language models (LLMs) are misleading due to significant heterogeneity in user preferences across languages and tasks. The study analyzed approximately 89,…