We are thrilled to launch the 2025 WSDM Cup: LMSYS Multilingual Chatbot Arena Prediction Contest, in collaboration with Kaggle and LMSYS.org.
This year's challenge focuses on creating multilingual auto-rater models using chatbot arena data. In order to provide a strong ability to ensure that these models are indeed reflective of human evaluations, we have worked in partnership with LMSYS.org, which has become one of the leading resources for the field through their well known chatbot arena lmarena.ai. This arena has led the way in open-ended, community based evaluations of LLMs in blind side-by-side comparison, and provides the perfect resource for training and evaluating auto-rater models.
Visit the official competition page on Kaggle for all details: https://www.kaggle.com/competitions/wsdm-cup-multilingual-chatbot-arena/overview