With a purpose to assist builders globally perceive large language models (LLMs) higher, the corporate has funded and revealed knowledgeable translation of the Huge Multitask Language Understanding (MMLU) benchmark in 14 languages through Hugging Face.
“Supporting those that (builders) perceive the distinctive cultures, economies, and social dynamics of their communities will assist be sure that AI functions are tailor-made to satisfy native wants,” the corporate defined.
The MMLU benchmark is offered in a number of languages, together with Arabic, Bengali, Chinese language, French, German, Hindi, Indonesian, Italian, Japanese, Korean, Portuguese, Spanish, Swahili, and Yoruba.
