With the intention to assist builders globally perceive massive language fashions (LLMs) higher, the corporate has funded and revealed an expert translation of the Large Multitask Language Understanding (MMLU) benchmark in 14 languages through Hugging Face.
“Supporting those that (builders) perceive the distinctive cultures, economies, and social dynamics of their communities will assist be certain that AI purposes are tailor-made to satisfy native wants,” the corporate defined.
The MMLU benchmark is accessible in a number of languages, together with Arabic, Bengali, Chinese language, French, German, Hindi, Indonesian, Italian, Japanese, Korean, Portuguese, Spanish, Swahili, and Yoruba.