Search
3 results for "mixture of experts"
Products and releases 3
Transformers Release v5.20.0Hugging Face, Oct 15, 2026: Release v5.20.0 New Model additions Muse Spark Open Muse Spark Open is a multimodal mixture-of-experts model from Meta that takes text, images, audio, and video as input and generates text.
Transformers Release: v5.21.0Hugging Face, Oct 26, 2026: Transformers v5.21.0 introduces the MiniCPM-OCR document-understanding model and the Flint mixture-of-experts language model.
Transformers 5.22.0: Mistral Large 4 (Le Chonk)Hugging Face, Oct 29, 2026: Transformers v5.22.0 adds support for Mistral Large 4, a 1-trillion parameter multimodal Mixture-of-Experts model featuring a 1-million token context window.