Meta releases Muse Spark Open with 816 billion parameters

Meta released Muse Spark Open on October 15, making its model weights available for download. The company designed the model for software development, reasoning and tasks that require several steps..

The model contains 816 billion parameters, with 42 billion active when processing each token. It accepts text, images, audio and video, produces text responses and supports about one million tokens of context. Its mixture-of-experts architecture activates selected components, although hosting still requires memory for the full model..

Downloadable weights give developers the option to customize the model and operate it on their own infrastructure. Meta said the model can also run across two Mac Studio computers equipped with Apple's M5 Ultra chips using MLX. The release uses Meta's Muse Model License, which includes commercial restrictions..

Developers can obtain the weights through Hugging Face or access hosted versions through providers including Groq, Together AI and Fireworks AI. Meta said it had completed release evaluations under its safety framework and would publish a fuller evaluation report later..