Meta Just Dropped an 816 Billion Parameter AI Anyone Can Download and It Only Needs 2 Mac Studios to Run
TL;DR: Meta just open-sourced a 816 billion parameter AI model called Muse Spark Open. It uses a Mixture of Experts architecture so only 42 billion parameters activate per request, and you can run the whole thing locally on two Apple M5 Ultra Mac Studios. Commercial use has restrictions but the weights are free to download today.
I had to re-read this headline three times before I believed it. Meta dropped an 816B parameter model and just let anyone download it.
For context: most of the biggest open models out there cap out around 70 billion parameters. GPT-4 is estimated somewhere north of a trillion but is locked behind an API. And here is Meta putting something in the same weight class onto the internet for free.
What Is Muse Spark Open
Meta calls it Muse Spark Open. It is a Mixture of Experts model, which means not all 816 billion parameters run at once. When you send a prompt, the model activates a routing layer that picks which specialist sub-networks to use. For Muse Spark Open that comes out to about 42 billion active parameters per request. That is still a big model but it is not the absolutely crushing compute requirement the headline suggests.
MoE has been the architecture behind some of the best recent releases including Mistral's Mixtral and reportedly GPT-4 itself. Meta took that playbook and scaled it way up.
The Hardware Story
Meta says the reference setup for running the full model is two Apple M5 Ultra Mac Studios connected via Thunderbolt. That is roughly 384 GB of unified memory between the two machines. The model weights at 4-bit quantization land around 400 GB so you are right at the limit, which is tight but apparently workable.
If you want to run it at full precision (16-bit) you are looking at a proper GPU cluster. But the quantized version on two Mac Studios is a real use case that a small studio or indie developer could actually pull off. A pair of M5 Ultra Mac Studios is not cheap but it is not hyperscaler territory either.
What It Is Good At
Meta is positioning Muse Spark as a general reasoning and generation model. Early benchmarks from the community are putting it close to GPT-4o on most standard evals. Coding, math, and long document summarization all look competitive. Creative writing quality is getting a lot of positive comments in the early test threads I have been following.
The model supports a 128K context window, which gives it serious reach for document analysis tasks. That is on par with what you get from the frontier API models.
The License Details Matter
This is where it gets a little complicated. The weights are free to download and you can run the model locally as much as you want. The commercial restrictions kick in at scale: if your product or service reaches more than 700 million monthly active users you need to go back to Meta for a special commercial license. For basically every startup or independent developer that threshold is not a concern.
There is also a clause prohibiting use in certain regulated industries without additional agreements. It is similar to what Llama models have had in previous versions. Not truly permissive open source, but dramatically more open than anything else at this parameter count.
Why Meta Keeps Doing This
Meta has been the most aggressive big tech company in open sourcing AI. Every Llama release has pushed the open source baseline higher. This is partly strategic: a world where everyone builds on Meta infrastructure and model weights means more engagement, more data feedback loops, more talented researchers who know Meta tools.
But it also puts real competitive pressure on the closed model providers. Hard to charge premium API prices when a comparable model is free to run locally.
How to Get It
The weights are on Hugging Face under the meta-ai organization. The model card has the quantization instructions and the recommended hardware configs. The community has already started building Ollama and llama.cpp integrations so you will not need to write much infrastructure yourself.
What's your experience? Drop a comment below! 👇
Have you tried running any of Meta's open models locally? What hardware are you running them on and what are you using them for?
#MetaAI #MuseSpark #OpenSourceAI #AI #LLM #ArtificialIntelligence #MacStudio #TechNews #AIModel #MixtureOfExperts
Comments
Post a Comment