I first saw Ling-3.0-flash described as a “124B-A5B” model in an NVIDIA developer forum. It is a compelling headline, but the deployment discussion underneath it is a useful lesson in what “active parameters” does and does not mean. The official specification is 124B total parameters and 5.1B activated per token. Its MoE has 512 routed experts and activates 8 of them per token. That helps explain the compute path. It does not mean the machine only needs to store 5.1B parameters. The official single-DGX-Spark INT4 guide says the quantized weights occupy roughly 72 GB on a GB10 system with 121 GB of unified memory. The rest of the practical budget still has to absorb the runtime, KV and recurrent state, context length, concurrency, temporary allocations and the operating system. That gives me a more useful way to read MoE headlines: Total parameters describe the model that must be represented in memory or storage. Active parameters describe how much of the routed network participates in each token. Quantization changes memory use and may change quality. Runtime and kernel support determine whether the theoretical efficiency appears on this hardware. Context and concurrency determine how much room is left after the weights load. The forum thread showed all five layers interacting. The same checkpoint produced a retracted short benchmark, a better hard-mode score, long-prompt slowdown, an OOM report, and later more positive results after the software and quantization paths changed. Would model releases be easier to evaluate if every MoE card reported three separate numbers up front: active compute, installed weight size, and measured context/concurrency on named hardware? submitted by /u/Sitkin_Marrel
Originally posted by u/Sitkin_Marrel on r/ArtificialInteligence