MoE vs. dense models: What you need to know before picking a model

Saw a comment online about Models getting dumber or Model Labs trying to just pass benchmark as a tradeoff for losing some capabilities. This brings back memory of model selection in early days where