MoE - I'm a bit confused about 'Experts' [D]

I've been doing some reading about Mixture of Experts (MoE) models, and how they penalise the models to ensure that the distribution of activations are equal across all X experts.

Now that being said, is it reasonable to say that it isn't a "This is the Maths expert, and that's the Science expert", but rather a black box of optimised sub-models trained on lots training data to target different dimensions of the input query?

I'm viewing it more as a …

distribution expert experts isn machinelearning maths mixture of experts moe reading