Mixture Of Experts

What is a model architecture that uses a sparse approach?

A model architecture that uses a sparse approach in triggering model elements, making it highly performant on certain tasks while remaining computationally efficient.