Mixture of Experts (Moe)

A technique for scaling Transformers without activating everything.

ResearchUnknown
Visit tool

chizkidd.github.io

About Mixture of Experts (Moe)

Mixture of Experts (Moe) is a technique for scaling Transformers without activating everything. It is described in a blog post on GitHub.

Description summarised by AI from the sources listed below.

Pricing

Pricing model: Unknown — we have not been able to confirm pricing from the official website, so nothing is stated here.

Pricing summarised by AI from the sources listed below.