Open source repositories tagged with #mixture-of-experts, ranked by health score.
Run a 120B-parameter MoE (60 GB) on a 12 GB phone. CPU-only, lossless, on stock llama.cpp