MoE-Infinity

PyTorch library for cost-effective, fast and easy serving of MoE models.

What is MoE-Infinity?

PyTorch library for cost-effective, fast and easy serving of MoE models.