TensorFold

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint

What is TensorFold?

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint