TensorFold
Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint
What is TensorFold?
Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint
Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint
Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint