flyte
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust,
What is flyte?
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
Overview of flyte
What it is
Flyte is an open-source, type-safe distributed orchestration platform for agents, ML pipelines, and real-time inference. It is designed to run on Kubernetes and is written in pure Python with async/await support. Flyte also supports other languages including Rust, Go, and TypeScript. It is a graduated project of the LF AI & Data Foundation.
Key features
- Type-safe orchestration for agents, ML pipelines, and real-time inference.
- Distributed execution on Kubernetes.
- Pure Python with async/await support.
- Support for multiple languages (Rust, Go, TypeScript).
- Local development environment with a TUI (Terminal User Interface) available.
- Model serving capabilities via FastAPI.
- Task environment definition with custom images and dependencies.
Use cases
Flyte can be used for orchestrating machine learning pipelines, running real-time inference on Kubernetes, automating agent workflows, and developing type-safe distributed applications that require async execution.
Getting started
Install the SDK:bashuv pip install flyteFor the full SDK and development tools, see the flyte-sdk repository.
License and pricing
The project is licensed under Apache 2.0. It is open-source.
Based on the project's public README and repository metadata.