OpenAssembler
Open source compiler for your whole ML repo (support python, CUDA C/C++) into sass and cuda binary (which are closed sourced by Nvidia); 3-40% faster than Opena
What is OpenAssembler?
Open source compiler for your whole ML repo (support python, CUDA C/C++) into sass and cuda binary (which are closed sourced by Nvidia); 3-40% faster than Openai Triton for Neural Network (primarily LLM) based training/inferencing
Overview of OpenAssembler
What it is
OpenAssembler is an open source compiler that translates Python models and GPU kernels into native NVIDIA SASS and cubins. It targets A100/SM80 architecture and includes its own instruction selection, register allocation, scheduling, and machine-code encoder. The project is under active development and supports Python 3.12+ on Linux and macOS.
Key features
- Compiles Python model repositories, Python GPU kernels, CUDA C/C++/C device sources, and PTX into SASS and cubin binaries
- Supports local, SSH, and Modal cloud backends for compilation and execution
- Includes automatic model discovery that infers model class, input shapes, and configuration without requiring a TOML file
- Provides native model compilation for torch.nn.Module with supported operators including linear layers, softmax, GELU, LayerNorm, and attention
- Offers GEMM generation with measured tile, pointer, fragment, and traversal policies plus optional A100 autotuning
- Includes a SASS emulator and PTX interpreter for offline semantic checks
Use cases
OpenAssembler is designed for compiling ML repositories into native GPU binaries for training and inference. It can be used to compile Python models and GPU kernels, inspect generated code, and run saved artifacts locally, over SSH, or on Modal. The project is particularly focused on neural network workloads, primarily LLM-based training and inferencing.
Getting started
shgit clone https://github.com/lucialuka/OpenAssembler.gitcd OpenAssemblerpython3 -m venv .venvsource .venv/bin/activatepython -m pip install -e '.[modal]'openassembler welcomeOr install via Homebrew:shbrew tap lucialuka/openassembler https://github.com/lucialuka/OpenAssemblerbrew install openassemblermodal setup
License and pricing
OpenAssembler is licensed under Apache-2.0 and is open source.
Based on the project's public README and repository metadata.