memra

memra is a Rust + CUDA inference engine built for NVIDIA RTX PRO 6000 Blackwell and RTX 5090. It serves GGUF models over an OpenAI-compatible API, and every def

What is memra?

memra is a Rust + CUDA inference engine built for NVIDIA RTX PRO 6000 Blackwell and RTX 5090. It serves GGUF models over an OpenAI-compatible API, and every default it ships was measured on those two cards — both Blackwell sm_120a, with a separately compile-gated Hopper/H100 (sm_90a) lane alongside.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/avifeneshmemra.svg)](https://yunodb.com/tools/avifeneshmemra?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/avifeneshmemra?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/avifeneshmemra.svg" alt="Featured on YunoDB" height="20"></a>