vllm-rlt
A vLLM-inspired inference engine for looped transformers, with loop-level scheduling and execution across composable stages
What is vllm-rlt?
A vLLM-inspired inference engine for looped transformers, with loop-level scheduling and execution across composable stages