sample-genai-on-eks-starter-kit

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: πŸš€ AI Gateway (LiteL

What is sample-genai-on-eks-starter-kit?

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: πŸš€ AI Gateway (LiteLLM) πŸ€– LLM Serving (vLLM, SGLang, Ollama) πŸ“Š Vector Databases, πŸ” Embedding Models (TEI) πŸ“ˆ Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/aws-samplessample-genai-on-eks-starter-kit.svg)](https://yunodb.com/tools/aws-samplessample-genai-on-eks-starter-kit?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/aws-samplessample-genai-on-eks-starter-kit?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/aws-samplessample-genai-on-eks-starter-kit.svg" alt="Featured on YunoDB" height="20"></a>