sample-genai-on-eks-starter-kit
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ๐ AI Gateway (LiteL
What is sample-genai-on-eks-starter-kit?
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ๐ AI Gateway (LiteLLM) ๐ค LLM Serving (vLLM, SGLang, Ollama) ๐ Vector Databases, ๐ Embedding Models (TEI) ๐ Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
