NVIDIA Dynamo in 5 Minutes: Dynamo On Kubernetes for AI Inference
Your model endpoint works for a demo. What does it take to scale it for your team? In this episode of Dynamo in 5 Minutes, we walk through deploying NVIDIA Dynamo on Kubernetes, from defining your serving setup to sending requests to a live endpoint. You’ll learn: • How the Dynamo Operator creates and manages your serving setup • Two deployment paths: describe what you need with DGDR, or customize an existing deployment recipe with DGD • How requests move from an OpenAI-compatible frontend to inference engines such as SGLang, vLLM, or TensorRT-LLM • The full DGDR workflow in a live demo, fro
Discussion
Rejoignez la communauté pour réagir et poser vos questions.
Aucun message pour l'instant. Lancez la discussion !