Already running a model endpoint? What does it take to scale it on Kubernetes?
In five minutes, we walk through how NVIDIA Dynamo handles deployment with scalable workers and an OpenAI-compatible endpoint.
Watch below:
Scaling a model endpoint with NVIDIA Dynamo