Ad Image

NVIDIA Introduces Kubernetes Orchestration on Their GPUs

NVIDIA Kubernetes


The recent NVIDIA GPU Technology Conference had a lot of hype surrounding it. There were over 8,500 attendees at this year’s event. There were a lot of important announcements to take away from this conference, but perhaps the most important to DevOps is the NVIDIA Kubernetes orchestration.

Enterprises are moving towards artificial intelligence throughout their technology space. This is happening parallel to the increased interest in hybrid clouds. These Kubernetes GPUs simplify the deployment of AI systems throughout hybrid clouds. This feature works for both on-premises Kubernetes management, or on a cloud like AWS. The primary benefit of the NVIDIA GPU utilizing Kubernetes is that it allows processes to run much faster. Enterprises will be able to keep up with the increased speed of containers more efficiently.


Widget not in any sidebars

NVIDIA CEO, Jensen Huang’s keynote address states, “Kubernetes allows us to take massive workloads that are servicing billions of people. It’s an orchestration layer that orchestrates the workload that’s coming in from the cloud across the resources in the hyperscale infrastructure… Today it is GPU aware and GPU accelerated.”

NVIDIA’s GPUs will increase the efficiency of Kubernetes. In the keynote, Huang shows the speed a Skylake CPU can process images of flowers. It does so at 4.3 images per second. They then show it on a single NVIDIA GPU with Kubernetes and it processes over 870 images per second. They then add replicas into the load balancer, utilizing the Kubernetes software, and process nearly 7,000 images per second.

Huang says, “Kubernetes assigns this pod (service or application housing a lot of containers) on one GPU, on many GPUs in one server, on many GPUs on many servers, it can also assign it across data centers. All of this stuff is happening completely invisibly because we’ve made Kubernetes GPU aware, and NVIDIA architecture and containers are literally everywhere.”

I encourage you to watch the keynote presentation below, it’s incredibly interesting and shows the power of Kubernetes on NVIDIA GPUs.


Widget not in any sidebars

Share This

Related Posts