AI Engineering Podcast
GPU Clouds, Aggregators, and the New Economics of AI Compute
RunPod came up in “GPU Clouds, Aggregators, and the New Economics of AI Compute” from AI Engineering Podcast.
Quote
Which I would or I would say they're more concierge clouds. Um and that is where Maybe I'll talk to sales and I say, hey, I need sixty-four H one hundreds for the next six months. And they say okay and I wire transfer some money and then they provision the machines and they email me And then finally the I think some of the things that I've got to do. that's also interesting is um there's a GPU aggregator market that I would say is a subset of the GPU cloud market. And these are companies like Shadeform, Vast.ai, RunPod, fluid stack, SF compute, brev dev. There are more. And then also I would point out that a lot of times these business models get mixed so for example run sub run pod and flute stack they do aggregate gps but they also have their own hard Whereas SF Compute primarily aggregates GPUs and does not have their own hardware. Aggregators is just, you know, you go to one place and you can access GPUs from a bunch of different providers. It's something that I never thought would work, just because that's like very counter to how how most people have been using cloud computing. Like most people try to stay in one cloud only. of GPU scarcity and GPU pricing, uh the aggregator model is actually taking off. And I think that's probably And another interesting layer on top of that is
Audio
Starts around 4:10