Where are people finding GPU capacity?

Is it just me or is GPU capacity surprisingly hard to find right now , even in Spot pools? I’ve been trying to get H100s and the Spot pools I’ve checked are pretty much always full.

I ended up trying MI350/MI355s on DigitalOcean Spot and have been running them for about a week without getting interrupted. Curious if anyone else has tried them? How often are you actually getting reclaimed?

Also, where are you guys finding capacity these days?

5 points | by adilhafeez 1 day ago

2 comments

  • franc11 1 day ago
    Vast.ai has some u could check out
  • aamir424 15 hours ago
    Spot GPU capacity at DO has not disappointed me so far , best thing is the 2 hour reclaim window the fact that I can checkpoint while running our training workloads on the beefy Mi355x is awesome