Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yep. It’s expensive to spin up an A100 80GB instance but not THAT expensive. Oracles cloud offering (first thing to show up in google search I know you probably won’t use them and it seems extra expensive) is $4.00 per hour. If you are motivated to screw around with this stuff there’s definitely options.


> If you are motivated to screw around with this stuff there’s definitely options.

Erm, for inference that is. Training is definitely out of question for individuals I believe (unless you use much smaller models?).


GCP spot price for A100 80g gpu is only $1.25 and they give you $300 of credit when you open a new acc


Unless its for something you want to happen whenever and don't mind be dumped in process, shouldn't we look at on-demand, not spot, prices?


It’s fine for testing it out or serving short queries. Your data can still remain on PV if the vm gets yanked




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: