Hacker News new | past | comments | ask | show | jobs | submit login

They idle at pretty low wattages, and since the bulk of the TDP is rated for raster workloads you usually won't see them running at full-power on compute workloads.

My 300w 3070ti doesn't really exceed 100w during inference workloads. Boot up a 1440p video game and it's a different story altogether, but for inference and transcoding those 3060s are some of the most power efficient options on the consumer market.




Interesting, my 3060 uses 150-170W with 14B model on Ollama, according to nvidia-smi.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: