Is it possible to fine-tune using CPU only? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		sea_temple on March 22, 2023 \| parent \| context \| favorite \| on: Show HN: Finetune LLaMA-7B on commodity GPUs using... Is it possible to fine-tune using CPU only?

lxe on March 22, 2023 | [–]

I haven't tried it myself, and I haven't actually heard anyone attempt doing it with a model this large.

kiraaa on March 22, 2023 | [–]

you could but it will be very slow. oh and make sure the code is cpu compatible.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact