exciting! maybe we will see that land in llama.cpp eventually, who knows! | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		rain1 on May 14, 2023 \| parent \| context \| favorite \| on: Run Llama 13B with a 6GB graphics card exciting! maybe we will see that land in llama.cpp eventually, who knows!

juliangoldsmith on May 14, 2023 [–]

llama.cpp has CLBlast support now, though I haven't used it yet.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact