Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
cudder
on May 14, 2023
|
parent
|
context
|
favorite
| on:
Run Llama 13B with a 6GB graphics card
The Mac's "integrated memory" means it's shared between the CPU and GPU. So the GPU can address all of that and you can load giant (by current consumer GPU standards) models. I have no idea how it actually performs though.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: