For instance used it in conjunction with llama-index for knowledge management. C... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		instance on May 14, 2023 \| parent \| context \| favorite \| on: Run Llama 13B with a 6GB graphics card For instance used it in conjunction with llama-index for knowledge management. Created an index for a whole confluence/jira of a mid-sized company, got good results with GPT, but for LLaMA of this size that use case was too much.

dzhiurgis on May 14, 2023 | [–]

I'd argue 1k per month for mid-sized company is nothing, but I can understand where you are coming from.

sroussey on May 14, 2023 | [–]

Did you try instructor-xl? It ranks highest on huggingface.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact