It's an interesting question. I'm not sure we really know yet what the right mix...

jph00 on March 9, 2024 | parent | context | favorite | on: Fine tune a 70B language model at home

It's an interesting question. I'm not sure we really know yet what the right mix of RAG and fine tuning is. IMO small-scale fine tuning might be under-appreciated.