I have and continue to take approach IV and VIII[0], and its worked very well for me. Especially now that my research is investigating LLMs[1], scaling down and using architectures that focus on performance is paying dividends.
Working in a niche applications (molecular biology) is also a great way to remain sane (although it comes with its own problems).
I have and continue to take approach IV and VIII[0], and its worked very well for me. Especially now that my research is investigating LLMs[1], scaling down and using architectures that focus on performance is paying dividends.
Working in a niche applications (molecular biology) is also a great way to remain sane (although it comes with its own problems).
[0] "Scale down" and "Small models"
[1] Well, "large" is a relative term here.