Would running vLLM in docker work for you, or do you have other requirements? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		omneity 5 months ago \| parent \| context \| favorite \| on: Show HN: Price Per Token – LLM API Pricing Data Would running vLLM in docker work for you, or do you have other requirements?

yieldcrv 5 months ago [–]

its not an image and audio model, so I believe it wouldn't work for me by itself

would probably need multiple models running in distinct containers, with another process coordinating them

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact