Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

we at Valohai (https://valohai.com/) do check all the mentioned feature boxes and do serve a lot of startups

* data stores: automatic download/upload to/from AWS S3, Azure Blob, Google Cloud Storage, OpenStack Swift or stores that implements S3-like interface

* interactive environments: we do have notebook hosting with automatic orchestration

* training: history, comparisons, parameters, hyperparameter tuning with Optuna, Hyperopt or custom optimizer (https://github.com/valohai/optimo); additionally visualizations about training progress and hardware resource monitoring

* serving for production: our deployments allow you to build, push, manage and monitor HTTP/S based services on Kubernetes clusters (https://docs.valohai.com/core-concepts/deployments/) but you can just as easily download your model and deploy it yourself as your use-case requires

* a permission system: we have organization management with teams and such, but your mileage may vary depending how fine grained control you need

* software heritage: all runs are containerized and how they was ran is recorded so everything is reproducible if the base image and data exist at the original source, we also keep track of data heritage (what files X were used to produce these files Y https://valohai.com/patch-notes/2019-09-03/)

* labeling system/UI: full web UI, command line client and a REST API (https://docs.valohai.com/valohai-api/) but no labeling tools though

Essentially your whole machine learning pipeline under one roof; from data preprocessing and training to deployment and monitoring. Also, we are technically agnostic, you can just as easily run Python/Julia/C++ or Unity engine to generate synthetic datasets (https://www.youtube.com/watch?v=QxMuWuk_W10)

not self-service or free though; our technical support team handles all the setup and maintenance

let me know if you have questions about Valohai or MLOps (https://valohai.com/mlops/) in general, I've seen quite a lot of projects and pipelines as I work at Valohai as an ML engineer helping our customers to setup end-to-end ML pipelines



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: