Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Any idea what the query engine/translation layer they are using is? I'm assuming there is something like Presto underneath it, but quite curious.


I'm with the team that built this. It's actually a new purpose-built engine, optimized for near real-time availability of large scale volumes of log data. It supports an unbounded number of fields across log records, and doesn't require the definition of a schema or dealing with data types at setup/ingestion time. Compute and storage are separate, which is what allows queries to address data from any time window. There is no limit on the data retention period.


We would all be exceptionally interested in more technical details about this.

Particularly if you compare to other approaches, talk about technical tradeoffs made, etc.


The pricing model actually sounds a little like Athena.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: