Should take a look at flatbuffers. It’s an evolution of protobuf that’s super optimized for querying sunsets of data. Basically lookup of offsets and mmap all the way.