there are several good articles explaining this, especially on Timescable blog, but in short, without time partitioning and just index, at some given point the performance for reads and writes degrades exponencially.
jasonshen's blog is awesome! And regarging the case, that is basically what my father did. Left a corporate job to run his own small business 25 years ago and he has been much happier ever since.
With many news articles on the North Korean missile that flew over Japan yesterday, one obvious question is not even mentioned: why didn't Japan shoot it down? But an article from 2017, at the timing of the previous occurrence might explain it. Maybe it simply cant'.
This is indeed a hard problem, when you have a country like China, with a long term strategic plan and control over its companies and a country like US in which companies are more focused on keep Wall Street and media happy.
The US government has long had the authority to limit trade with China. Can't blame companies for acting rationally, but you can blame the government for failing to tackling national security threats.
We did a data analytics project for a upper class furniture manufacturer and I was really surprised to hear that they typically cannot afford buying A grade leather because the car industry actually stocks everything. Due to their processing requirements car manufacturers can hardly work around natural defects. The absurdity they said is that the leather in cars is coated below so many layers of plastic coating that it hardly had any properties of real leather anymore. Large hides of high quality leather seem to be actually a serious business rather than a waste product from what I heard.
