Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
The looming (storage) bandwidth wall (scalability.org)
11 points by timf on Sept 21, 2009 | hide | past | favorite | 2 comments


Retrieving data to process and storing back to some giant "storage units" are becoming more and more obsolete. The future is google style: data is replicated and backed up at all times and you push computation to data to explore data locality.


Mitigate this by keeping redundant copies on multiple servers, avoiding having similar servers with largely the same set of chunks.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: