Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The web indexes from Google and Bing are available publicly? I can pull it down from somewhere and try to make a search engine?


Bing at least license their indexes to partners on a commercial basis, as did Yahoo until they gave up indexing the web. I am sure that the NSA, the Chinese government, the ahrefs website, and other organizations have comprehensive indexes of the web which they don't share in this way.

Mojeek seems to be the independent, non-paywalled search engine with the biggest index, for an overview see https://seirdy.one/posts/2021/03/10/search-engines-with-own-...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: