There is rate limiting and also some regularity testing, e.g., one site would only let me download if I scheduled randomly and less than a certain frequency.