Well, they've recently (afaict last September) nerfed the client API - my local updater used to fetch 5000 URLs at a time from the API (worked for ~9 years) but now it's 30 returned max per request with tighter rate limits and it'll also randomly just not bother to return any results or a 500 or a 404 regardless of rate limits.