https://git.sr.ht/robots.txt > YandexBot is a dickhead, too aggressive > User-ag... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		paulcarroty on Jan 9, 2023 \| parent \| context \| favorite \| on: Sourcehut will blacklist the Go module mirror https://git.sr.ht/robots.txt > YandexBot is a dickhead, too aggressive > User-agent: Yandex > Disallow: / Hahaha.

n8ta on Jan 10, 2023 [–]

# Used for Alexa, I guess, who cares

User-agent: Amazonbot

Disallow: /

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact