Untitled attachment

Dark Visitors maintains a list of AI web agents (chatbots, scrapers, search crawlers) and provides an API for updating your robots.txt

@jonny and I said "mhmm", so we made a github action that regularly creates PRs for our mastodon fork if there's any updates

and here's a version with comments to help you make it work for other websites

consent shouldn't be opt-out, but ai bros are dicks. so here we are

Notices where this attachment appears