18.04.2024

Dark Visitors

A Kirby plugin to block AI crawler

This Kirby plugin utilizes the Dark Visitors API to create a robots.txt file that (theoretically) prevents common AI crawlers from scraping your website. Additionally, sitemaps and custom rules can be added. Installation via the usual methods, the plugin is free.

Dark Visitors

Dark Visitors blocks unwanted AI Crawlers from your website using robots.txt. It uses the Dark Visitors API to identify and block unwanted visitors.

Dark Visitors
With this Kirby plugin, you can prevent AI crawlers from visiting your own site.
Related Pages
This is how I show related pages under every post on my site.
Tracking and blocking of Bots and Crawlers
The Darkvisitors plugin now supports the new tracking feature. This way you can watch crawlers and bots on your site.

Write a comment

Respond elsewhere

This post is not connected to any Mastodon or Bluesky post, please leave a comment instead.

You can also create a new post on your own site and send a webmention. That would be really cool!

Reactions from the Open Web

likes and shares

Replies

Maurice
@gutewebsites weder noch. Es stellt nur eine neue Route zur Verfügung. Gibt es bereits eine robots.txt wird Kirby diese ausliefern, gibt es keine, greift die Route.
André Goldmann
@mauricerenck überschreibt das Plugin bestehende robots.txt oder erweitert es die Datei lediglich. Auf alle Fälle: Schöner Ansatz! 👍