Documentation
ScraperBlock
Quick Start

Quick Start

Open Settings

Go to Settings → ScraperBlock.

Check protection is on

Enable Protection, robots.txt Blocking and noai / Meta Tags are on by default - leave them on.

Decide on AI search bots

If you want your site to appear in ChatGPT, Perplexity or Mistral answers, turn on Allow AI Search Bots. AI training crawlers stay blocked either way.

Add your own bots (optional)

Enter extra user-agent patterns under Custom User-agents, one per line.

Save

Click Save Settings.

Verify

Visit your site as a normal visitor and confirm pages load normally. Blocked bots appear on the Logs tab and in the Blocked bots in last 24 hours dashboard widget.