Install
Upload it under Plugins → Add New Plugin → Upload Plugin, then activate.
Install straight from GitHub with WP-CLI:
wp plugin install https://github.com/sashmarin/juliepr-robots-txt-disallow/releases/download/juliepr-robots-txt-disallow%401.0.0/juliepr-robots-txt-disallow-1.0.0.zipWordPress plugin that adds Disallow: / rules for selected crawlers to the virtual robots.txt generated by WordPress.
Use
- Install and activate the plugin.
- Open Settings → robots.txt Disallow.
- Add one User-Agent name per line, then save.
For example, entering GPTBot creates:
User-agent: GPTBot
Disallow: /
On Multisite, the setting is stored per site. Network activation is supported; each subsite administrator with the manage_options capability configures its own list.
Uninstalling
The saved list is retained by default. To remove it, enable Delete settings when the plugin is deleted before deleting the plugin. In Multisite, this choice and the deletion are evaluated separately for every site.
Localization
English is the source language. Russian translations are included as a .po source catalog and a WordPress 6.5+ PHP translation file (.l10n.php). No .mo file is shipped.
Notes
This only changes WordPress's virtual robots.txt response. If a physical robots.txt exists in the site's document root, the web server may serve that file instead.
Releases
1 release. Each count is every asset in that release; expand a row for the breakdown.