“crawl” 61

Complete Really Simple Licensing (RSL) support for WordPress sites. Define machine-readable licensing terms for your content, enabling AI companies, crawlers, and other automated systems to properly license your digital assets.

Intelligent Open Graph meta tags with automatic image fallback from AVIF/WebP to JPEG/PNG for social media crawlers.

WordPress plugin that rate-limits Facebook/Meta web crawlers to prevent server overload

Automatically crawls your frontend pages, posts, and custom post types to detect broken links (404s, 410s, broken redirects, and server errors), logs them with page/section context, and notifies admins on a schedule.

Saman SEO is an all-in-one SEO workflow plugin focused on fast editorial UX and crawler-friendly output.

WordPress plugin: AI-bot crawl-traffic capture for Bluerails Discovery Agent Traffic (BLUE-1346)

WordPress plugin: AI-bot crawl-traffic capture for Bluerails Discovery Agent Traffic (BLUE-1346)

A Log File Analysis plugin for WordPress

Block junk search traffic, harden public endpoints, and manage crawl-facing protection rules from one admin page.

WordPress plugin that generates llms.txt and llms-full.txt endpoints for AI/LLM consumption

WordPress plugin for Valu Search

Maximize WordPress site visibility for AI engines (LLMs, AI search, AI agents)

Plugin is generating "markdown cache" to be able for AI to consume web content

Plugin is generating "markdown cache" to be able for AI to consume web content

Free WordPress plugin for AI bot traffic analytics

WordPress plugin that adds Disallow rules for selected crawlers to the virtual robots.txt generated by WordPress

Safely manages website-use preference signals in a physical robots.txt file.

WordPress security and traffic intelligence plugin for observing suspicious requests, crawlers, and automated traffic.

A small plugin to automatically add the AI scraper blocking rules to the robots.txt in WordPress

WordPress plugin that makes a site discoverable, readable and operable by AI agents: Markdown delivery, Content Signals, AI crawler rules, llms.txt and agent manifests.

Optimizes your site's robots.txt to reduce server load and CO2 footprint by blocking unnecessary crawlers while allowing major search engines and specific tools.

A powerful WordPress plugin for data migration and web crawling using Rake 2.0 framework

OptiGraph SEO is a WordPress SEO plugin for technical SEO, schema.org/JSON-LD, XML sitemaps, redirects, Open Graph, WooCommerce SEO, content and link analysis, site audits, AEO/GEO and AI search optimization. Includes llms.txt, AI…

Plugin WordPress pour surveiller les visites des robots SEO et GEO/AI sur votre site.

WordPress sitemaps + AI-readable publishing. XML sitemaps, llms.txt, Markdown, structured discovery, delivery diagnostics, and local crawler analytics.

Export your WordPress site as static HTML files. Crawls every page like a browser and saves a complete static copy with all referenced assets.

Zie welke AI-crawlers je WordPress-pagina's ophalen en zet in robots.txt wat ze met je content mogen. Zelf gehost, geen uitgaand verzoek, geen IP-adres. Gratis GPL-plugin van theseo.nl.

WordPress plugin that emits canonical permalinks for shortlink output

WordPress plugin that generates llms.txt and llms-full.txt files for AI/LLM accessibility and SEO optimization