“crawl”
136 repositories, including 97 with fewer than two releases. Show released plugins only
WP-Script importer for WordPress: bulk and scheduled video imports from AVDB API and xvidapi into WP-Script themes.
VidMov importer for WordPress: imports videos, thumbnails and metadata from AVDB API into the VidMov theme.
Eroz theme importer for WordPress: scheduled video imports from AVDB API and xvidapi with full meta-field mapping.
DooPlay importer for WordPress: scheduled imports of titles, posters, metadata and players from AVDB API.
Complete Really Simple Licensing (RSL) support for WordPress sites. Define machine-readable licensing terms for your content, enabling AI companies, crawlers, and other automated systems to properly license your digital assets.
WordPress plugin for serving AI-optimized Markdown to AI crawlers (Claude, ChatGPT, Perplexity)
Intelligent Open Graph meta tags with automatic image fallback from AVIF/WebP to JPEG/PNG for social media crawlers.
Static HTML caching engine for WordPress. Serve pages at CDN speed from any host — zero PHP execution on cached pages. Smart crawler, dependency graph, Apache/Nginx rules. Premium: ISR, CDN purge (Cloudflare/BunnyCDN/Fastly),…
AI Search Optimization for WordPress and WooCommerce. Generate llms.txt, AI crawler rules and metadata to make your site visible to AI search engines.
WordPress plugin that makes your site ready for AI agents: .md URLs, llms.txt, llms-full.txt, security.txt, api-catalog, Agent Skills discovery, Link response headers, Content Signals, and AI crawler rules in robots.txt
WordPress plugin that rate-limits Facebook/Meta web crawlers to prevent server overload
A Log File Analysis plugin for WordPress
Saman SEO is an all-in-one SEO workflow plugin focused on fast editorial UX and crawler-friendly output.
Advanced Crawling Add-on for WP2Static
WordPress plugin: AI-bot crawl-traffic capture for Bluerails Discovery Agent Traffic (BLUE-1346)
Block junk search traffic, harden public endpoints, and manage crawl-facing protection rules from one admin page.
WordPress plugin for Valu Search
Maximize WordPress site visibility for AI engines (LLMs, AI search, AI agents)
WordPress plugin that generates llms.txt and llms-full.txt endpoints for AI/LLM consumption
WordPress plugin that generates llms.txt files for AI crawlers, providing LLM-friendly content in Markdown format. Generative Engine Optimization aka GEO, SEO for AI.
Optimizes your site's robots.txt to reduce server load and CO2 footprint by blocking unnecessary crawlers while allowing major search engines and specific tools.
Wordpress plugin that silently blocks aggressive crawlers using behavior-based detection for logged-out users only.
Plugin is generating "markdown cache" to be able for AI to consume web content
Automatically crawls your frontend pages, posts, and custom post types to detect broken links (404s, 410s, broken redirects, and server errors), logs them with page/section context, and notifies admins on a schedule.
Free WordPress plugin for AI bot traffic analytics
A WPGraphQL extension for SmartCrawl.