“crawler”
111 repositories, including 77 with fewer than two releases. Show released plugins only
WP-Script importer for WordPress: bulk and scheduled video imports from AVDB API and xvidapi into WP-Script themes.
VidMov importer for WordPress: imports videos, thumbnails and metadata from AVDB API into the VidMov theme.
Eroz theme importer for WordPress: scheduled video imports from AVDB API and xvidapi with full meta-field mapping.
DooPlay importer for WordPress: scheduled imports of titles, posters, metadata and players from AVDB API.
Complete Really Simple Licensing (RSL) support for WordPress sites. Define machine-readable licensing terms for your content, enabling AI companies, crawlers, and other automated systems to properly license your digital assets.
WordPress plugin for serving AI-optimized Markdown to AI crawlers (Claude, ChatGPT, Perplexity)
Intelligent Open Graph meta tags with automatic image fallback from AVIF/WebP to JPEG/PNG for social media crawlers.
Static HTML caching engine for WordPress. Serve pages at CDN speed from any host — zero PHP execution on cached pages. Smart crawler, dependency graph, Apache/Nginx rules. Premium: ISR, CDN purge (Cloudflare/BunnyCDN/Fastly),…
AI Search Optimization for WordPress and WooCommerce. Generate llms.txt, AI crawler rules and metadata to make your site visible to AI search engines.
WordPress plugin that makes your site ready for AI agents: .md URLs, llms.txt, llms-full.txt, security.txt, api-catalog, Agent Skills discovery, Link response headers, Content Signals, and AI crawler rules in robots.txt
WordPress plugin that rate-limits Facebook/Meta web crawlers to prevent server overload
A Log File Analysis plugin for WordPress
Saman SEO is an all-in-one SEO workflow plugin focused on fast editorial UX and crawler-friendly output.
WordPress plugin: AI-bot crawl-traffic capture for Bluerails Discovery Agent Traffic (BLUE-1346)
WordPress plugin for Valu Search
Maximize site visibility for AI engines — llms.txt, Markdown endpoints, robots.txt AI directives, AI discovery files, and MCP abilities.
WordPress plugin that generates llms.txt and llms-full.txt endpoints for AI/LLM consumption
WordPress plugin that generates llms.txt files for AI crawlers, providing LLM-friendly content in Markdown format. Generative Engine Optimization aka GEO, SEO for AI.
Optimizes your site's robots.txt to reduce server load and CO2 footprint by blocking unnecessary crawlers while allowing major search engines and specific tools.
Wordpress plugin that silently blocks aggressive crawlers using behavior-based detection for logged-out users only.
Plugin is generating "markdown cache" to be able for AI to consume web content
Automatically crawls your frontend pages, posts, and custom post types to detect broken links (404s, 410s, broken redirects, and server errors), logs them with page/section context, and notifies admins on a schedule.
Free WordPress plugin for AI bot traffic analytics
A small plugin to automatically add the AI scraper blocking rules to the robots.txt in WordPress
A WordPress plugin,Automates llms.txt and llms-full.txt generation for AI crawlers while monitoring critical GEO/SEO health signals. - WordPress 插件,可自动生成供 AI 爬虫使用的 llms.txt 和 llms-full.txt 文件。
WordPress sitemaps + AI-readable publishing. XML sitemaps, llms.txt, Markdown, structured discovery, delivery diagnostics, and local crawler analytics.
WordPress plugin to hit the dashboard of every site in a MultiSite network (assists with plugin updates)