WP Manifestindependent plugin directory
manifest / search

“crawler”

111 repositories, including 77 with fewer than two releases. Show released plugins only

1

WP-Script importer for WordPress: bulk and scheduled video imports from AVDB API and xvidapi into WP-Script themes.

★ 1379≈80
2

VidMov importer for WordPress: imports videos, thumbnails and metadata from AVDB API into the VidMov theme.

by Avdbapi Content & Publishing V2.3.1 · 1mo ago
★ 1136≈120
3

Eroz theme importer for WordPress: scheduled video imports from AVDB API and xvidapi with full meta-field mapping.

★ 1346≈40
4

DooPlay importer for WordPress: scheduled imports of titles, posters, metadata and players from AVDB API.

by AVDB API Crawler Content & Publishing V1.0.1 · 1mo ago
★ 0163≈150
5

Complete Really Simple Licensing (RSL) support for WordPress sites. Define machine-readable licensing terms for your content, enabling AI companies, crawlers, and other automated systems to properly license your digital assets.

by James W. LePage AI v0.0.5-alpha · 1 year ago
★ 3588
6

WordPress plugin for serving AI-optimized Markdown to AI crawlers (Claude, ChatGPT, Perplexity)

by Third Audience AI v3.6.1 · 4mo ago
★ 2025
7

Intelligent Open Graph meta tags with automatic image fallback from AVIF/WebP to JPEG/PNG for social media crawlers.

by ROBOTSTXT SEO & Metadata 1.2.2 · 1mo ago on git.robotstxt.es ↻ updates itself
★ 0169≈40
8

Static HTML caching engine for WordPress. Serve pages at CDN speed from any host — zero PHP execution on cached pages. Smart crawler, dependency graph, Apache/Nginx rules. Premium: ISR, CDN purge (Cloudflare/BunnyCDN/Fastly),…

by Loka Dwiartara Performance & Caching v1.3.1 · 5mo ago
★ 083≈30
9

AI Search Optimization for WordPress and WooCommerce. Generate llms.txt, AI crawler rules and metadata to make your site visible to AI search engines.

by Made Büro SEO & Metadata v0.7.1 · 7mo ago
★ 30
10

WordPress plugin that makes your site ready for AI agents: .md URLs, llms.txt, llms-full.txt, security.txt, api-catalog, Agent Skills discovery, Link response headers, Content Signals, and AI crawler rules in robots.txt

by Miriam Schwab AI v1.66.0 · 2d ago
★ 683
11

WordPress plugin that rate-limits Facebook/Meta web crawlers to prevent server overload

by Nadim Tuhin Performance & Caching v3.0 · 3mo ago ↻ updates itself
★ 25
13

Saman SEO is an all-in-one SEO workflow plugin focused on fast editorial UX and crawler-friendly output.

by SamanLabs SEO & Metadata v2.0.33 · 7d ago
★ 453
14

WordPress plugin: AI-bot crawl-traffic capture for Bluerails Discovery Agent Traffic (BLUE-1346)

by Bluerails Analytics & Tracking v1.3.2 · 1mo ago ↻ updates itself
★ 029≈10
16

Maximize site visibility for AI engines — llms.txt, Markdown endpoints, robots.txt AI directives, AI discovery files, and MCP abilities.

by AmphiBee SEO & Metadata v1.3.3 · 1mo ago
★ 11077
17

adult-api-crawler-for-videoclub-theme

by VideoClub Theme Team Content & Publishing V2.0.0 · 1 year ago
★ 1135
18

WordPress plugin that generates llms.txt and llms-full.txt endpoints for AI/LLM consumption

by The Growth Project AI v1.3.4 · 9mo ago
★ 141
19

Wordpress Plugin to log search bots visits to Google Analytics

by David Vallejo SEO & Metadata no releases pushed 9 years ago
★ 18
20

WordPress plugin that generates llms.txt files for AI crawlers, providing LLM-friendly content in Markdown format. Generative Engine Optimization aka GEO, SEO for AI.

by vaneavasco SEO & Metadata v1.0.1 · 10mo ago
★ 32
21

Optimizes your site's robots.txt to reduce server load and CO2 footprint by blocking unnecessary crawlers while allowing major search engines and specific tools.

by Joost de Valk SEO & Metadata no releases pushed 1 year ago
★ 11
22

Wordpress plugin that silently blocks aggressive crawlers using behavior-based detection for logged-out users only.

by Creative Applications Network Security no releases pushed 7mo ago
★ 6
23

Plugin is generating "markdown cache" to be able for AI to consume web content

by Jitka Klingenbergová AI 1.4.1 · 1mo ago ↻ updates itself
★ 3
24

Automatically crawls your frontend pages, posts, and custom post types to detect broken links (404s, 410s, broken redirects, and server errors), logs them with page/section context, and notifies admins on a schedule.

by KW Developers SEO & Metadata 26.09.06 · 1mo ago ↻ updates itself
★ 083
26

WordPress plugin that crawl your website to report seo links.

by Ahmad Wael SEO & Metadata v1.0.0 · 3 years ago
★ 26
27

A small plugin to automatically add the AI scraper blocking rules to the robots.txt in WordPress

by Andrew Norcross SEO & Metadata no releases pushed 1 year ago
★ 6
28

A WordPress plugin,Automates llms.txt and llms-full.txt generation for AI crawlers while monitoring critical GEO/SEO health signals. - WordPress 插件,可自动生成供 AI 爬虫使用的 llms.txt 和 llms-full.txt 文件。

by SatoMini SEO & Metadata v1.0.0 · 6mo ago
★ 2
29

WordPress sitemaps + AI-readable publishing. XML sitemaps, llms.txt, Markdown, structured discovery, delivery diagnostics, and local crawler analytics.

by Aleksandr Oreshkin SEO & Metadata v8.0.3 · never
★ 029
30

WordPress plugin to hit the dashboard of every site in a MultiSite network (assists with plugin updates)

by Jason Lemahieu Multisite & Networks no releases pushed 12 years ago
★ 7
Page 1 of 4Next →