WP Manifestindependent plugin directory
manifest / search

“crawler”

111 repositories, including 77 with fewer than two releases. Show released plugins only

31

Safely manages website-use preference signals in a physical robots.txt file.

by BlogLogistics SEO & Metadata v1.2.0 · 1mo ago ↻ updates itself
★ 026
32

The best scraping solution for WooCommerce

by Nguyen Quan eCommerce no releases pushed 2 years ago
★ 6
33

Scans through a few APIs to generate a list of all languages/members

by Marko Heijnen Languages & Localization no releases pushed 11 years ago
★ 6
34

WordPress plugin that adds Disallow rules for selected crawlers to the virtual robots.txt generated by WordPress

by Sergei Ashmarin SEO & Metadata juliepr-robots-txt-disallow@1.0.0 · 1mo ago
★ 11
35

WordPress SEO plugin that bulk-applies title tag and meta description fixes to Yoast SEO, Rank Math, SEOPress or AIOSEO from the Crawl Cove desktop crawler, with a change log and one-click revert

by Crawl Cove SEO & Metadata v0.10.8 · 19h ago
★ 019
36

WordPress plugin blocking AI Bots

by Jörn Lund Security 0.0.1 · 1 year ago ↻ updates itself
★ 12
37

AI SEO Readiness Auditor | JJSC IT Solutions Internship Developed a custom WordPress plugin to evaluate how effectively AI agents (LLM crawlers) can index and interpret website content.

by CJay D Acopra SEO & Metadata v2.1.3 · 8mo ago ↻ updates itself
★ 018
38

WordPress Plugin: The GUI create a flow for crawler to migrate or crawl data from other sources: web, rss, xml, csv or more

by Puleeno Nguyen Updates & Deployment 1.1 · 1 year ago
★ 12
39

WordPress security and traffic intelligence plugin for observing suspicious requests, crawlers, and automated traffic.

by IAQ Security v0.4.1 · 2mo ago
★ 1
40

A privacy-focused WordPress analytics plugin providing visitor statistics, crawler insights, device analytics, and real-time monitoring without external services.

by Psydox Analytics & Tracking v2026.06.01.2150 · 4mo ago
★ 09
41

WordPress用プラグイン アクセスを精密に制御する管理者向けプラグイン。Advanced access control plugin for administrators.

by donnma Security v4.0.1 · 7mo ago
★ 1
42

ruiji scraper wordpress plugin

by ruijiscraper Content & Publishing no releases pushed 7 years ago
★ 4
43

Track WordPress AI Bot visits in a simple admin dashboard.

by Codeboxr Analytics & Tracking 1.0.1 · 8mo ago
★ 08
44

WordPress plugin: charge AI crawlers and bots per page with x402 USDC micropayments on Base, paid straight to your wallet. Humans and verified search engines read free. Bot analytics in wp-admin.

by ForgeMesh Labs AI v0.2.2 · 5d ago
★ 07
45

Wordpress plugin that tracks AI bots visiting your website

by Piotr Cichosz Analytics & Tracking no releases pushed 7mo ago
★ 2
46

RankSage Connect — WordPress plugin: AI-crawler visit capture, the RankSage tracking tag and IndexNow key serving for sites connected to RankSage

by RankSage SEO & Metadata v1.2.2 · 19d ago
★ 05
47

WordPress plugin that makes a site discoverable, readable and operable by AI agents: Markdown delivery, Content Signals, AI crawler rules, llms.txt and agent manifests.

by Mao Rodriguez AI v1.0.3 · 1mo ago
★ 05
48

WordPress plugin: forces collapsed panels open for search engine crawlers

by Def Dog Productions SEO & Metadata v1.0.0 · 5mo ago
★ 04
50

WordPress member directory for ChamberOrganizer / ECTownUSA chambers — server-rendered member pages, schema.org, sitemap and llms.txt for SEO and AI crawlers.

by Chamber Nation Users & Membership v1.0.0 · 23d ago ↻ updates itself
★ 02
51

Plugin WordPress pour surveiller les visites des robots SEO et GEO/AI sur votre site.

by Erwan Tanguy SEO & Metadata no releases pushed 1mo ago ↻ updates itself
★ 1
52

Ozi AI Crawler — WordPress plugin for auto-crawl multi-source → AI rewrite (JSON-strict) → drip publish. PHP 8.1+, Action Scheduler, hardened security.

by OziCrawler Team AI no releases pushed 5mo ago
★ 1
53

OptiGraph SEO is a WordPress SEO plugin for technical SEO, schema.org/JSON-LD, XML sitemaps, redirects, Open Graph, WooCommerce SEO, content and link analysis, site audits, AEO/GEO and AI search optimization. Includes llms.txt, AI…

by Shahin Ilderemi SEO & Metadata no releases pushed 1mo ago
★ 1
54

WordPress plugin that generates llms.txt and llms-full.txt files for AI/LLM accessibility and SEO optimization

by 柏崎剛 (Tsuyoshi Kashiwazaki) SEO & Metadata no releases pushed 1mo ago
★ 1
55

WordPress网站蜘蛛爬虫日志监控插件

by 老蒋和他的小伙伴 Analytics & Tracking no releases pushed 7mo ago
★ 1
56

WordPress plugin that emits canonical permalinks for shortlink output

by basicus SEO & Metadata v1.0.3 · 1mo ago
★ 01
57

Zie welke AI-crawlers je WordPress-pagina's ophalen en zet in robots.txt wat ze met je content mogen. Zelf gehost, geen uitgaand verzoek, geen IP-adres. Gratis GPL-plugin van theseo.nl.

by TheSEO SEO & Metadata v1.0.0 · 2mo ago
★ 01
58

Naught theme importer for WordPress: scheduled video imports from AVDB API and xvidapi (2.0 build).

by Adult API Crawler For Eroz Theme Content & Publishing no releases pushed 1 year ago
★ 1
59

Collect videos from multiple adult API providers (AVDBAPI, XVIDAPI, etc.) - Eroz Theme Compatibility

by Adult API Crawler For Eroz Theme Media & Images no releases pushed 1 year ago
★ 1
60

A crawl plugin to Extract all internal hyperlinks.

by Riddhish SEO & Metadata no releases pushed 3 years ago
★ 1