manifest / search
“crawler” 19
1
Facebook Request Throttle
nadimtuhin/facebook-request-throttle-wordpress-plugin
Performance & Caching
WordPress plugin that rate-limits Facebook/Meta web crawlers to prevent server overload
★ 26stars
2
Automatically crawls your frontend pages, posts, and custom post types to detect broken links (404s, 410s, broken redirects, and server errors), logs them with page/section context, and notifies admins on a schedule.
★ 0stars
38downloads
≈20active
3
Saman SEO is an all-in-one SEO workflow plugin focused on fast editorial UX and crawler-friendly output.
★ 4stars
55downloads
4
WordPress plugin: AI-bot crawl-traffic capture for Bluerails Discovery Agent Traffic (BLUE-1346)
★ 0stars
23downloads
≈10active
5
A Log File Analysis plugin for WordPress
★ 4stars
19downloads
≈10active
6
WordPress plugin for Valu Search
★ 2stars
88kcomposer
7
Maximize site visibility for AI engines — llms.txt, Markdown endpoints, robots.txt AI directives, AI discovery files, and MCP abilities.
★ 0stars
6downloads
23composer
8
Optimizes your site's robots.txt to reduce server load and CO2 footprint by blocking unnecessary crawlers while allowing major search engines and specific tools.
★ 11stars
9
WordPress Plugin: The GUI create a flow for crawler to migrate or crawl data from other sources: web, rss, xml, csv or more
★ 1stars
2composer
10
OptiGraph SEO is a WordPress SEO plugin for technical SEO, schema.org/JSON-LD, XML sitemaps, redirects, Open Graph, WooCommerce SEO, content and link analysis, site audits, AEO/GEO and AI search optimization. Includes llms.txt, AI…
★ 1stars
11
Zie welke AI-crawlers je WordPress-pagina's ophalen en zet in robots.txt wat ze met je content mogen. Zelf gehost, geen uitgaand verzoek, geen IP-adres. Gratis GPL-plugin van theseo.nl.
★ 0stars
1downloads
12
指定されたニュースソースから記事を自動取得し、WordPressサイトに投稿として追加します。YouTube動画クロール機能も含まれています。
★ 0stars
13
Inspect crawler-facing HTTP, indexability, sitemap, structured-data and migration evidence from inside WordPress.
★ 0stars
15
The best scraping solution for WooCommerce
★ 6stars
16
WordPress Intelligent Web Crawler, Role-Based Content & Image Automation Engine (DeepSeek, Gemini, OpenAI, Claude, Groq & Ollama) | Muzaffer Ulusoy (ulusoydigital.com)
★ 0stars
17
ruiji scraper wordpress plugin
★ 4stars
18
A Simple Robots.txt Manager Plugin For Wordpress.
★ 1stars
19
Rubik's Link Analyser is a WordPress plugin for analysing and monitoring links in your articles. It classifies links as internal, external, follow, nofollow and sponsored, and detects errors such as 404s or…
★ 0stars