WP Manifestindependent plugin directory
manifest / search

“crawler”

8 plugins with two or more releases. Show all 15

1

Intelligent Open Graph meta tags with automatic image fallback from AVIF/WebP to JPEG/PNG for social media crawlers.

by ROBOTSTXT SEO & Metadata 1.2.2 · 1mo ago on git.robotstxt.es ↻ updates itself
★ 0169≈40
2

WordPress plugin that rate-limits Facebook/Meta web crawlers to prevent server overload

by Nadim Tuhin Performance & Caching v3.0 · 3mo ago ↻ updates itself
★ 25
3

WordPress plugin: AI-bot crawl-traffic capture for Bluerails Discovery Agent Traffic (BLUE-1346)

by Bluerails Analytics & Tracking v1.3.2 · 1mo ago ↻ updates itself
★ 029≈10
4

Plugin is generating "markdown cache" to be able for AI to consume web content

by Jitka Klingenbergová AI 1.4.1 · 1mo ago ↻ updates itself
★ 3
5

Automatically crawls your frontend pages, posts, and custom post types to detect broken links (404s, 410s, broken redirects, and server errors), logs them with page/section context, and notifies admins on a schedule.

by KW Developers SEO & Metadata 26.09.06 · 1mo ago ↻ updates itself
★ 083
6

Safely manages website-use preference signals in a physical robots.txt file.

by BlogLogistics SEO & Metadata v1.2.0 · 1mo ago ↻ updates itself
★ 026
7

AI SEO Readiness Auditor | JJSC IT Solutions Internship Developed a custom WordPress plugin to evaluate how effectively AI agents (LLM crawlers) can index and interpret website content.

by CJay D Acopra SEO & Metadata v2.1.3 · 8mo ago ↻ updates itself
★ 018