Auto AI Optimization

A modern, highly-optimized WordPress plugin that prepares your website for AI scrapers, LLMs (Language Models), and AI Agents. It serves two main purposes:

1. Generates a fully spec-compliant /llms.txt file outlining your website architecture.
2. Automatically adds .md endpoints to every post and page on your site, serving clean Markdown instead of HTML.

Features

• Global /llms.txt Endpoint: Follows the Jeremy Howard specification for AI-friendly website maps. Groups content by categories, auto-prunes old content to an Optional block.
• Dynamic Markdown Pages: Any post or page (e.g., your-site.com/hello-world/) automatically gets an AI-readable Markdown version at your-site.com/hello-world.md.
• Intelligent HTML-to-MD Parser: The built-in converter parses headers, bold text, links, lists, code blocks, and blockquotes while intelligently stripping messy shortcodes, scripts, and unnecessary div wrappers.
• Aggressive Caching: Uses WordPress transients to cache all endpoints so your server performance is never impacted by heavy AI scrapers. Cache auto-clears on post updates.
• Advanced Admin UI: A beautiful, React-like settings interface using native WordPress UI to toggle endpoints, test outputs, and debug Markdown generation for specific posts.

Installation

1. Copy the auto-ai-optimization folder into your wp-content/plugins/ directory.
2. Activate the plugin through the 'Plugins' menu in WordPress.
3. Upon activation, the plugin automatically flushes rewrite rules.
4. Navigate to Settings > Auto AI Opt to configure options.
5. Your global map is live at /llms.txt.
6. Append .md to any post permalink to see its markdown version!

Technical Details

• Output: All endpoints return Content-Type: text/plain; charset=utf-8 with X-Robots-Tag: noindex.
• Rewrite System: Hooks into template_redirect natively to prevent full theme loads when .md is requested, drastically improving scraper performance.
• Requirements: PHP 7.4+, WordPress 5.8+

Author

Created by Kaan KOSE (@kaankosei)