SoftGlaze Trustoo Scraper

Version 1.5.0 · 11 files · text domain softglaze-trustoo-scraper

Scrapes business profiles from Trustoo.nl and Trustlocal.es and pushes the results to configured remote WordPress sites. Categories are discovered from sitemaps; the work runs as a resumable queue on WP-Cron rather than in one request.

Trustoo and Trustlocal are the sources being read, not client names, so they stay in the plugin name. Every source URL is a setting, not a literal.

Provides

• Admin — 5 pages: Scraper Control, Custom Links, View Logs, Settings, scraped-data browser (admin.php?page=sgts-scraper)
• Queue — start / stop / status, batch delete of scraped posts, URL-tracking reset, live log tail
• AJAX — 11 actions, registered from an allow-list array rather than one add_action each
• Remote push — sends profiles to other sites over a configured REST endpoint

Tables

{prefix}sg_scraper_urls, {prefix}sg_scraper_logs, {prefix}sg_scraper_profile_data. All three are created by the plugin itself; it shares no table with any other plugin.

Settings

Base URLs, page limits, delays, parallelism, remote push URL and key, and an optional Mapbox public token (sgts_mapbox_token) used only to fill in a missing postal code from a street address. Leave it blank to skip that step.

Note

The scraper rotates browser user-agent strings. Check that your use stays within the target sites' terms of service and applicable law before running it.

Licence

GPLv2 or later — see LICENSE. Copyright (C) 2026 Azhar Ali (SoftGlaze).

This plugin ships no credentials. Every API key it needs is entered in the WordPress admin and stored as an option.