Semrush
SEO and search intelligence platform with AI crawler profiles for ChatGPT and AI agent discoverability
Semrush is a leading SEO and search intelligence platform. The March 2026 update to its Enterprise Site Intelligence product added predefined Crawler Profiles including a ChatGPT crawler profile (naming ChatGPT-User, OAI-SearchBot, and GPTBot) alongside Googlebot — enabling communications and web teams to simulate exactly how AI bots access and interpret site content, identifying technical barriers to AI discoverability. This moves from asking "are we appearing in AI results?" (an Otterly AI/Profound question) to "can AI systems even access and parse our content correctly?" — a technical readiness question. Scheduled crawls provide continuous monitoring for when technical changes break AI discoverability. Note: Semrush owns Prowly (also in this directory), making it a connected PR and SEO intelligence offering.
For comms teams: digital comms and owned-media leads working with web or SEO teams.
Best for
- • Digital comms and owned-media leads working with web or SEO teams
- • Organisations where comms is accountable for AI discoverability
- • Teams diagnosing why they're not appearing in AI answers
- • Combined PR/SEO workflows (Semrush + Prowly ecosystem)
Pricing
AI Visibility Toolkit from $99/month — check semrush.com for current UK pricing
Enterprise Site Intelligence (includes Crawler Profiles) at enterprise tier; Semrush also owns Prowly
Pricing last verified Apr 2026 – check vendor site for current rates.
What works well
- + Diagnoses technical AI discoverability barriers rather than just reporting outcomes
- + Predefined AI crawler profiles remove setup complexity
- + Established platform with strong methodology documentation
Watch out for
- - Technical diagnostic tool — operationalising insights requires engineering bandwidth
- - Not a brand mention or narrative monitoring tool
- - AI Visibility Toolkit pricing adds to existing Semrush costs
When to choose this
Choose Semrush when technical AI readiness is a known gap — it diagnoses whether AI crawlers can access and parse your content correctly, not just whether your brand appears in AI answers.
Who should look elsewhere
If you need brand mention monitoring in AI engines rather than technical crawl readiness, Otterly AI or Profound are the right tools. If budget is limited, start with the free Bing Webmaster Tools AI Performance dashboard before adding Semrush. Semrush is most justified when technical AI readiness is a confirmed gap, not just a theoretical concern.
Key features
- • Predefined Crawler Profiles for AI agents including ChatGPT-User, OAI-SearchBot, GPTBot (launched March 2026)
- • Scheduled crawl simulations replicating AI bot access to site content
- • Technical barrier identification for AI discoverability
- • Full SEO and search intelligence platform capabilities
- • Domain analytics, keyword research, and backlink analysis
Governance & data
Governance information is based on publicly available vendor documentation. Verify with your vendor before procurement decisions.
Integrations
Available on
More in GEO & AI Visibility
Need help choosing the right tools?
Faur helps communications teams evaluate, implement, and integrate AI tools into their workflows.
Get in touch ↗