AI Crawler Access Check
196 AI bots · tiered robots.txt & WAF audit
Enter any URL to instantly audit which AI crawlers (ChatGPT, Gemini, Claude, Perplexity, Meta AI) are blocked across Tier 1/2/3 priority groups.
BHM-MCP adds 28 SEO/GEO skills to Claude, ChatGPT and Cursor, plus tools to check AI bots and your website.
Connect Claude, ChatGPT, and Cursor directly to 28 specialized engineering skills, our 264-checkpoint audit engine, and verified global playbooks.
196 AI bots · tiered robots.txt & WAF audit
Enter any URL to instantly audit which AI crawlers (ChatGPT, Gemini, Claude, Perplexity, Meta AI) are blocked across Tier 1/2/3 priority groups.
175 AI bots · robots.txt audit · bot verification
Upload raw server logs (.log, .txt, .gz, .csv, .xlsx) to inspect exact crawl frequency of GPTBot, ChatGPT-User, ClaudeBot, and PerplexityBot by URL, date, and AI provider.
Inspect raw HTML exactly like GPTBot, ClaudeBot & PerplexityBot
Audit raw server-rendered HTML without JavaScript execution. Scores semantic HTML5 landmarks, heading hierarchy, structured data, and meta tags.
Compare raw SSR HTML vs. client-rendered DOM across 6 metrics
Does your site survive when AI crawlers disable JavaScript? Scores 4 dimensions: Crawl Accessibility, No-JS Content Availability, Entity/GEO Readiness, and Render Stability.
An audit on your own website, with a prioritised list of what to fix.
Optimizing technical infrastructure, entity graphs, and content extractability so AI platforms (ChatGPT, Google AI Overviews, Gemini, Claude, Perplexity) cite and recommend your brand.
Brian Ho’s bottom-up engineering audit stack spanning DNS/TLS (L1-2), WAF/Bot Access (L3), robots.txt (L5), Edge SSR (L8), Schema/Entities (L10), llms.txt (L11), and MCP (L12).
The 7 sequential gates every URL must pass to earn AI visibility: Discover -> Crawl -> Index -> Retrieve -> Ground -> Cite -> Mention.
When a user submits a complex prompt, ChatGPT expands it into multi-hop sub-queries (Find -> Hone) and filters candidates down to ~6.7 safe_urls that drive 99.86% of citations.
Extending Google’s E-E-A-T with Algorithmic/Agentic Verifiability and structuring first-party documentation as a high-density reference graph.
Brian Ho Marketing’s Model Context Protocol server (mcp.brianhomarketing.com) equipping Claude, ChatGPT, and Cursor with 28 specialized SEO/GEO engineering skills.
Brian Ho Marketing’s Inversion methodology: Instead of only asking "How do we rank?", we first eliminate the 4 structural failure modes that cause 90% of brands to be skipped by AI crawlers and excluded from ChatGPT safe_urls.