Blog
Working guides on how AI decides who to name.
Crawler access, structured data and entity clarity. Each post states its answer in the first paragraph, then shows the work.
-
ClaudeBot, Claude-SearchBot and Claude-User: Anthropic's Crawlers Explained
Anthropic runs three crawlers with different jobs. What each one does, what blocking it costs you, and the exact robots.txt rules to allow or block them.
Read the post -
How to Fix AI Crawler 403 and 405 Errors
AI crawlers getting blocked with a 403 or 405 is almost always a firewall, WAF or security plugin, not robots.txt. Here is how to find it and fix it.
Read the post -
Is Cloudflare Blocking ChatGPT? How to Check and Allow AI Crawlers
If your site runs behind Cloudflare, its AI bot policies may be blocking the crawlers you want to be cited by. How to check, and the setup for a business that wants to be found.
Read the post -
PerplexityBot User Agent: robots.txt Rules and Official Documentation
The exact PerplexityBot and Perplexity-User agent strings, what each does, and the robots.txt rules to allow or verify them, straight from Perplexity's own docs.
Read the post -
Why ChatGPT Recommends Your Competitor Instead of You (7 Reasons and the Fix for Each)
ChatGPT names two or three businesses per answer. Here are the seven reasons it skips yours, how to check each one, and what to fix first.
Read the post -
How to Check What ChatGPT, Perplexity, Gemini and Google AI Say About Your Business (Free Method)
Ten buyer questions, four AI engines, one spreadsheet. A free, repeatable method to see whether AI names your business, your competitors, or nobody.
Read the post -
How Much Does AEO Cost in 2026? An Honest Breakdown of DIY, Freelancer and Agency Pricing
AEO costs from $0 to $30,000+ a month. What DIY, software, consultants and agencies actually charge, what drives the price, and the red flags to avoid.
Read the post -
How Dental Practices Get Recommended by ChatGPT and Google AI Overviews
Patients now ask AI for a dentist by city, insurance and urgency. A nine-point checklist for getting your practice named, written for practice owners.
Read the post -
How to Get Your Local Business Into Google AI Overviews and AI Mode
Google says there is no AI Overviews trick, and it is right. What actually gets a local business named in AI Overviews and AI Mode, step by step.
Read the post -
How to Allow AI Crawlers in robots.txt (Every User Agent, Copy and Paste)
A copy and paste robots.txt that allows every major AI crawler, what each user agent does, and the three mistakes that quietly block ChatGPT from citing you.
Read the post -
GPTBot, OAI-SearchBot and ChatGPT-User: What Each One Actually Does
OpenAI runs three crawlers and they do different jobs. Which one decides whether ChatGPT can cite you, which one only feeds training, and how to tell them apart.
Read the post -
What Is llms.txt, and Does Anything Actually Read It Yet?
llms.txt is a proposed Markdown index for AI models. Here is who reads it, what the 2026 adoption data shows, and whether it is worth the half day to publish.
Read the post -
How to Check Whether Your Site Is Blocking AI Crawlers in Under Five Minutes
Four checks that tell you whether ChatGPT, Perplexity and Gemini can actually reach your site. Most blocks are accidental and sit in the firewall, not robots.
Read the post -
The sameAs Property: How to Fill It In Properly and Why It Matters More Than You Think
sameAs is how AI models confirm your business is one entity, not two. Which profiles to include, which to leave out, and the mistakes that undo the whole thing.
Read the post