You’ve spent years building a great product. Your Google SEO is solid. Your customers love you. But when someone asks ChatGPT “what’s the best [your category] brand,” your name doesn’t come up. Here’s why β€” and what you can do about it.

The New Reality of Brand Discovery

Something fundamental shifted in how people discover brands. A growing number of purchase decisions now start not with a Google search, but with a question typed into ChatGPT, Perplexity, or Claude.

“What’s a good skincare brand for sensitive skin?” “Best project management tool for small teams?” “Where can I find affordable handmade jewelry?” These queries are going to AI β€” and AI is answering with specific brand recommendations.

The numbers: ChatGPT now has 2.8 billion monthly users. Perplexity is growing 45% quarter-over-quarter. AI-referred visitors convert at 4.4Γ— the rate of organic search traffic. The brands getting recommended now are building a compounding advantage.

The uncomfortable truth is that most brands β€” including well-known ones with strong SEO β€” are completely invisible in AI search. Not because their products aren’t good enough. Because of three specific technical issues that most people don’t know exist.

The 3 Reasons ChatGPT Isn’t Recommending Your Brand

Reason 01 β€” Most Critical
Your robots.txt is blocking AI crawlers

This is the most common and most damaging problem β€” and most brands have no idea it’s happening.

robots.txt is a file on your website that tells web crawlers what they can and can’t access. It was designed for Google’s crawler. But AI search engines use completely different crawlers: GPTBot (ChatGPT), ClaudeBot (Claude), PerplexityBot (Perplexity), GoogleBot-Extended (Gemini).

If your robots.txt was set up before 2023, it almost certainly doesn’t include rules for these AI crawlers. In many cases, catch-all rules like Disallow: / are blocking them entirely. If AI can’t crawl your site, it can’t learn about your brand β€” and it can’t recommend you.

Here’s what an AI-friendly robots.txt addition looks like:

User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: GoogleBot-Extended Allow: /
Simple to fix. Takes 5 minutes. But without it, nothing else matters.
Reason 02 β€” Very Important
AI has no structured briefing on your brand

Even if AI crawlers can access your site, they’re piecing together an understanding of your brand from your homepage, product pages, and blog posts β€” content written for humans, not for AI models.

The result? AI often misrepresents brands. It might describe your positioning incorrectly, cite outdated product information, or β€” most commonly β€” just not mention you at all because it couldn’t confidently understand what you do.

The solution is llms.txt β€” an emerging open standard (similar to robots.txt but for AI) that lets you give AI models a structured, accurate briefing on your brand. It lives at yourdomain.com/llms.txt and contains:

  • What your brand does and who it’s for
  • Your key products or services
  • Your brand voice and how you want to be described
  • FAQ content AI models commonly ask about your category
  • Contact information and canonical URLs

Yoast and Webflow have already added native llms.txt support. Adoption is accelerating fast.

Reason 03 β€” Important
Your structured data doesn’t speak AI’s language

Schema markup (JSON-LD) helps AI models understand the structure of your content β€” what type of business you are, what products you sell, what your FAQs are, who wrote your content and what their expertise is.

Most sites have minimal schema, often just the basic Organization type added by their CMS theme. AI models use schema to build confidence in their understanding of a brand. Without comprehensive schema, you’re relying on AI to infer information it should be told directly.

The most impactful schema types for AI citation: Organization (with detailed brand info), Product (with pricing and descriptions), FAQPage (your most common customer questions), and Article (with author expertise signals).

How to Know If You Have These Problems

The quickest way to check all three issues at once is to run a technical AI visibility audit on your site. Here’s what to look for:

  • robots.txt allows GPTBot, ClaudeBot, and PerplexityBot
  • llms.txt exists at yourdomain.com/llms.txt
  • Organization schema is present with complete brand info
  • FAQ schema exists on key pages
  • Page load speed is under 3 seconds (AI bots time out too)
  • AI bots blocked by catch-all Disallow rules
  • No llms.txt file β€” AI guessing your brand positioning
  • Missing or incomplete schema markup

The Fix: What Brands Getting Cited Are Doing Differently

Step 1: Fix your robots.txt 5 minutes
Add explicit Allow rules for GPTBot, ClaudeBot, PerplexityBot, and GoogleBot-Extended. If you’re on Shopify, this requires editing your robots.txt.liquid template. WordPress users can use a plugin or edit directly via cPanel.
Step 2: Create your llms.txt 30-60 minutes
Write a structured file covering your brand overview, products/services, brand voice guidelines, FAQ content, and contact information. Place it at yourdomain.com/llms.txt. Keep it updated as your business evolves β€” AI models re-crawl periodically.
Step 3: Add comprehensive Schema markup 1-2 hours
Implement Organization, Product, FAQPage, and Article schema using JSON-LD. Add it to your page’s <head> section. If you’re on WordPress, Yoast SEO handles much of this automatically. Shopify requires more manual work or a dedicated schema app.
Step 4: Monitor your AI citations Ongoing
After optimization, track whether ChatGPT, Perplexity, and Claude are actually citing your brand β€” and with what sentiment. This tells you what’s working and where gaps remain. Check manually by asking AI engines about your brand category, or use a citation tracking tool for systematic monitoring.

How Long Does It Take to See Results?

AI models re-crawl sites on varying schedules, but most brands see changes in citation patterns within 2-6 weeks of fixing their robots.txt and adding llms.txt. Schema improvements tend to take longer to fully propagate.

The brands seeing the fastest improvement are those that fix all three issues simultaneously β€” robots.txt, llms.txt, and schema β€” rather than addressing them one at a time.

Real example: withinmemories.com went from an AI Visibility Score of 35 to 86 after fixing their robots.txt (which was blocking all AI bots) and adding a complete llms.txt file. The two changes together took under 2 hours to implement.

The Compounding Effect

Here’s what makes this worth prioritizing now: AI search visibility compounds over time. Brands that get cited regularly build stronger brand signals in AI training data. The earlier you optimize, the stronger your position becomes β€” and the harder it is for competitors who optimize later to catch up.

Most brands in your category haven’t done this yet. The window to establish early AI search presence is open, but it won’t stay open forever.

Check Your AI Visibility Score β€” Free
FoundInAI scans your site for all three issues covered in this post β€” plus Schema markup, brand signals, page speed for AI bots, and more. Get your AI Visibility Score in 60 seconds, with a breakdown of exactly what to fix and in what order.
Get My Free AI Visibility Score β†’

No credit card required Β· 60 seconds Β· Works with any platform

πŸ€–

See how ChatGPT perceives your brand β€” free scan

foundinai.co β†’ Free AI Visibility Scan

β†’

✍️ Leave a Comment