Skip to content
AI Visibility · 10 min read

How to Check Your Website's AI Visibility: A 5-Step Self-Audit

Most brands with strong Google rankings still appear in only 18% of AI answers. Here's how to check where your site stands — and what a professional audit adds.

Mario  · SEO & GEO Strategist at Uygen

GEO, AEO, and SEO practitioner helping businesses grow through AI search and content strategy.

A diagnostic checklist for checking a website's AI visibility, covering indexing, robots.txt, schema, and AI citation checks

Research shows that companies with strong traditional SEO rankings appear in only 18% of AI-generated answers. Checking your website's AI search visibility takes five concrete steps: verify Bing indexing, audit your robots.txt and llms.txt, inspect your schema, test content extractability, and run a live citation spot-check across ChatGPT, Perplexity, and Gemini.

This guide walks through each step and explains what to look for. The final section covers what a professional audit checks that a self-check cannot.

Key Takeaways

  • Strong Google rankings do not guarantee AI visibility — there is a well-documented 18% gap between SEO performance and AI citation rates.
  • Bing indexing is the most commonly missed access blocker for non-Google AI systems.
  • Cloudflare WAF rules silently block AI crawlers on a significant share of sites, with no robots.txt entry showing the problem.
  • FAQ schema is now an LLM extraction signal, not a rich snippet driver — Google removed FAQ rich results in May 2026.
  • A live spot-check across ChatGPT, Perplexity, and Gemini gives you a concrete AI visibility baseline.

Why strong Google rankings don't guarantee AI visibility

Ahrefs' analysis of 1.4 million ChatGPT prompts found that 88.46% of sources cited by ChatGPT came from pages already in Google's search index. That sounds like good news for anyone who ranks well. In practice, Google rankings are a necessary condition for AI citations, not a sufficient one.

AI systems add their own filters on top of indexing. Your content might be indexed and ranking while still being blocked by a CDN rule, too dense for an AI to extract a clean answer from, or lacking the third-party signals that give AI models confidence to cite it.

The gap comes down to three things:

The five steps below check each of these in order. Start with access before worrying about understanding or authority.


Step 1: Check your Bing indexing status

For AI systems outside Google's own ecosystem, Bing's search index is the primary source. Perplexity, Microsoft Copilot, and many other AI tools pull citation sources directly from Bing. If your pages aren't indexed there, those systems can't cite you regardless of how well you rank on Google.

How to check Bing indexing

Go to Bing Webmaster Tools at webmaster.bing.com. Under Reports, check your indexed page count against your expected site size. For a quick manual check, search site:yourdomain.com on Bing.com and compare the result count to the same query on Google. A significant gap points to a Bing indexing problem.

What a Bing indexing gap looks like

Common symptoms: recently published content takes weeks to appear in Bing, the Bing site: count is much lower than Google's, or key pages rank on Google but return nothing on Bing. The fastest fix is submitting URLs directly through Bing Webmaster Tools or using IndexNow for real-time submission.


Step 2: Check your robots.txt and llms.txt

Your robots.txt is the first file AI crawlers check when they visit your site. If they're blocked there, nothing else in this guide matters.

AI bots to check for in your robots.txt

Open yourdomain.com/robots.txt and check that none of these user agents are blocked:

Bot name AI system
GPTBot ChatGPT
ClaudeBot Anthropic / Claude
PerplexityBot Perplexity
Google-Extended Google AI products
CCBot Common Crawl
OAI-SearchBot OpenAI search agent

A blanket User-agent: * Disallow: / catches all of these. More common, and harder to catch, is a block introduced by a CDN or WAF configuration that doesn't show up in robots.txt at all.

The Cloudflare silent-blocking problem

Cloudflare WAF configurations silently block AI crawlers on a significant portion of sites, even when robots.txt looks fine. One documented case: a brand was completely invisible to Claude AI despite ranking well on Google and Bing. The cause was a WAF rule categorising AI crawlers as bot traffic at the network layer — nothing in robots.txt indicated a problem.

To check, review your Cloudflare Bot Management settings and WAF rules for any policies that block bots or scrapers broadly.

Does your site need an llms.txt file?

llms.txt is a newer file standard that gives AI systems a structured map of your site's AI-readable content. Check whether one exists at yourdomain.com/llms.txt.

For Google AI Search, llms.txt is not required and has no documented effect. For ChatGPT, Perplexity, and Claude, it can help those systems navigate your content more efficiently. If you're targeting non-Google AI citations and don't have one yet, it's a straightforward addition.


Step 3: Check your schema and structured data

Google removed FAQ rich results in May 2026. But FAQ schema didn't lose its value. It shifted from being a rich snippet driver to being one of the primary mechanisms AI systems use to extract structured answers from content pages.

The minimum schema baseline for AI visibility

Every site should have JSON-LD Organization and WebSite schema on the homepage. These give AI agents a machine-readable identity signal: who you are, what your URL is, what you do. For content pages, FAQPage and HowTo schema are the most useful types for AI extraction.

One nuance worth knowing: an Ahrefs correlation study found that schema markup alone had no direct citation uplift in Google AI Overviews. Schema works as a parsing and identity layer, not a standalone ranking signal. Getting the baseline right matters; stacking additional schema types beyond it has diminishing returns.

How to check your current schema

Run your homepage and key content pages through Google's Rich Results Test. Look for:

Missing Organization schema on the homepage is the most common gap.


Step 4: Test your content extractability

Access and schema are about whether AI systems can reach and identify your content. Extractability is about whether they can accurately quote it.

The quick-answer block test

Look at the opening of each key page. Is there a direct, self-contained answer to the primary question within the first 40 to 60 words?

AI systems prefer content that front-loads its answer. If your introduction spends two paragraphs setting context before reaching the actual claim, AI systems may extract from a different part of the page or skip to a competitor that answered immediately.

A clear quick-answer block states the answer in the first two sentences. An opening that begins "The world of AI search has changed dramatically..." is not independently extractable.

The live extraction test

Take a key section from one of your important pages. Paste it into ChatGPT or Perplexity and ask: "Based only on this text, what is the main answer?" If the AI returns a clear, accurate summary that reflects your framing, the content is extractable. If it returns something generic or misses your main point, that section probably needs restructuring: a clearer heading, shorter sentences, or a direct-answer opening.


Step 5: Run a live AI citation spot-check

The most direct way to check your AI search visibility is to ask AI systems about your brand and document what comes back.

What queries to run

Run these three query types across ChatGPT (with web search enabled), Perplexity, and Gemini:

What to look for

Document the result for each query-platform combination:

Result type What it means
Direct citation Your URL appears as a named source
Indirect mention Your brand name appears but without a link
No mention Your brand does not appear
Misattribution Your brand name appears with incorrect information

This spot-check creates your AI visibility baseline. Without a before-state, you have no way to measure whether changes are working.

Free tools that automate citation tracking across platforms: Ahrefs AI Visibility Checker and Semrush AI Brand Visibility Tool.


What a professional AI visibility audit checks that this guide does not

A self-check surfaces the most common and visible gaps. A professional AI visibility audit goes further on signals a manual check can't reach.

Ready to go beyond the self-check?

The Weekly AI Visibility Loop runs 30 prompts across 5 platforms in week 1 to find your citation gaps, then tracks weekly whether your optimizations are working.


Frequently asked questions

How do I check if AI can find my website?

Start with a Bing site:yourdomain.com search to verify indexing. Then check your robots.txt for AI crawler blocks — GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and OAI-SearchBot. Finally, query ChatGPT or Perplexity directly with your brand name to see whether you appear.

What is Bing indexing and why does it matter for AI visibility?

Bing maintains its own search index separate from Google. AI systems including Perplexity and Microsoft Copilot pull citation sources directly from Bing's index. If your pages aren't indexed on Bing, those systems can't cite you regardless of your Google rankings.

Which AI bots should I allow in my robots.txt?

The key crawlers to allow are: GPTBot (ChatGPT), ClaudeBot (Anthropic/Claude), PerplexityBot, Google-Extended (Google AI), CCBot (Common Crawl), and OAI-SearchBot. Also check that your Cloudflare WAF or CDN configuration isn't blocking them at the network level — this is a silent block that won't appear in robots.txt.

Does llms.txt actually improve AI visibility?

For Google AI Search, no — llms.txt has no documented effect on Google AI citations. For other AI systems like ChatGPT, Perplexity, and Claude, it can help by giving them a structured map of your site's AI-readable content. Worth adding if you're targeting non-Google AI citations.

What schema types help AI systems cite my content?

The baseline is JSON-LD Organization and WebSite schema on your homepage. For content pages, FAQPage and HowTo schema are the most effective for AI extraction. Schema functions as an identity and parsing layer for AI agents, not a direct citation driver in isolation.

What does a professional AI visibility audit check that I can't do myself?

A professional audit adds server-level crawler simulation, entity disambiguation across AI systems, source ecosystem analysis covering third-party signals outside your site, and cross-platform citation consistency mapping. The self-check surfaces access blockers and content gaps; the audit surfaces systemic and off-site issues.


If you've worked through all five steps, you have a baseline picture of where your AI visibility stands. The most common gaps — Bing indexing misses, Cloudflare-blocked crawlers, missing Organization schema — are fixable without specialist help. Deeper issues, including entity confusion and off-site source gaps, are what a professional AI Visibility Audit is designed to surface.