Back to report
Signal 05 of 10

Whether AI crawlers can reach your site at all

75/100StrongBest Solution Services
75/100
Strong

Whether AI crawlers can reach your site at all

This signal is helping buyers find and trust you.

You vs peer median
Peer median 72

Why this matters

SEO foundation signals determine whether AI crawlers can reach your site at all. Before AI can recommend you, cite you, or sell for you, it has to be able to read your pages. robots.txt, sitemaps, SSL, page speed, and mobile viewport are the gatekeepers.

This is not traditional SEO. AI crawlers do not rank pages in a list of 10 blue links. They parse your site once, extract what they can, and decide whether to include you in their knowledge base. A single misconfigured robots.txt directive can make your entire site invisible to AI.

The gold standard
  • HTTPS with valid SSL certificate
  • robots.txt that allows AI crawlers (Googlebot, GPTBot, ClaudeBot, PerplexityBot)
  • XML sitemap with all indexable pages discoverable
  • Page load time under 2 seconds
  • Mobile viewport tag
  • Exactly 1 H1 tag per page
  • Meta title (30-60 chars) and description (120-160 chars)
  • Canonical tags on every page
  • Zero images without alt text

LLM crawlability score

Page Load Speed2878ms — acceptable. Under 2,000ms preferred for priority crawling.
Server-Side Rendered Content2 substantive paragraph(s) in raw HTML. Good signal for AI extraction.
SSL / HTTPSSite secured with HTTPS. Required for all AI agent integrations.
Mobile ViewportMobile viewport declared. AI crawlers use mobile-first indexing.
Rich Schema Markup7 schema types detected. Good machine-readable signal density.
Answer-First Content Structure2 answer-block paragraphs detected. Strong citation extraction potential.
Preload / Performance HintsResource preloading detected. Signals a performance-optimized site to AI crawlers.

What we found on your site

HTTPS / SSLSite secured with HTTPS
Title tag (58 chars)58 characters (optimal: 30-60)
Meta description (153 chars)153 characters (optimal: 120-160)
Canonical tagCanonical URL declared
robots.txtFound
XML sitemapNo sitemap found. AI indexers may miss large sections of your site.
Mobile viewportMobile-first indexing supported
H1 tag (4 found)4 H1 tags found. AI expects exactly one H1 per page.
Page load time (2878ms)Acceptable but under 2s preferred.
Image alt text1 image(s) missing alt text

Your robots.txt

User-agent: * 
Crawl-Delay: 20

What to do next

  1. Generate an XML sitemap listing every indexable page. Submit it to Google Search Console and Bing Webmaster Tools.
  2. Reduce to exactly one H1 tag per page. Multiple H1s confuse AI page hierarchy parsing.

Learn more