Back to report
Signal 05 of 10

Whether AI crawlers can reach your site at all

28/100Currently limiting your visibilitywww.cosentino.com/usa
28/100
Currently limiting your visibility

Whether AI crawlers can reach your site at all

This signal is currently limiting how often buyers see you.

You vs peer median
Peer median 72

Why this matters

SEO foundation signals determine whether AI crawlers can reach your site at all. Before AI can recommend you, cite you, or sell for you, it has to be able to read your pages. robots.txt, sitemaps, SSL, page speed, and mobile viewport are the gatekeepers.

This is not traditional SEO. AI crawlers do not rank pages in a list of 10 blue links. They parse your site once, extract what they can, and decide whether to include you in their knowledge base. A single misconfigured robots.txt directive can make your entire site invisible to AI.

The gold standard
  • HTTPS with valid SSL certificate
  • robots.txt that allows AI crawlers (Googlebot, GPTBot, ClaudeBot, PerplexityBot)
  • XML sitemap with all indexable pages discoverable
  • Page load time under 2 seconds
  • Mobile viewport tag
  • Exactly 1 H1 tag per page
  • Meta title (30-60 chars) and description (120-160 chars)
  • Canonical tags on every page
  • Zero images without alt text

LLM crawlability score

Page Load Speed87ms — excellent. AI bots index fast pages first.
Server-Side Rendered ContentThin HTML detected — content likely loaded via JavaScript, which AI crawlers cannot execute.
SSL / HTTPSSite secured with HTTPS. Required for all AI agent integrations.
Mobile ViewportNo mobile viewport tag. AI systems using mobile-first indexing may penalize or skip this site.
Rich Schema MarkupZero structured data. AI systems have no machine-readable content to extract.
Answer-First Content StructureNo answer-block paragraphs detected. AI systems cannot extract direct answers — they skip to sites that have them.
Preload / Performance HintsNo preload hints found. Adding <link rel="preload"> improves perceived load time for all bots.

What we found on your site

HTTPS / SSLSite secured with HTTPS
Title tag (27 chars)27 characters (optimal: 30-60)
Meta description (0 chars)No meta description found
Canonical tagNo canonical tag. Duplicate content signals confuse AI crawlers.
robots.txtNo robots.txt. AI crawlers may skip your site entirely.
XML sitemapNo sitemap found. AI indexers may miss large sections of your site.
Mobile viewportNo viewport meta tag. AI crawlers use mobile-first indexing.
H1 tagNo H1 tag found.
Page load time (87ms)Fast. AI bots index fast pages first.
Image alt textAll images have alt text

What to do next

  1. Create a robots.txt file. Explicitly allow GPTBot, ClaudeBot, PerplexityBot, and Googlebot.
  2. Generate an XML sitemap listing every indexable page. Submit it to Google Search Console and Bing Webmaster Tools.
  3. Add canonical tags to every page to prevent duplicate content signals.

Learn more