Back to reportSignal 05 of 10
Whether AI crawlers can reach your site at all
Strong
Whether AI crawlers can reach your site at all
This signal is helping buyers find and trust you.
Why this matters
SEO foundation signals determine whether AI crawlers can reach your site at all. Before AI can recommend you, cite you, or sell for you, it has to be able to read your pages. robots.txt, sitemaps, SSL, page speed, and mobile viewport are the gatekeepers.
This is not traditional SEO. AI crawlers do not rank pages in a list of 10 blue links. They parse your site once, extract what they can, and decide whether to include you in their knowledge base. A single misconfigured robots.txt directive can make your entire site invisible to AI.
The gold standard
- HTTPS with valid SSL certificate
- robots.txt that allows AI crawlers (Googlebot, GPTBot, ClaudeBot, PerplexityBot)
- XML sitemap with all indexable pages discoverable
- Page load time under 2 seconds
- Mobile viewport tag
- Exactly 1 H1 tag per page
- Meta title (30-60 chars) and description (120-160 chars)
- Canonical tags on every page
- Zero images without alt text
LLM crawlability score
Page Load Speed141ms — excellent. AI bots index fast pages first.
Server-Side Rendered ContentNo substantial text blocks in raw HTML. AI bots cannot extract meaningful content.
SSL / HTTPSSite secured with HTTPS. Required for all AI agent integrations.
Mobile ViewportMobile viewport declared. AI crawlers use mobile-first indexing.
Rich Schema Markup3 schema types detected. Good machine-readable signal density.
Answer-First Content StructureNo answer-block paragraphs detected. AI systems cannot extract direct answers — they skip to sites that have them.
Preload / Performance HintsResource preloading detected. Signals a performance-optimized site to AI crawlers.
What we found on your site
HTTPS / SSLSite secured with HTTPS
Title tag (41 chars)41 characters (optimal: 30-60)
Meta description (103 chars)103 characters (optimal: 120-160)
Canonical tagNo canonical tag. Duplicate content signals confuse AI crawlers.
robots.txtFound
XML sitemapFound (16 entries)
Mobile viewportMobile-first indexing supported
H1 tagSingle H1 tag
Page load time (141ms)Fast. AI bots index fast pages first.
Image alt textAll images have alt text
Your robots.txt
# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding # use. # (b) If a Content-Signal = no, you may not collect content for the # corresponding use. # (c) If the website operator does not include a Content-Signal for a # corresponding use, the website operator neither grants nor restricts # permission via Content-Signal with respect to the corresponding use. # The content signals and their meanings are: # search: building a search index and providing search results (e.g., returning # hyperlinks and short excerpts from your website's contents). Search does not # include providing AI-generated search summaries. # ai-input: inputting content into one or more AI models (e.g., retrieval # augmented generation, grounding, or other real-time taking of content for # generative AI search answers). # ai-train: training or fine-tuning AI models. # use: how AI systems may consume the content (immediate, reference, or full). # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF # RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT # AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET. # BEGIN Cloudflare Managed content User-agent: * Content-Signal: search=yes,ai-train=no,use=reference Allow: / User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CloudflareBrowserRenderingCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: meta-externalagent Disallow: / # END Cloudflare Managed Content User-agent: * Allow: / Sitemap: https://www.xoinvite.com/sitemap.xml
Your robots.txt may be blocking AI crawlers. Check for Disallow directives targeting GPTBot, ClaudeBot, PerplexityBot, or broad Disallow: / rules.
Sitemap at https://www.xoinvite.com/sitemap.xml with 16 entries.
What to do next
- Add canonical tags to every page to prevent duplicate content signals.