Back to reportSignal 05 of 10
Whether AI crawlers can reach your site at all
Strong
Whether AI crawlers can reach your site at all
This signal is helping buyers find and trust you.
Why this matters
SEO foundation signals determine whether AI crawlers can reach your site at all. Before AI can recommend you, cite you, or sell for you, it has to be able to read your pages. robots.txt, sitemaps, SSL, page speed, and mobile viewport are the gatekeepers.
This is not traditional SEO. AI crawlers do not rank pages in a list of 10 blue links. They parse your site once, extract what they can, and decide whether to include you in their knowledge base. A single misconfigured robots.txt directive can make your entire site invisible to AI.
The gold standard
- HTTPS with valid SSL certificate
- robots.txt that allows AI crawlers (Googlebot, GPTBot, ClaudeBot, PerplexityBot)
- XML sitemap with all indexable pages discoverable
- Page load time under 2 seconds
- Mobile viewport tag
- Exactly 1 H1 tag per page
- Meta title (30-60 chars) and description (120-160 chars)
- Canonical tags on every page
- Zero images without alt text
LLM crawlability score
Page Load Speed455ms — excellent. AI bots index fast pages first.
Server-Side Rendered Content1 substantive paragraph(s) in raw HTML. Good signal for AI extraction.
SSL / HTTPSSite secured with HTTPS. Required for all AI agent integrations.
Mobile ViewportMobile viewport declared. AI crawlers use mobile-first indexing.
Rich Schema MarkupZero structured data. AI systems have no machine-readable content to extract.
Answer-First Content Structure1 substantive paragraph found. Aim for 3+ answer-first paragraphs for reliable AI citation.
Preload / Performance HintsResource preloading detected. Signals a performance-optimized site to AI crawlers.
What we found on your site
HTTPS / SSLSite secured with HTTPS
Title tag (41 chars)41 characters (optimal: 30-60)
Meta description (65 chars)65 characters (optimal: 120-160)
Canonical tagCanonical URL declared
robots.txtFound
XML sitemapFound (1729 entries)
Mobile viewportMobile-first indexing supported
H1 tagNo H1 tag found.
Page load time (455ms)Fast. AI bots index fast pages first.
Image alt textAll images have alt text
Your robots.txt
# robots.txt for Credit Saint # Spec: https://www.rfc-editor.org/rfc/rfc9309 # # Default policy: allow all crawlers everywhere EXCEPT the gated paths # below (member portal, enrollment funnel, query-string URLs). Named # blocks further down exist only to fully deny crawlers we don't want. # LLM/AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, # Applebot-Extended, OAI-SearchBot, etc.) are not listed individually — # under RFC 9309 they match the wildcard, which is exactly the policy # we want: opt-in on content, opt-out on gated paths. User-agent: * Disallow: /*? Disallow: /enter Disallow: /enter/ Disallow: /portal Disallow: /portal/ Disallow: /consultation Disallow: /consultation/ Disallow: /getStarted Disallow: /getStarted/ Disallow: /getStartedAgreement Disallow: /getStartedAgreement/ # Fully blocked crawlers User-agent: Baiduspider Disallow: / User-agent: Yandex Disallow: / User-agent: ia_archiver Disallow: / User-agent: MJ12bot Disallow: / User-agent: Bytespider Disallow: / User-agent: PetalBot Disallow: / Sitemap: https://www.creditsaint.com/sitemap.xml Sitemap: https://www.creditsaint.com/resources/sitemap.xml LLMs: https://www.creditsaint.com/llms.txt
Your robots.txt may be blocking AI crawlers. Check for Disallow directives targeting GPTBot, ClaudeBot, PerplexityBot, or broad Disallow: / rules.
Sitemap at https://www.creditsaint.com/sitemap.xml with 1729 entries.