Establish public access
The scan begins with the normalized website address and records the homepage response, redirect destination, and published crawler directives.
Methodology
A repeatable technical standard for AI discoverability.
The AICrawlSuccess methodology connects provider guidance with observable website signals, weighted scoring, and page-level evidence. Every report records the ruleset used at scan time.
Audit framework
Six connected stages from page selection to final priority.
Select representative pages
Same-site sitemap entries and internal links expand the scan up to the selected page limit while keeping it focused on public website content.
Evaluate discoverability signals
Checks evaluate access, crawler access, discovery, indexing, identity, understanding, accessibility, navigation, and agent usability.
Record supporting evidence
Every finding preserves the affected URL and the response, directive, element, or count that produced the result.
Calculate score and severity
The report begins at 100 and applies defined weights for detected findings. Severity organizes the implementation order.
Attach remediation
Each finding includes a specific correction so the report can move directly into content, development, or agency workflows.
Ruleset governance
Current guidance, controlled changes, traceable reports.
The technical ruleset is maintained as a versioned part of the service so changes in crawler documentation can be detected, recorded, and applied consistently.
First-party sources
Provider documentation and established web standards anchor crawler tokens and technical requirements.
Source monitoring
Scheduled source checks identify changes in the guidance used by the active ruleset.
Conservative discovery
Newly observed crawler tokens are recorded for visibility without changing scored access recommendations.
Versioned refresh
Each successful source refresh receives a distinct ruleset version and recorded review time.
Report traceability
Every scan records the ruleset version used to produce its findings and score.
Defined scope
Page, response-size, redirect, origin, and time limits keep every scan consistent with the selected plan.
Interpreting the result
A score for orientation. Evidence for action.
The AI Discoverability Score provides a concise baseline. Severity identifies the implementation order. URLs, evidence, and remediation give the responsible team what it needs to improve each page.
100starting score
15weighted checks
9discoverability categories
1versioned ruleset
AICrawlSuccess
Apply the methodology to your website.
Start with a five-page AI discoverability baseline, then choose the report size that matches your website.