Confirm public access
The scan starts with the website address, follows redirects, and checks whether the homepage and other public pages are available.
Each check looks at evidence the website makes publicly available and compares it with current crawler guidance. The report shows what was found, how serious it is, and what to do next.
The scan starts with the website address, follows redirects, and checks whether the homepage and other public pages are available.
The scan uses the site's sitemaps and links to find public pages, up to the limit included with the selected report.
The scan checks whether crawlers can reach, understand, identify, and navigate the website's public content.
Every problem includes the affected page and the exact response, setting, or page element that caused it.
The score starts at 100. Each unique issue has one severity-weighted maximum deduction. A page-specific issue starts at half that weight and scales toward the full weight based on the share of applicable evaluated pages it affects, rounded up. A genuinely sitewide issue receives its full rule weight. Repeated instances of the same issue are grouped into one scored finding, so they increase prevalence without creating another severity penalty. No single finding deducts more than its published rule weight.
The report tells you whether to start with one site-wide setting, shared website code, or a specific page. It then shows where to make the change, what steps to follow, and an example when available.
The technical ruleset is maintained as a versioned part of the service so changes in crawler documentation can be detected, recorded, and applied consistently.
Provider documentation and established web standards anchor crawler tokens and technical requirements.
Scheduled source checks identify changes in the guidance used by the active ruleset.
Newly observed crawler tokens are recorded for visibility without changing scored access recommendations.
When source guidance changes, the ruleset gets a new version number and review date.
Every scan records the ruleset version used to produce its findings and score.
Page, response-size, redirect, origin, and time limits keep every scan consistent with the selected plan.
The score gives the company a starting point. Priority shows what to fix first. Every problem includes the affected pages, what was found, and the steps needed to correct it.
Receive a traceable report connecting every finding to its affected page, observed evidence, and exact correction, to take immediate action.