SEOscanner.app

Rule · HTTP and hosting

Intended URLs are publicly accessible

SEO-HTTP-02C1 Mechanism· w8gate: indexing

Class
C1 Mechanism
Weight
8
Severity on fail
critical
Applies to
Google

Test this rule on a live site with the XML sitemap checker or the noindex checker. Free, no account needed.

Scope and evidence

Evaluated on each member of I. The book marks this requirement ELIGIBILITY REQUIREMENT, SEARCH-ENGINE-SPECIFIC, and the scanner treats it as a gate: indexing rule: a failure on an intended page removes that page from the eligible set instead of entering the achieved share.

{waf_clause} is added when response headers or body match a recorded bot-challenge signature: " The response looks like a bot challenge; it may differ for verified crawlers, which this scanner cannot impersonate."

Fail conditions

Each condition has a stable code and a reason template. The evaluator fills the placeholders from observed values only; no sentence in a report is generated.

  • auth_required

    {url} returned {status} to a request without credentials. Google states that if a page is made private, such as by requiring a log-in, Googlebot will not crawl it.{waf_clause}

The documented fix

Serve pages meant for Search without login. If a firewall or bot-protection layer produced this response, make sure it admits verified search crawlers (manual check SEO-HTTP-08).

Sources, quoted

These are the passages the rule rests on, stored once in the knowledge base and emitted exactly as written. A citation marked for specific conditions appears only on findings with those codes.