SEOscanner.app

Rule · Indexing controls

noindex is not placed in robots.txt

SEO-IDX-03C1 Mechanism· w8

Class
C1 Mechanism
Weight
8
Severity on fail
critical
Applies to
Google

Test this rule on a live site with the robots.txt checker or the noindex checker. Free, no account needed.

Scope and evidence

Evaluated on each in-scope origin. The book marks this requirement EXPLICITLY DISMISSED (as a mechanism), SEARCH-ENGINE-SPECIFIC.

Fail conditions

Each condition has a stable code and a reason template. The evaluator fills the placeholders from observed values only; no sentence in a report is generated.

  • noindex_in_robots_txt

    robots.txt line {line} reads {text}. Google does not support noindex in robots.txt, so the URLs it targets remain indexable.

The documented fix

Use a robots meta tag or an X-Robots-Tag: noindex header on crawlable URLs.

Sources, quoted

These are the passages the rule rests on, stored once in the knowledge base and emitted exactly as written. A citation marked for specific conditions appears only on findings with those codes.