SEOscanner.app

Rule · robots.txt

robots.txt larger than 100 KiB (house convention)

SEO-ROBOTS-03-HCC4 Informational· w0house conventioninformational

Class
C4 Informational
Weight
0
Severity on fail
info
Applies to
Any engine

Scope and evidence

Evaluated on each in-scope origin with a 2xx robots.txt. The book marks this requirement house convention. As a house convention it is off by default, carries no weight, and appears only when a team opts in.

Observations

Each condition has a stable code and a reason template. The evaluator fills the placeholders from observed values only; no sentence in a report is generated.

  • over_100kib

    robots.txt on {origin} is {bytes} bytes. Google's documented limit is 500 KiB; the 102,400-byte warning is a house convention.

Sources, quoted

These are the passages the rule rests on, stored once in the knowledge base and emitted exactly as written. A citation marked for specific conditions appears only on findings with those codes.