Tag Archives: 4xx

Here is another PSA from Gary Illyes of Google. In short, if you serve a 4xx status code with your robots.txt file, then Google will ignore the rules you have specified in that file. Why? Well, 4xx status codes means the document is not available, so Google won’t check it because the server says it […]