Tag Archives: Verifier

Google has added a new Google crawler, a new user agent, to the Google spider list. Its name is Google Site Verifier User Agent. This user agent ignores robots.txt rules, by the way, and I assume it is used for verifying sites with Search Console and other Google tools and services. Google posted the new […]