Google has launched a brand new crawler, a brand new Googlebot, named Google-InspectionTool. This new Google crawler can be how Google identifies crawling exercise for the crawler utilized by Google Search’s testing instruments, just like the wealthy outcomes check and Google Search Console’s URL inspection device.
Google-InspectionTool. Google posted particulars about this new crawler in its assist doc over here. It says, “Google-InspectionTool is the crawler utilized by Search testing instruments such because the Wealthy Consequence Take a look at and URL inspection in Search Console. Other than the person agent and person agent token, it mimics Googlebot.”
Here’s a screenshot of that documentation:
Person agent. The person agent token for its crawl exercise can both be the basic Googlebot or the brand new Google-InspectionTool. Google additionally listed the complete person agent strings which differ for cellular and desktop crawls:
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Construct/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Cell Safari/537.36 (appropriate; Google-InspectionTool/1.0)
Mozilla/5.0 (appropriate; Google-InspectionTool/1.0)
Why we care. If you’re a crawler junky and also you analyze the crawling exercise and bot exercise in your log information, you may see Google-InspectionTool present up. That’s particularly in case you use the Wealthy Consequence Take a look at and URL inspection in Google Search Console.
In case you see points with these instruments doing their jobs, you could be blocking the Google-InspectionTool person agent from accessing your website. So be sure to permit Google-InspectionTool to crawl your website you probably have strict guidelines in place.