Google announced the launch of an updated version of the Google Search Console Crawl Stats report. This report now gives you data you can use to debug crawl issues and check the health of your site with crawl related issues in Google Search.
The old version just showed you a chart of pages crawled per day, kilobytes downloaded per day and time spent downloading pages by day.
Here is a preview of the old report:
Whats new. Google said the new report will make it easier for developers, webmasters, SEOs, etc to find issues with Google crawling.
It brings the following exciting new features:
- Total number of requests grouped by response code, crawled file type, crawl purpose, and Googlebot type.
- Detailed information on host status
- URL examples to show where in your site requests occurred
- Comprehensive summary for properties with multiple hosts and support for domain properties
This report allows website owners to see Google crawl data totals and overtime charts for: total requests, total download size and average response time.
Grouped crawl data
The new version of the report also provides data on crawl requests broken down by response, file type of the fetched URL, purpose of the crawl request, and Googlebot agent.
See example URLs of each type by clicking on a row in the grouping table:
Multiple host support
For domain properties with multiple hosts, you can check the host status for each of the top hosts presented in the report summary view. This can help in evaluating performance of all hosts under your domain in one place.
High level & detailed information on host status issues:
Host status details in the report let you check your site’s general availability to Google in the last 90 days. And for domain properties with multiple hosts, you can check the host status for each of the top hosts presented in the report summary view.
This is a welcome update to the Search Console that will be useful to helping monitor websites for any issues that might come up. All strategist will benefit from making the Crawl Stats Report a part of monitoring sites for search performance.
Reference: Search Console Crawl Stats Report