Shae Bourdeaux
speaker
195 appearances
2 recordings
1 series
first heard Nov 2024
last heard Nov 2024
Shae Bourdeaux’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
You guys have a great article on this on your website.
I think it was in 2020 they released this crawl stats report.
Up until then, the technical SEO geeks like myself
We're always fighting for server log access and things like that because that was the only way to be able to look at a lot of these metrics.
But once they released this report, this gave you the insight of a lot of the things you should be looking at when it comes to your crawl stats, crawl requests, average response time.
I mean, it's a robust report that gives you a lot of good information.
Now, mind you, this is GSC.
Just like with anything else in Google Search Console, the data is limited.
I think you have a 90-day window of how you could view it, which I think is a good sample size.
But if you want to dig deeper, you're going to need to invest in a more robust tool.
Or if you just want to...
you know, maybe extract your, your log files and work on it manually.
Uh, that's also an option as well, but there's some great tools out there like Spotify on crawl, you know, several others that can do this and do this log file analysis where, where you can really get a good idea of how your site is performing and where you're, you're losing crawl budget, where you're, um,
You may see some critical rendering issues where you might see a differentiation between type of bot types, which is a big one as far as maybe mobile bot is successfully crawling your site, but desktop bot may be struggling.
Even though we know the mobile bot is the primary bot, and that's what you should see for, I'd say, 70% of your crawl rate, depending on your site, Google still does use desktop bot to crawl your site.
And so if you're looking at this and you're measuring this, you'll be able to see that breakdown.
And who knows, maybe that could be a sign of a critical issue if you are still seeing a majority desktop bot that's crawling your site.
But yes, as far as some of the metrics that we like to look at, number one, we like to look at just total crawl requests to start off.
And we'll look at that, see if everything's in range and everything's normal, just the way that Google's crawling our site.
and make sure that there aren't any huge obvious drop-offs because that's a clear sign that something's going wrong or something's broken.
Showing 21–40 of 195 · page 2 of 10
← Previous
Next →