Official statement
To prevent the crawling of certain URLs with parameters, robots.txt is preferable to the URL Parameters tool because it works for all crawlers, not just Google. The URL Parameters tool is only useful in very specific and complex cases. Using canonical tags is often a better alternative.
35:52
Other statements from this video 17 ▾
- 1:02 Why should you incorporate Page Experience into your desktop SEO strategy?
- 2:08 How does the Desktop Page Experience report affect your SEO strategy?
- 4:03 How do clicks on 'People Also Ask' impact your SEO statistics?
- 7:54 Should you worry about URL variations for SEO?
- 13:12 How can you truly master indexing in four steps according to Google?
- 18:45 Why are Search Console coverage reports sometimes delayed?
- 20:08 Is it necessary to cite external sources for AggregateRating?
- 25:45 Does being part of the same company group really ensure the SEO credibility of reviews?
- 27:47 How does Google really use your spam reports?
- 32:29 How does Google truly leverage Spam Reports to enhance its algorithms?
- 39:18 Should you really let Google crawl your pages instead of blocking them?
- 42:07 Is DMCA the Better Choice for Reporting Copied Content Instead of Search Console?
- 44:00 How could DMCA requests affect your SEO strategy?
- 46:06 What's the deal with Google's 1000 URL limit on DMCA requests?
- 48:41 Why are we still optimizing for Google instead of our readers?
- 54:27 Should you rethink comment campaigns for SEO?
- 56:02 Why is the UGC attribute essential for your blog comment links?
Official statement from
(4 years ago)
⚠ A more recent statement exists on this topic
Should you really block AI crawlers in your robots.txt?
View statement →
TL;DR
Robots.txt is more effective than the URL Parameters tool for blocking the crawl of URLs. It is compatible with all crawlers and avoids overly complex use cases.
❓ Frequently Asked Questions
Est-ce que robots.txt bloque complètement l'indexation ?
Non, robots.txt empêche le crawl mais n'interdit pas l'indexation si une URL est déjà connue ou référencée ailleurs.
L'outil URL Parameters est-il totalement inutile alors ?
Pas totalement. Il reste pertinent pour les usages très spécifiques, mais rares, où une gestion fine des paramètres est nécessaire.
Quels sont les types de paramètres à bloquer avec robots.txt ?
Ciblez surtout les paramètres de tracking, de recherche ou de tri qui génèrent des URLs redondantes.
🎥 From the same video 17
Other SEO insights extracted from this same Google Search Central video · duration 1h01 · published on 27/01/2022
🎥 Watch the full video on YouTube →
💬 Comments (0)
Be the first to comment.