Official statement
Google occasionally re-crawls URLs that were detected in the past, even if they no longer exist. For temporary pages, it is possible to use the 'unavailable_after' meta robots tag in addition to standard 404 errors.
23:13
Other statements from this video 11 ▾
- 4:04 Why are redirects essential when modifying a URL in SEO?
- 6:37 Should you prioritize certain types of redirects to boost your SEO?
- 9:53 Should you always use 301 redirects during a website migration?
- 13:03 Should you really keep redirects for such a long time?
- 14:44 Is it risky to use Google's removal tool during a migration?
- 15:47 Why do rankings really fluctuate during a website migration?
- 18:57 Why doesn’t Google notify us during a spam update?
- 20:02 Why should you only mark up creators and not supervisors?
- 22:10 How can you optimize your crawl budget with unique content?
- 26:54 Is it true that crawl budgets are not shared between services on the same domain?
- 30:14 How does Googlebot really perceive duplicate pages?
Official statement from
(2 years ago)
⚠ A more recent statement exists on this topic
How Is Google Optimizing Its Crawl to Do Less But Better?
View statement →
TL;DR
Google sometimes re-crawls old URLs, even if they're deleted. Use 'unavailable_after' with 404 for temporary pages. Analyze your logs to spot these visits.
❓ Frequently Asked Questions
Quelle est la meilleure pratique pour gérer les URLs supprimées ?
Utiliser les erreurs 404 et 'unavailable_after' pour contrôler le recrawl.
Le recrawl des URLs supprimées affecte-t-il mon classement ?
Indirectement, car il consomme le crawl budget.
Comment savoir quelles URLs sont revisitées ?
Analysez régulièrement les logs de votre serveur.
Devons-nous toujours utiliser 'unavailable_after' ?
Oui, pour les pages temporaires dont la date d'expiration est claire.
Quelle est la fréquence de recrawl de Google ?
Google ne précise pas la fréquence exacte des recrawls de pages supprimées.
🎥 From the same video 11
Other SEO insights extracted from this same Google Search Central video · duration 33 min · published on 08/02/2024
🎥 Watch the full video on YouTube →
💬 Comments (0)
Be the first to comment.