Official statement
If a page is blocked by robots.txt but needs to be unblocked for noindex: first unblock robots.txt as instructed, allow Google to crawl and see the noindex, then block it again if necessary. The most reliable method is to keep noindex in place.
19:40
Other statements from this video 11 ▾
- 1:33 How will Google's 'Helpful Content' update shake up SEO?
- 3:39 How can you create truly unique and impactful content for SEO?
- 3:39 Should you really focus solely on creating valuable content for users?
- 4:43 Should you keep using the hreflang tag after the Search Console update?
- 9:48 Are indexed redirect pages really a concern for your SEO?
- 11:21 Is it true that Google overlooks your redirects for the canonical version?
- 14:41 Why is mastering the FAQ format in SEO essential?
- 15:44 Is adding a job application button really not considered SEO cloaking?
- 17:53 Are Pros and Cons structured data really unsuitable for product pages?
- 21:30 Why is the noarchive meta tag essential for SEO?
- 25:30 Is your page suddenly losing its SEO ranking?
Official statement from
(3 years ago)
⚠ A more recent statement exists on this topic
Should you really block AI crawlers in your robots.txt?
View statement →
TL;DR
For Google to properly process noindex, first unblock the page in robots.txt, allow it to be crawled, and then block it again if necessary. Do not block noindex.
❓ Frequently Asked Questions
Que se passe-t-il si je ne débloque pas le robots.txt avant le noindex?
Google ne pourra pas voir la directive noindex, la page reste donc dans l'index.
Combien de temps laisser une page débloquée pour Google?
Il n'y a pas de durée fixe, mais suffisamment longtemps pour que Googlebot la crawl et détecte le noindex.
Est-il possible de tester ces modifications?
Oui, surveillez les logs du serveur et la Search Console pour voir l'activité de crawling.
🎥 From the same video 11
Other SEO insights extracted from this same Google Search Central video · duration 30 min · published on 01/09/2022
🎥 Watch the full video on YouTube →
💬 Comments (0)
Be the first to comment.