Official statement
If a page is blocked by robots.txt but receives links, Google can index it without any actual content because it cannot crawl it. These pages will probably not rank well since Google has no information about their content.
Other statements from this video 13 ▾
- □ How can you prevent the indexing failure of your web pages?
- □ Why do links without HREF hinder Google's indexing?
- □ Does the no-index tag really prevent Google from crawling your pages?
- □ How does Google view window.history.pushState in terms of SEO?
- □ Is it true that the mobile validator isn't always reliable for your URLs?
- □ Does mobile compatibility really have a significant impact on your SEO?
- □ How can CDNs disrupt your site's mobile display?
- □ Is it true that JavaScript-loaded content remains invisible to Googlebot?
- □ Could HTML Buttons Be Undermining Your SEO Efforts?
- □ How can you ensure that every URL in your SPA is properly indexed by Google?
- □ How Does the Compatibility of the Beacon API with the WRS Influence Your SEO Tracking?
- □ How can you ensure that content beneath the viewport is acknowledged by Google?
- □ Are Google’s Testing Tools Truly Reliable for SEO?
Official statement from
(5 years ago)
⚠ A more recent statement exists on this topic
Should you really block AI crawlers in your robots.txt?
View statement →
TL;DR
If a page is blocked by robots.txt but has inbound links, Google may index it without any content. However, these pages are unlikely to perform well in the SERPs.
❓ Frequently Asked Questions
Google peut-il réellement indexer une page bloquée ?
Oui, via les liens entrants, même sans crawler le contenu.
Une page bloquée peut-elle bien classer ?
Peu probable, car Google manque des données cruciales pour évaluer sa pertinence.
Comment influencer positivement le ranking d'une page bloquée ?
Réviser le fichier robots.txt ou améliorer la qualité et la pertinence des backlinks peut aider.
🎥 From the same video 13
Other SEO insights extracted from this same Google Search Central video · published on 22/09/2021
🎥 Watch the full video on YouTube →
💬 Comments (0)
Be the first to comment.