Why does your site still receive 40% of desktop crawls after transitioning to mobile-first indexing?

Does mobile-first indexing really mean 100% mobile crawls?

No, and this is a common misunderstanding. Mobile-first indexing refers to the version of the site that Google prioritizes for indexing and ranking, not necessarily the bot used for every type of query.

Specifically? Google uses several bots with different missions. The Googlebot Smartphone scans your site to feed the main index. But other systems — Google Shopping, Quality Raters, Ads checks — rely on the Googlebot Desktop for their specific needs. These desktop crawls do not contribute to your traditional organic ranking, but they remain visible in your server logs and Search Console.

Which Google systems still use the desktop bot?

Mueller explicitly mentions Google Shopping and AdWords Landing Page Check, but the list is probably longer. These services have technical constraints or workflows that still require desktop rendering.

The issue is that Google does not publish an exhaustive list. You may observe patterns of desktop crawls concentrated on specific URLs (product pages, advertising landing pages), but it’s impossible to map all the use cases precisely. [To be verified] on your own traffic with granular analysis by page type.

Is this 40/60 distribution stable or fluctuating?

Mueller discusses an approximate ratio, not a fixed rule. The proportion varies depending on your content mix: an e-commerce site with a large Shopping catalog will mechanically see more desktop crawls than a blog.

Stability also depends on your active ad campaigns, the frequency of quality raters' audits, and dozens of other opaque variables. Monitoring for a drastic shift (e.g., a drop from 40% to 5% desktop in a week) may signal a problem — but a variation of 10-15 points remains within normal noise.

• Mobile-first indexing does not mean 100% mobile crawl
• Desktop bots serve ancillary systems (Shopping, Ads, Quality)
• A 40% desktop / 60% mobile ratio is perfectly normal
• The distribution fluctuates according to content type and active campaigns
• No public exhaustive list of desktop use cases exists

Is this statement consistent with on-the-ground observations?

Yes, largely. Large-scale log analyses confirm similar ratios on e-commerce sites and advertising landing pages. We indeed observe clusters of desktop crawling on product URLs synchronized with Google Merchant Center.

However — and Mueller doesn’t specify this — some purely editorial sites without Shopping feeds or active Ad campaigns see much more imbalanced ratios favoring mobile (90%+). [To be verified]: this statement primarily applies to sites with a strong advertising or merchant footprint, not all profiles.

What are the risks if we optimize only for mobile?

Let’s be honest: optimizing solely for mobile remains the absolute priority for organic ranking. The residual desktop crawl does not change this rule.

But — an important nuance — if your desktop rendering significantly differs from mobile (conditional CSS/JS, hidden content), the ancillary systems may return conflicting signals. A poorly displayed product on desktop can impact your Shopping eligibility even if your mobile version is perfect. Google does not document these edge cases, but we have seen Shopping de-listings correlated with desktop bugs.

Should you monitor this ratio over time?

Monitor yes, panic no. A dashboard showing the mobile/desktop crawl distribution by URL type (products, categories, blog, landing pages) helps detect anomalies.

What really matters: a sharp drop in total crawl volume (all bots combined), not the internal distribution. If your desktop crawl goes from 40% to 10% but mobile compensates, there’s no impact. If both collapse simultaneously, then you have a problem — but it’s not related to mobile-first indexing.

What should you concretely check in your logs?

Segment your logs by bot type (Googlebot Smartphone vs Desktop) and URL type. You should observe clear patterns: product listings with Shopping feeds attract desktop, purely editorial content remains predominantly mobile.

If you see massive desktop crawling on URLs without commercial or advertising justification, investigate. This could signal an involuntary configuration (incorrect canonical tags, poorly managed conditional redirects) forcing Google to recrawl in desktop to clarify ambiguity.

How can you avoid pitfalls related to this dual exposure?

The main risk: deploying a mobile-only site that blocks or artificially degrades desktop rendering, thinking that “Google crawls mobile anyway now.”

Error. Ancillary systems continue to solicit desktop. A broken desktop rendering can impact Shopping, the quality of Ads landing pages (and thus your Quality Score), and likely other undocumented metrics. Maintain a functional parity between both versions, even if the UX may differ.

When should you truly worry about this distribution?

Three scenarios for real alerts:

Sudden shift in the ratio without any editorial or advertising changes on your side — may indicate a technical bug or an undisclosed change on Google’s part. Excessive desktop crawling (70%+) on a purely editorial site without campaigns — often a symptom of an incomplete mobile-first migration or erroneous annotations. Content divergence detected between mobile and desktop by Search Console — Google explicitly signals the problem to you.

• Analyze your logs by segmenting by bot (Smartphone vs Desktop) and URL type
• Check the functional parity desktop/mobile, not just mobile
• Watch for sudden variations in the ratio (>20 points in a week)
• Test desktop rendering on your Shopping URLs and Ads landing pages
• Set up alerts for total crawl volume, not just distribution
• Document your baseline (average ratio over 3 months) to detect anomalies