Fixes

How to fix “Indexed, though blocked by robots.txt” on Magento

If Search Console shows “Indexed, though blocked by robots.txt” on your Magento site, you are in the right place. The URL is blocked by robots.txt yet still in the index. This page covers the causes and a step-by-step fix for Magento. A powerful e-commerce platform (Adobe Commerce) for large catalogs. Layered navigation filters create many parametrised URLs.

Updated: 05.11.2026 · 2 min read · Türkçe

Contents
  1. What does this status mean?
  2. Likely causes on Magento
  3. Step-by-step fix on Magento
  4. Extra checks for Magento
  5. After fixing
  6. More information

What does this status mean?

Google did not crawl the URL because robots.txt forbids it, but it knows the address from links on other pages and indexed it without content. The result usually shows "No information is available for this page".

Likely causes on Magento

  • Only robots.txt was used to hide the page.
  • External and internal links announced the address to Google.
  • The page was indexed first and blocked in robots.txt later.
  • The sitemap still lists the URL.
  • Magento note: Edit robots.txt on the same screen. Disallowing filter parameters, search results and cart URLs protects crawl budget.

Step-by-step fix on Magento

  1. In your Magento admin go to: Stores > Configuration > Catalog > Catalog > Search Engine Optimization and Marketing > SEO & Search.
  2. Edit robots.txt on the same screen. Disallowing filter parameters, search results and cart URLs protects crawl budget.
  3. Under Stores > Configuration > General > Design > Search Engine Robots the default should be INDEX,FOLLOW. A NOINDEX,NOFOLLOW value left over from development is a common live mistake.
  4. If you do not want it indexed, remove the robots block and add noindex; allow crawling so Google can see the noindex.
  5. Protect content that must stay private with a password or login; do not rely on robots.txt alone.
  6. For urgent removal use the Removals tool in Search Console temporarily.
  7. If you want it indexed, remove the robots block and send the URL.
  8. Take blocked URLs out of the sitemap.

Extra checks for Magento

  • canonical and duplicate URLs: In Catalog > SEO turn on "Use Canonical Link Meta Tag" for categories and products. Dropping the category path from product URLs reduces duplicates.
  • redirects and 404: Add 301s under Marketing > URL Rewrites. When a product URL key changes, keep the "create permanent redirect" box ticked.

After fixing

In Search Console start "Validate fix" for this status and resubmit the page with URL inspection. First confirm the blocker is gone with the free Free indexability checker tool; for many URLs follow Bulk URL indexing: how to send thousands of pages to Google. Google makes the indexing decision itself and timing ranges from days to weeks.

More information

Frequently asked questions

Why noindex first, then robots?

Google must be able to crawl the page to see noindex. Let noindex take it out of the index first, then close it with robots.txt if you like.

Is this an error?

It is a warning; a content-less listing may be undesirable for your brand.

Where are these settings on Magento?

Stores > Configuration > Catalog > Catalog > Search Engine Optimization and Marketing > SEO & Search.

Related pages