What is a Noindex Tag?

You've probably heard SEOs talk about "noindexing" pages, but if you're not 100% sure what that means, or you're worried about doing it wrong and tanking your rankings, you're in the right place.

This guide covers everything: what a noindex tag actually is, how it works under the hood, when you should use one, and the mistakes that trip people up every single time.

A noindex tag is a small piece of code you put on a webpage to tell search engines: "Don't show this page in search results."

That's really it. When Google (or Bing, or any other crawler) visits your page and sees a noindex directive, it won't list that page in its index. Your visitors can still reach the page if they have the direct URL. But it won't show up when someone searches on Google.

Think about it: not every page on your site deserves a spot in Google's index. Admin pages, thank-you pages, duplicate content, staging environments, filtered product pages - these can actually hurt your SEO if Google is indexing them. The noindex tag gives you control over what gets seen.

How Search Engines Read the Noindex Tag

Search engines send out bots (also called crawlers or spiders) that visit your pages regularly. When a bot lands on a page, it reads the HTML in the < head>section before doing anything else.

If it finds a noindex directive, it stops and moves on. The page won't be added to the index, and any existing listing for that page gets removed over time.

Here's the standard noindex meta tag format:

< meta name="robots" content="noindex">

You place that inside the < head>of your HTML. Simple as that.

You can also combine directives. For example:

< meta name="robots" content="noindex, nofollow">

That tells the bot: don't index this page AND don't follow any links on it.

Noindex vs. Nofollow: What's the Difference?

People mix these up constantly. Here's the quick breakdown:

• Noindex - Don't include this page in search results
• Nofollow - Don't follow the links on this page
• Noindex, nofollow - Don't index it AND don't follow its links
• Index, follow - The default (you don't need to write this; it's assumed)

They do different jobs. You can noindex a page but still allow Google to follow its links, or you can nofollow a page but still let it show up in search. Most of the time, when you want a page completely hidden, you'll use both together.

There are actually two main ways to send a noindex directive to search engines. Knowing both matters, because the right choice depends on your site setup.

The Meta Robots Tag

This is the most common method. You add a < meta>tag directly into the HTML of the page you want to exclude. It goes inside the < head>section, like this:

< meta name="robots" content="noindex">

Want to target a specific search engine? You can do that too:

< meta name="googlebot" content="noindex">

That one targets Google's crawler specifically. Useful in rare cases where you want other search engines to index a page but not Google.

Most CMS platforms - WordPress, Shopify, Squarespace - let you set this without touching code. There's usually a checkbox in the SEO settings of each page. Pro tip: always double-check that the setting actually writes the correct tag to the HTML, because some plugins behave unexpectedly.

The X-Robots-Tag HTTP Header

This is the less talked-about method, but it's just as valid. Instead of putting the directive in the HTML, you send it in the HTTP response header when the page is requested.

It looks like this in a server response:

X-Robots-Tag: noindex

Here's why this matters: the X-Robots-Tag works for non-HTML files. PDFs, images, video files - you can't put a meta tag inside a PDF, but you can send an X-Robots-Tag header with it. If you've got a lot of PDFs or media files you don't want indexed, this is the way to go.

Setting it up usually requires server-level access (Apache, Nginx config files, or server-side code). It's a bit more technical, but worth knowing about.

What Happens After You Add a Noindex Tag?

You add the tag. Now what?

Google doesn't remove a page from its index instantly. The bot has to come back, re-crawl the page, see the noindex tag, and then process the removal. That can take anywhere from a few days to a few weeks depending on how often Google crawls your site.

For faster removal, you can use Google Search Console's URL Removal Tool. That's a temporary solution (it lasts about 6 months), but it speeds things up when you need a page gone fast.

One important thing: the bot still has to be able to crawl the page to see the noindex directive. If you also block the page in your robots. txt file, Google can't read the noindex tag and the page might stay in the index. Don't block and noindex the same page - it's a common mistake we'll cover later.

This is where a lot of people get stuck. "Should I noindex this page?" isn't always obvious. Here's how to think about it.

Pages That Usually Need a Noindex Tag

Some pages genuinely shouldn't be in search results. Not because they're bad, but because they'd confuse users if they showed up, or they'd dilute your site's overall quality signal.

• Thank-you pages - After a form submission or purchase, these pages have no value to someone searching Google
• Login and account pages - Private user areas don't belong in search results
• Admin and dashboard pages - These should never be public anyway
• Duplicate content pages - Printer-friendly versions, pages with URL parameters, pagination pages that repeat content
• Thin content pages - Pages with very little content that don't serve a real search purpose
• Staging or test environments - If your staging site is publicly accessible, noindex everything on it
• Internal search results pages - Google actually recommends noindexing these
• Tag and category archive pages - On blogs with lots of tags, these can create hundreds of thin pages

Real talk: if a page wouldn't help someone who found it through a Google search, it probably shouldn't be indexed.

Pages You Should Never Noindex

On the flip side, some pages get accidentally noindexed all the time - and it's a disaster when it happens.

• Your homepage - Seems obvious, but it happens more often than you'd think
• Core product or service pages - These are your money pages; they need to rank
• High-traffic blog posts - If a page gets organic traffic, noindexing it kills that traffic
• Landing pages you're running ads to - You might still want organic traffic on these
• Any page you want to rank for - This sounds obvious, but URL migrations and CMS updates can accidentally apply noindex tags at scale

Honestly, the scariest noindex scenarios are the accidental ones. A developer checks a box on the wrong setting, a plugin update changes behavior, a site migration goes wrong. Monitoring your indexed pages regularly is non-negotiable in 2026.

Knowing what a noindex tag is and actually managing noindex decisions across a large site are two very different things. That's where a tool like Semly Pro comes in.

Semly Pro is built for SEO professionals, agencies, and website owners who need to stay on top of their site's search visibility without doing everything manually, and in 2026, with Google's algorithms getting sharper about content quality, keeping your indexed pages clean matters more than ever.

How Semly Pro Tracks Your Indexed Pages

Semly Pro connects to Google Search Console and Google Analytics 4, so you get a real-time picture of what's indexed and what's performing. You can spot pages that are indexed but getting zero traffic (potential candidates for noindex) and pages that aren't indexed but should be.

The content audit feature is particularly useful here. On the Pro plan, you get 15 content audits per month. On Business Pro, that goes up to 40. These audits flag indexing issues, thin content, and crawlability problems across your site automatically.

Semly Pro's plans break down like this:

All plans come with a 7-day free trial. You can get started without a credit card commitment and see exactly what's happening with your site's indexing right away.

Using Semly Pro's AI Visibility Score

Here's something that goes beyond traditional noindex management. Semly Pro includes an AI visibility score that tracks how your content appears in AI-generated search results - things like ChatGPT responses, Perplexity answers, and Google's AI Overviews.

Why does this matter for noindex decisions in 2026? Because some pages that you'd traditionally consider "thin" might still be getting cited in AI-driven responses. Before you noindex a page, checking its AI visibility score gives you a fuller picture of its actual value.

The Business Pro plan adds advanced AI metrics and LLMs. txt generation - a newer optimization layer that helps you control how AI systems read and reference your content. If you're managing a larger site or working with agency clients, that's a genuinely useful feature set.

There's no one-size-fits-all answer here. Your noindex strategy depends on your site's size, structure, and goals, but there's a process that works well for almost everyone.

Auditing Your Pages Before Adding Noindex Tags

Before you start noindexing anything, you need a clear picture of what's currently indexed and why.

Start by pulling a list of all your indexed URLs. You can do this in Google Search Console under the "Pages" report. Look for:

• Pages with zero impressions over the past 90 days
• Pages with very low word counts (under 300 words)
• Duplicate or near-duplicate pages
• Pages with URL parameters that shouldn't be indexed
• Old pages that are outdated or no longer relevant

Don't just noindex everything that looks thin. Check if those pages have inbound links. Check if they're driving any traffic, even a little. Sometimes a page with only 200 words is ranking for a long-tail keyword and bringing in real visitors. You'd never know unless you check.

Step-by-Step: Adding a Noindex Tag Correctly

Once you've identified the pages that should be noindexed, here's how to do it properly:

1. Decide on your method - Meta robots tag for HTML pages, X-Robots-Tag for non-HTML files or server-level control
2. Check robots. txt first - Make sure the page isn't already blocked. If it is, the bot can't see your noindex tag
3. Add the meta tag to the page's < head> section - Use < meta name="robots" content="noindex">
4. Verify with a browser extension or view-source - Confirm the tag is actually rendering in the HTML (especially important for JavaScript-heavy sites)
5. Check Google Search Console - Use the URL Inspection tool to confirm Google can see the tag
6. Monitor over the next 2-4 weeks - Watch for the page to drop out of the index and confirm nothing else broke
7. Document your changes - Keep a log of what you noindexed and why, so you can reverse decisions if needed

That last step sounds boring, but you'll thank yourself later. SEO teams change, clients ask questions, and six months from now you won't remember why you noindexed 47 pages unless you wrote it down.

You don't manage noindex tags in isolation. You need broader SEO tooling to audit pages, track indexing, and catch mistakes. Here's how the main options stack up:

The big differentiator for Semly Pro in 2026 is the AI visibility layer. Most traditional SEO tools were built before AI-generated search responses became a major traffic source. Semly Pro tracks both classic Google indexing and AI citation visibility, which gives you a more complete picture of how your content is performing.

Jasper and Writesonic are primarily content creation tools, not technical SEO platforms, so they don't really compete on indexing management. Frase does content optimization but doesn't touch crawlability. Semrush and Ahrefs are the closest full-suite competitors, though neither offers LLMs. txt generation or dedicated AI visibility scoring as of 2026.

These are the ones that show up again and again. Learn them now and you won't have to fix them later.

Mistake 1: Blocking the page in robots. txt AND adding a noindex tag

If robots. txt disallows a URL, Google's bot won't crawl it. That means it also won't see the noindex tag. The page might stay in the index forever because Google never gets to read your removal directive. Use one or the other, not both.

Mistake 2: Noindexing pages on a staging site using a plugin - then forgetting to change the setting on the live site

This is how entire sites end up deindexed overnight. Always verify your live site's indexing status after any migration or CMS update. Semly Pro's content audits can catch this automatically.

Mistake 3: Noindexing paginated pages incorrectly

Some SEOs noindex all paginated pages (page 2, page 3, etc.) to avoid duplicate content, but if those pages contain unique product listings or posts, you might be hiding valuable content from Google. It's a judgment call, and it depends on your site's structure.

Mistake 4: Forgetting that noindex takes time

You add the tag and expect the page to vanish from Google by morning. That's not how it works. Google needs to re-crawl the page first. For urgent removals, use Google Search Console's URL removal tool alongside the noindex tag.

Mistake 5: Noindexing pages that have inbound links

If other sites link to a page and you noindex it, you lose that link equity. If the page needs to go away, consider redirecting it to a relevant page rather than noindexing it. You keep the link value and the old URL doesn't confuse users.

Mistake 6: Not monitoring after adding noindex tags

You make the change and walk away. Three weeks later, you realize you accidentally noindexed a category page that was driving thousands of visitors per month. Always monitor your indexed page counts before and after any bulk noindex changes.

Mistake 7: Assuming noindex is the only solution for duplicate content

Noindex is one tool. Canonical tags are another. For duplicate pages where you want to consolidate link equity rather than just hide a page, a canonical tag is often a better choice. Know when to use each.

What exactly does a noindex tag do?

A noindex tag tells search engines not to include a specific page in their search results. The page can still be accessed directly via URL, but it won't show up when someone searches on Google or other search engines.

Where do you put a noindex tag?

For HTML pages, you put it in the < head>section of the page's HTML code, like this: < meta name="robots" content="noindex">. For non-HTML files (like PDFs), you can use an X-Robots-Tag in the HTTP response header instead.

Does noindex remove a page from Google immediately?

No. Google needs to re-crawl the page and read the noindex tag before it removes it from the index. This can take anywhere from a few days to several weeks. If you need a fast removal, use Google Search Console's URL removal tool alongside the noindex tag.

What's the difference between noindex and robots. txt?

Robots. txt tells search engines not to crawl a page at all. A noindex tag tells them not to index a page they've already crawled. You shouldn't use both at once - if robots. txt blocks crawling, the bot can't see the noindex tag, and the page might stay indexed.

Can I noindex a page temporarily?

Yes. You add the noindex tag, then remove it whenever you're ready for the page to be indexed again. Once you remove the tag and Google re-crawls the page, it'll be eligible for indexing. You can also use Google Search Console's temporary URL removal for short-term needs (it expires after 6 months).

Does noindex affect my site's crawl budget?

This is a common question. Google still crawls noindexed pages - it needs to crawl them to see the noindex directive. So noindexing a page doesn't automatically save crawl budget. If you want to preserve crawl budget, blocking in robots. txt is more effective, but remember that blocks prevent Google from reading any noindex tag on the page.

Should I noindex thin content pages?

It depends. Thin content pages that add no value and don't rank for anything are usually good noindex candidates, but check traffic and link data first. If a short page is actually ranking and driving visits, improving the content is better than noindexing it. Noindexing should be a last resort for pages that genuinely can't be improved.

What happens to the PageRank of a noindexed page?

A noindexed page can still pass link equity through internal links, as long as it allows crawling (it's not blocked by robots. txt) and doesn't have a nofollow attribute. The page just won't appear in search results. If you want to also stop Google from following links on the page, use content="noindex, nofollow".

How can I check if a page is already noindexed?

The quickest way is to use Google Search Console's URL Inspection tool. You can also right-click a page in your browser, select "View Page Source," and search for "noindex" in the code. Browser extensions like SEO Meta in 1 Click also show you the robots directives on any page instantly.

How does Semly Pro help with noindex tag management?

Semly Pro connects to Google Search Console and tracks your indexed pages through its content audit feature. It flags indexing issues, thin content, and crawlability problems automatically. The Pro plan includes 15 content audits per month (€139/mo), Business Pro includes 40 per month (€229/mo), and the Managed SEO plan (€469/mo) includes unlimited audits with a dedicated SEO strategist who handles this for you. All plans start with a 7-day free trial.