What do all and none mean in Google's robots metadata?

Definition: In Google's robots metadata, all leaves indexing and serving unrestricted, while none is shorthand for noindex, nofollow. When the values are combined, the more restrictive rule controls the result.

Key facts

• Google's robots meta tags reference describes all as the default with no effect when it is explicitly listed.
• The same reference defines none as equivalent to noindex, nofollow.
• Google accepts several rules in one comma-separated value or across multiple meta tags, and treats the rules as case-insensitive.
• Google applies the more restrictive rule when robots rules conflict.
• Google's robots metadata and X-Robots-Tag rules are found when a URL is crawled. A robots.txt disallow prevents those indexing or serving rules from being found.
• Google's robots.txt introduction describes robots.txt as a way to control which URLs crawlers can access and recommends noindex or password protection to keep a page out of Google.

What does all mean?

Google defines all as having no restrictions for indexing or serving. It is the default value, so an explicit all does not change the page's indexing or serving rules. The value belongs to Google's robots metadata vocabulary, which can also be sent in an X-Robots-Tag HTTP response header.

<meta name="robots" content="all">

The same meaning applies when the value is written for a crawler-specific metadata name, provided the rule is addressed to the crawler that reads it. The Google reference says that rules specified without a user agent apply to all crawlers in the X-Robots-Tag form, and that the header, user agent name, and values are not case sensitive.

What does none mean?

none is a compact form of two separate rules. Google's table defines it as equivalent to noindex, nofollow: noindex prevents the page, media, or resource from appearing in search results, while nofollow tells Google not to follow links on the page. Google also says that, without nofollow, it may use links on the page to find linked pages.

<meta name="robots" content="none">

This value therefore carries both the page visibility restriction and the link-following restriction. A page must still be crawled for Google to read its robots metadata.

What happens when all and none are combined?

Google allows a multi-rule instruction with comma-separated values or multiple meta tags. For example, the following uses the documented syntax for combining rules:

<meta name="robots" content="all, none">

The combined result is the none result, equivalent to noindex, nofollow. This follows from Google's three documented rules: all has no restrictions, none expands to two restrictive rules, and the more restrictive rule applies when rules conflict. Writing all alongside none therefore adds no permission that changes the outcome.

The same combination can be written as separate tags:

<meta name="robots" content="all">
<meta name="robots" content="none">

Google's reference also shows separate tags for noindex and nofollow, and says that the rules are combined across that form. The page does not provide a standalone example containing both all and none; the result above is the direct application of its stated equivalence and conflict rule.

How does this relate to robots.txt?

robots.txt controls crawler access to URLs. Google says that a robots metadata tag and an X-Robots-Tag header are discovered when a URL is crawled, and that rules in those locations are ignored when crawling is disallowed by robots.txt. A none value consequently needs crawl access before it can be read.

Google's robots.txt guide also says that a disallowed URL can still appear in search results when other pages link to it, even though Google has not visited the page. For a page-level exclusion, Google's guide points to noindex or password protection. The none value supplies the noindex and nofollow metadata rules after Google can access the response.

Related terms

• Meta robots
• X-Robots-Tag
• noindex
• nofollow
• robots.txt

FAQ

Is all required for normal indexing?

No. Google documents all as the default and says that explicitly listing it has no effect.

Does none mean only noindex?

No. Google defines none as the combination noindex, nofollow, so it covers search visibility and link following.

Can none replace a robots.txt rule?

They control different stages. none is page metadata that Google reads during crawling, while robots.txt controls crawler access to the URL. Google says a disallowed URL can still appear when linked from elsewhere, and recommends noindex or password protection for keeping a page out of Search.

Sources

1. Google Search Central, "Robots Meta Tags Specifications", 24 March 2026
2. Google Search Central, "Introduction to robots.txt", 10 December 2025

---

Check how a page reads to answer engines. Open the GEO score analyzer