Meta robots raw value
The meta robots raw value is the exact instruction set placed in a page’s robots meta tag. It tells search engines how the page should be treated, including whether it should be indexed, whether links should be followed, and whether certain search features are allowed.
Because this check stores the full raw string, it helps you spot even small directive changes that may affect indexing behaviour. That makes it a high-impact signal, especially when it changes on important pages or across templates.
What it is
The robots meta tag is a piece of HTML placed in the <head> of a page. It gives search engines page-level instructions.
A common example is:
index,follow,max-image-preview:large
This means the page can be indexed, links on the page can be followed, and large image previews may be shown in search results.
SEOlerts stores the exact content of that tag as a raw string. That matters because the full value can include several directives at once, and even a small edit can change how the page is handled.
Why it matters
Meta robots directives directly affect indexing. If they change unexpectedly, a page that was previously allowed into search results may become blocked from indexing, have its links ignored, or lose certain search presentation features.
Even where the change seems minor, the impact can still be meaningful. For example, changing from index,follow to noindex,follow can remove a page from search results over time. Changing to nofollow can alter how search engines treat links on the page. Removing preview-related directives may also affect how content appears in search.
Because this applies to all pages, an incorrect template change can spread very quickly across a whole site.
What can go wrong if unchecked
Unexpected changes to the raw robots value can cause pages to behave very differently in search without any visible change to the page for users.
Problems may include:
- important pages being set to
noindex - links on key pages changing to
nofollow - inconsistent directives across otherwise similar pages
- template or plugin updates overwriting intended settings
- staging or development directives being pushed live
A page can still load normally while becoming less visible or entirely excluded from search results. That is why robots changes are easy to miss unless they are monitored directly.
Not every change is harmful. Some pages should be noindex, and some directives may be updated deliberately. The risk comes from unplanned or unexplained changes.
Why monitoring it matters
Monitoring the full raw robots value helps you catch both major and subtle changes. Instead of checking only whether a page is indexable in broad terms, this method records the exact directive string for comparison.
That is useful because real-world robots tags often contain multiple instructions. A page may still say index, but another directive in the string may have changed and still affect SEO behaviour. Storing the full value gives you a more reliable record of what was actually present.
This is especially useful after CMS updates, plugin changes, template edits, JavaScript rendering changes, or deployments that affect page head elements.
What an alert may mean
An alert means the exact content of the robots meta tag is different from the previously stored version.
In practice, that could mean:
- indexing has been opened up or restricted
- link-following instructions have changed
- preview-related directives have been added, removed, or edited
- a template or plugin has changed the default page settings
- a technical change has altered the page head output
The alert does not automatically mean there is a problem. It may reflect a planned SEO update. But because robots directives influence how search engines treat the page, the reason for the change should be checked promptly.
What to check next
Start by comparing the old and new robots values exactly. Identify which directive changed rather than treating the whole string as one block.
Then check:
- whether the change was intentional
- whether the page should still be indexable
- whether
followornofollownow matches the intended behaviour - whether the change affects one page, a section, or a shared template
- whether recent CMS, plugin, or deployment changes explain it
If the new value includes noindex, review affected pages quickly, especially if they are important landing pages, category pages, or other URLs that should remain visible in search.
It is also sensible to review related signals such as canonicals, HTTP status codes, and XML sitemap inclusion. A robots directive change may be part of a wider indexing change.
Key takeaway
The meta robots raw value is the exact set of indexing instructions in a page’s robots meta tag. Monitoring the full string helps you catch both obvious and subtle directive changes before they affect search visibility. An alert means the page-level instructions given to search engines have changed, and those changes should be checked to confirm they are intentional and appropriate.
