meta warning meta/robots

Robots Meta Tag SEO Rule

Validate robots meta tags for correct crawl and index directives without conflicting signals

What This Rule Checks

Validates robots meta tag content for conflicting directives (index vs noindex, follow vs nofollow), empty tags, multiple tags, low max-snippet values, and Googlebot-specific tags.

Why It Matters for SEO & GEO

Robots meta tags control how search engines crawl and index your pages. Conflicting or incorrect directives can prevent pages from appearing in search results entirely.

How to Fix

Use clear, non-conflicting robots directives. Remove conflicting index/noindex or follow/nofollow pairs. Set appropriate max-snippet values (50+ recommended). Use one robots meta tag per page.

Examples

Bad

<meta name="robots" content="index, noindex">

Good

<meta name="robots" content="index, follow, max-snippet:-1">

How VibeLinter Checks Robots Meta Tags

VibeLinter’s meta/robots rule performs these checks on every page:

  1. Multiple tags — Flags multiple <meta name="robots"> tags on the same page
  2. Empty content — Warns about robots tags with empty content attributes
  3. Noindex detection — Reports pages set to noindex as informational
  4. Nofollow detection — Reports pages set to nofollow as informational
  5. Conflicting directives — Errors when both index and noindex appear together, or both follow and nofollow
  6. Max-snippet check — Warns when max-snippet value is below 50, which may limit search result visibility
  7. Googlebot-specific tags — Detects and reports <meta name="googlebot"> tags

Configuration

// vibelinter.config.cjs
module.exports = {
  rules: {
    'meta/robots': {
      enabled: true,
      severity: 'warning',
      checkConflicts: true
    }
  }
}

SEO Impact

Correct robots directives affect:

  • Indexing control — Determine which pages appear in search results
  • Link equity flow — Control how link value passes through pages
  • Snippet display — max-snippet controls how much content shows in search results
  • GEO (Generative Engine Optimization) — AI search engines respect robots directives; conflicting signals may cause AI models to skip your content entirely or include pages you intended to hide

Related SEO Topics

robots meta tag SEOnoindex nofollow directivescrawl directives optimizationsearch engine indexing controlrobots tag checkermax-snippet directive

Related Rules

References