A robots meta directive is an instruction, placed either in a page’s HTML meta tag or in an HTTP header, telling search engines how to handle crawling and indexing for that specific page — common directives include noindex, nofollow, and noarchive.
Unlike robots.txt, which operates at the site or directory level to block crawling access entirely, robots meta directives provide granular, page-specific control while still allowing the page itself to be crawled and its directives read.
Correctly auditing robots meta directives across a site is important, since misapplied directives — such as an accidental noindex on an important page — can silently remove valuable pages from search visibility.
Robots meta directive audits are a standard part of our Technical SEO service.