What Is the Robots META Tag/Element

Q

What Is the Robots META Tag/Element? - XHTML 1.0 Tutorials - Document Structure and Head Level Tags

✍: FYIcenter.com

A

The robots meta element is a special meta element that provides directives to robots who is visiting the XHTML document. The robots meta element must include the "name" attribute as, name="robots". The "content" attribute must use predefined values of:

  • content="index,follow" - Asking the robot to index the document, and follow links in the document.
  • content="noindex,nofollow" - Asking the robot to not index the document, and not follow links in the document.
  • content="index,nofollow" - Asking the robot to index the document, and not follow links in the document.
  • content="noindex,follow" - Asking the robot to not index the document, and follow links in the document.
  • content="all" - Same as content="index,follow".
  • content="none" - Same as content="noindex,nofollow".

Here is a good example of the robots meta element:

<meta name="robots" content="index,follow" />

2007-05-12, 4528👍, 0💬