The Robots meta tag is used to inform search engine crawlers if they are allowed to index a selected web page and adhere to its back links. When analyzing your web site's accessibility, you wish to discover pages which are inadvertently blocking crawlers. Here's an example of a robots https://www.youtube.com/watch?v=EVeTP0aV8gY