A meta tag is used to disallow single files and pages. Robots.txt is used to disallow a whole section of a site, such as a category. You can use both a meta robots tag and a robots.txt file as neither has authority over the other. However, meta Robot tags are better as they help in forcing the search engine crawlers not to index and display hidden pages. It also ensures that the link equity is not being lost, with the use of the ‘follow’ command.
