Thursday, March 27, 2014

Use for Robots.txt file

The robots.txt file is used to control how search engines crawling and indexing your website.

#Code to not allow any search engines
User-agent:*
Disallow:/

No comments:

Post a Comment