This is a test Post

BlogSpot SEO Tip #21: Blogger custom Robots.txt

Blogger custom Robots.txt is another very important inbuilt SEO tool in Blogger. Remember that everything you do in this section should do with your caution. One small mistake can ruin your blog pages showing in search results, especially mistakes in Custom Robots.txt.

What is Robots.txt?

Robots.txt is a text file which is hosted on Blogger servers (where your blog is hosted) that indicates search engine bots what to follow and crawl. We used Blogger Custom Header tags to protect special blog posts from search engines. But we can use Blogger Robots.txt file to protect individual web pages and also do some advanced SEO tasks.

When a web spider starts following links on your blog, first of all it reads the Robotx.txt file. Then follow its rules and crawl your web pages.

How to Use Blogger Robots.txt file to improve SEO of BlogSpot?

You can use Robots.txt file to protect low quality web pages from following and crawling by search engine bots. Here’s a sample code of Robots.txt