Facebook Twitter RSS feed Google +1 Email pinterest
News Update :
Home » , , , , , » How to add Custom Robot.txt to Blogger | Crawlers and Indexing

How to add Custom Robot.txt to Blogger | Crawlers and Indexing

Penulis : Arafat on Mar 17, 2013 | 1:09 PM

Robot is simply a software of Google Search Engine which is send by Google to collect information from all the websites which are newly discovered. I have already discussed about Crawling and Indexing in my previous post. Now I'm going to discuss about how to add custom robot text to blogger.



Before starting first we have to know about Custom text. Custom text is the direction to the Robot software that how it crawl the site which is given by the administrator. It allows Robot to crawl and index maximum number of pages from the website. So it essential for the Search Engine Optimization (SEO).

How to add Custom Robot.txt to Blogger blog:
There is no hardness to add this text which can be done even a beginner. So lets go the steps:
  1. Go to the Dashboard and select Settings from the left bar.
  2. Select Search preference from submenu.
  3. At the right, go to the Crawlers and Indexing section. 
  4. Click edit in Custom robot.txt and select yes.
  5. Add this code given below in the box which will appear just below the Custom robot.txt.
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search?q=*
Disallow: /*?updated-max=*
Allow: /

Sitemap: http://www.technocarebd.blogspot.com/feeds/posts/default?orderby=updated
Note: Red line denotes the link of your sitemap URL/RSS feed URL.

Now you have almost done.

Now take a look what you have done.


Click Save Changes.

Share this article :

+ comments + 7 comments

June 17, 2013

your method is good but i think my method is easy to implement check out here chillofyblogging.blogspot.in/2013/06/how-to-setup-custom-robotstxt-in.html

November 07, 2013

this is good
thanks bro

February 16, 2014

PrimeroTec - Web Designing Company in Tirunelveli >>>>> PrimeroTec - Web Designing Company in Tirunelveli
TN Results - Tn HSC Results 2014 >>>>> TN Results - Tn HSC Results 2014
Ziq - URL Shortener >>>>> Ziq - URL Shortener

August 18, 2014

robottxt is very important for search engine indexing.

add and bookmark your site link now : www.openadsus.com

September 29, 2014

This is interesting. Didn't know that we could add robots.txt in blogger. Good Post Mate!

Thanks for the usuful tips! I think that your blog is fantastic! Use CEO to know more.

June 03, 2022

Your post specially for SEO person. As per my knowloaged you should update your robots.txt file according to your need.
pest control richmond bc

Post a Comment

 
Privacy policy | Term of use | Widget | Advertise with Us | Site map
Copyright © 2011. :: TechnocareBD :: . All Rights Reserved.
Design Template by panjz-online | Support by creating website | Powered by Blogger