Mind blowing SEO improving and Google rank increasing Signature Rotator SEO Tool.

Thread: 

google robots

Ads
banner
banner
banner
Alex Thompson Offline referral

Posts: 101
Joined: Aug 2013
Reputation: 9

#1
Member
what are google robots in SEO?
chod Offline referral

Posts: 860
Joined: Jul 2013
Reputation: 85

#2
Posting Freak
The magical thing that comes and indexes your site and its content Wink
www.AdminEmpire.com
www.BlimptonTech.com - Best Free Online JavaScript tool to minify JavaScript files.
invisibe_dude Offline referral

Posts: 820
Joined: May 2013
Reputation: 24

#3
Posting Freak
It's called GoogleBot
antony Offline referral

Posts: 478
Joined: Jul 2013
Reputation: 5

#4
Senior Member
Once you submit your site to Google, Google will try to crawl all the content of your site and sometimes may index pages or content you don't with to be indexed. So to prevent such a content or pages to get indexed by search engine you use robots.txt where you include URLs you don't want to get indexed!
chod Offline referral

Posts: 860
Joined: Jul 2013
Reputation: 85

#5
Posting Freak
@Anthony this has nothing to do with the OP. Stay on topic!!!
www.AdminEmpire.com
www.BlimptonTech.com - Best Free Online JavaScript tool to minify JavaScript files.
marcus_avrelius Offline referral

Posts: 2,424
Joined: May 2013
Reputation: 102

#6
Support Team
Robots.txt is good for SEO because it blocks crawlers from accessing sensitive URLs!
chod Offline referral

Posts: 860
Joined: Jul 2013
Reputation: 85

#7
Posting Freak
It will only block those that follow robots.txt. Most of what you have to worry about does not follow that file. Bad bots will never play by your rules.
www.AdminEmpire.com
www.BlimptonTech.com - Best Free Online JavaScript tool to minify JavaScript files.





User(s) browsing this thread: 1 Guest(s)