Mind blowing SEO improving and Google rank increasing Signature Rotator SEO Tool.


Why robots.txt file is important to Website ?

jasminekour12 Offline referral

Posts: 25
Joined: Dec 2015
Reputation: 0

Junior Member
Hello Friends,

I want to know that Why robots.txt file is important to Website ? tell me guys,,
Victor Dub Offline referral

Posts: 462
Joined: Oct 2013
Reputation: 1

Senior Member
It's not too important most of the sites don't need it BUT if you need to prevent some files from being indexed then you have to use it.
chinomoreno Offline referral

Posts: 177
Joined: Jan 2015
Reputation: 1

Robots.txt file is use to tell search engines on how to behave when crawling website pages.

User(s) browsing this thread: 1 Guest(s)