Mind blowing SEO improving and Google rank increasing Signature Rotator SEO Tool.


Do I need robots.txt even if I am not blocking any crawlers?

maria Offline referral

Posts: 242
Joined: May 2013
Reputation: 4

If I don't need to block any Google-bot, Bing-bot crawlers do I still need to create and have on my server robots.txt file?
surenot Offline referral

Posts: 500
Joined: Jan 2014
Reputation: 16

Senior Member
Robots.txt is used to deny access or prevent crawlers from indexing some directories or URLs. If you don't need that then you don't need the file.
KevinMax Offline referral

Posts: 577
Joined: Aug 2013
Reputation: 78

Senior Member
Sitemap / Meta Descriptions / Robots File / Meta Keywords are not a mandatory fields in SEO.

User(s) browsing this thread: 1 Guest(s)