Mind blowing SEO improving and Google rank increasing Signature Rotator SEO Tool.

Do I need robots.txt even if I am not blocking any crawlers?

make money online
maria Offline referral

Posts: 242
Joined: May 2013
Reputation: 4

If I don't need to block any Google-bot, Bing-bot crawlers do I still need to create and have on my server robots.txt file?
surenot Offline referral

Posts: 498
Joined: Jan 2014
Reputation: 16

Senior Member
Robots.txt is used to deny access or prevent crawlers from indexing some directories or URLs. If you don't need that then you don't need the file.
KevinMax Offline referral

Posts: 579
Joined: Aug 2013
Reputation: 78

Senior Member
Sitemap / Meta Descriptions / Robots File / Meta Keywords are not a mandatory fields in SEO.

Google this topic

User(s) browsing this thread: 1 Guest(s)