Mind blowing SEO improving and Google rank increasing Signature Rotator SEO Tool.

Thread: 

What is disallow in robots.txt file?

Ads
banner
banner
parmodshastri Offline referral

Posts: 43
Joined: Sep 2017
Reputation: 0

#1
Junior Member
Hlo Friends,
What is disallow in robots.txt file?
shyamdas Offline referral

Posts: 61
Joined: Jul 2017
Reputation: 0

#2
Member
It tells the crawler not to index the page.
easyweb Offline referral

Posts: 85
Joined: Oct 2017
Reputation: 0

#3
Member
yes, we use disallow in robots.txt file to tells crawler not to index the specific page or directory.
damponting44 Offline referral

Posts: 507
Joined: Oct 2016
Reputation: 0

#4
Senior Member
Web site holders utilize the /robots. Txt document should provide for guidelines regarding their webpage will web robots; this may be known as those Robots prohibition Protocol.
Those "Disallow: /" lets the robot that it ought not visit whatever pages on the site.
Shivam Tripathi Offline referral

Posts: 28
Joined: Sep 2017
Reputation: 0

#5
Junior Member
The pages which are only useful to admin or have some confidential content should be added to disallow in robots.txt file to restrict the crawler from indexing the pages.
johnray Offline referral

Posts: 131
Joined: Jul 2017
Reputation: 0

#6
Member
This file is used by search engines to index the website. If we want certain path in the website that search engines should not crawl, then we have to mention that path in disavow.txt file. if this file is not used then complete website is allowed to search engines by default.
Dodge ECM, Ford PCM, Ford ECU Repair Company
Avasmith Offline referral

Posts: 15
Joined: Nov 2017
Reputation: 0

#7
Junior Member
Disallow is use to tell search engine bot whether to allow or disallow the search engine bot or not!





User(s) browsing this thread: 1 Guest(s)