Mind blowing SEO improving and Google rank increasing Signature Rotator SEO Tool.

Help Regarding Robots.txt

Ads
make money online
deepakrawat2u Offline referral

Posts: 12
Joined: Dec 2018
Reputation: 0

#1
Junior Member
Hi guys

User agent: *
Disallow: www. abc .com/products/123

Is that a right method of disallowing a file.

I am also familiar with

User agent:*
Disallow: /123

I just need to know if I write that file in the first given format. Does it make sense???? Or It will work?
Victor Dub Offline referral

Posts: 939
Joined: Oct 2013
Reputation: 5

#2
Posting Freak
No need to specify domain name in robots.txt!

Disallow: /products/123 -> this will block this particular directory!

if you want to block all links in some directory use * symbol as so!

Disallow: /products/*
or
Disallow: /products/123*
or
Disallow: /products/123/*

In Google webmaster tools search console account there is a robots.txt tester use it!
vinukum Offline referral

Posts: 33
Joined: Nov 2018
Reputation: 0

#3
Junior Member
In robot.txt file ,We recommend that you read the full syntax of robots.txt files because the robots.txt syntax has some subtle behavior that you should understand.



Google this topic


User(s) browsing this thread: 1 Guest(s)