Preventing look of particular directories/pages in google search engine result

I have my individual homepage, and also I desire the major web page itself to show up in search engine result. Yet I do not desire a particular directory site and also its subdirectories to show up in google search engine result. Just how do I do this?

0
2019-05-07 13:12:20
Source Share
Answers: 3

forbid the search crawlers to enter these areas:

http://www.robotstxt.org/robotstxt.html

google defines the procedure pretty good, instance offered:

User-agent: *
Disallow: /folder1/

This forbids all crawlers to index the web content of "/ folder1/"

0
2019-05-09 07:49:48
Source

There are numerous devices you can make use of to do this.

The first is the robots.txt documents. This is a method which is willingly adhered to by "excellent" search engines by google, and also permits you to detail areas of your website which they will certainly not adhere to.

Customer - representative : *
Disallow :/ myfolder/

The next is meta tags. Specific web pages can be marked with metadata which informs robotics not to index or present them. Google has a nice writeup on how to implement these.

<meta name="robots" content="noindex,nofollow">

The last device, if the web pages have actually currently been indexed, is to make use of the internet search engine's elimination device if one exists. I've connected to the documents for Google, Bing, and also Yahoo's elimination devices below:

0
2019-05-09 07:49:21
Source

Use a robots.txt documents in your major folder and also set it to:

User-agent: *
Allow: /

In the folder you do not desire any person to accessibility placed a robots.txt documents with this body:

User-agent: *
Disallow: /

Checkout http://www.robotstxt.org/ for even more details concerning robot.txt documents.

0
2019-05-09 07:47:59
Source