Saturday, June 22, 2024
HomeRuby On RailsDealing with area redirection whereas sustaining totally different google crawl attributes utilizing...

Dealing with area redirection whereas sustaining totally different google crawl attributes utilizing Cloudflare


neeto is a set of various sofwares. Every neeto
product will get its personal web page. For instance neetoCal will get the url
https://www.neeto.com/neetocal.

On the subject of truly utilizing these merchandise you may be redirected to
https://subdomain.neetocal.com. Right here “subdomain” could be the subdomain
allotted to you while you signed up for neeto.

We deliberate so as to add “Google register” function to make it simpler for the parents to
each signup and to log in. Throughout testing all of it labored effective. Nonetheless, after we
requested “Google” to approve the app “neetoCal” for “Google register” Google
demanded that our customers ought to be capable to see the “Privateness Coverage” and “Phrases of
circumstances” on the web site. With a purpose to make Google joyful we added a redirection
from “neetocal.com” to “neeto.com/neetocal”.

Nonetheless, Google was not pleased with it. The customers are logging into
https://subdomain.neetocal.com so the “privateness coverage” and “phrases of service”
needs to be seen on the area “neetocal.com” itself.

We’re utilizing cloudflare as our DNS supplier. Utilizing the instruments offered to us by
Cloudflare we determined to indicate the content material of “neeto.com/neetocal” on
“neetocal.com” with out redirecting the person.

Observe that on this case if you happen to kind “neetocal.com” then you will notice the url
change to “neetocal.com/neetocal” immediately. That is as a result of the url of the principle
advertising and marketing web site is “neeto.com/neetocal”.

Cloudflare gives
Web page guidelines
which we will probably be utilizing to realize our objectives. Under is video of the way it was completed.

The google search engine would not prefer it after we present the precisely identical content material
on two totally different domains. Google thinks that the positioning is attempting to cheat Google
and Google will punish each the websites.

We wish Google to index our major advertising and marketing web site https://neeto.com/neetocal and
we wish Google to disregard “neetocal.com”. One technique to inform Google to not index the
web site is by including a noindex
meta tag.

1<meta title="robots" content material="noindex">

Within the above instance we’re asking all bots to to not index the web page containing
the above meta tag.

We deliberate to inject this meta tag when a web page is rendered for the url
“neetocal.com” and we is not going to inject this tag when the web page is rendered for url
“neeto.com”.

Upon extra analysis we discovered that serps additionally take a look at the response
headers. Given under is the sequence that serps comply with for indexing the
net pages.

  • Crawler will get the uncooked web page supply as a response to the HTTP request.
  • Crawler checks if x-robots-tag: noindex, nofollow header is current within the
    response.
  • Crawler checks the meta tags to find out if the web page must be listed or
    not.

If a web page has x-robot-tag: noidex, nofollow then the crawler is not going to index
the web page.

Based mostly on this data we determined to make use of
Response Header Modification Guidelines
function of Cloudflare. Under is a video of the way it was completed.

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular

Recent Comments