Quantcast
Viewing all articles
Browse latest Browse all 512573

block a subdomain with .htaccess or robots.txt

Replies: 0

I installed a subdirectory on my site: subdomain.mysite.com and this url appears in search results which I want to avoid since it’s only for members. I’m unable to use google remove tool because it will remove it for 90 days. Could someone offer a simple way to prevent this url from being crawled by search engine robots.

I was reading https://moz.com/community/q/block-an-entire-subdomain-with-robots-txt but I’m unsure how to block this url from being crawled by search engine robots.


Viewing all articles
Browse latest Browse all 512573

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>