Replies: 0
I installed a subdirectory on my site: subdomain.mysite.com and this url appears in search results which I want to avoid since it’s only for members. I’m unable to use google remove tool because it will remove it for 90 days. Could someone offer a simple way to prevent this url from being crawled by search engine robots.
I was reading https://moz.com/community/q/block-an-entire-subdomain-with-robots-txt but I’m unsure how to block this url from being crawled by search engine robots.