You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Oct 15, 2024. It is now read-only.
Just leaving this here as Discord doesn't have threads and I dont want to lose it :)
I've noticed the robots.txt file on a couple of sites are all displaying the local version. Even though the environment in the settings is set to live.
Sitemap: https://www.domain.com/sitemaps-1-sitemap.xml
# local - disallow all
User-agent: *
Disallow: /
Is there another setting I should be aware of, I cannot see anything other settings relating to robots.txt. I have cleared all caches too. Thanks in advance.
Just leaving this here as Discord doesn't have threads and I dont want to lose it :)
I've noticed the robots.txt file on a couple of sites are all displaying the local version. Even though the environment in the settings is set to
live.Is there another setting I should be aware of, I cannot see anything other settings relating to robots.txt. I have cleared all caches too. Thanks in advance.