This repository has been archived by the owner on Jan 15, 2022. It is now read-only.
Missing robots.txt #65
Comments
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Search engines seem to be indexing potentially sensitive user data on this site (search "site:verify.edx.org"). I believe this can be fixed by simply adding an appropriate robots.txt.
The text was updated successfully, but these errors were encountered: