Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dagger indexing issue #22

Open
TWiStErRob opened this issue Mar 15, 2023 · 3 comments
Open

Dagger indexing issue #22

TWiStErRob opened this issue Mar 15, 2023 · 3 comments

Comments

@TWiStErRob
Copy link
Owner

Somehow Dagger URLs are showing up on my page:
https://www.google.com/search?q=site%3Atwisterrob.net+dagger

even though I don't have that folder, nor had it for a long long time. It's a potential redirect from
twisterrob.github.io/dagger which would be from the www.github.com/twisterrob/dagger repository. But that repo has been deleted long ago (months), and my DNS was set up to redirect a long time ago too (years).

image

image

TWiStErRob added a commit that referenced this issue Mar 15, 2023
@TWiStErRob
Copy link
Owner Author

Not a clue why this is happening, for now trying to use robots.txt to prevent this. Looking at the search results in Google these two represent the all the potential patterns:

http://www.twisterrob.net/dagger/api/2.13/dagger/android/support/class-use/FragmentKey.html
http://www.twisterrob.net/dagger/api/latest/dagger/grpc/server/class-use/CallScoped.html

So I removed the host and the package folders, and blanket ignored the rest in ed799f9

@TWiStErRob
Copy link
Owner Author

If it doesn't help https://search.google.com/search-console/remove-outdated-content might help.

@TWiStErRob
Copy link
Owner Author

Submitted a few today about 9 out of 15 results + the /dagger/ prefix.

TWiStErRob added a commit that referenced this issue Oct 25, 2023
[FIX] #22: workaround by forbidding robots
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant