Follow

Not sure if this will work but I want only DuckDuckGo to be able to index my wiki.

avanier.now.sh/robots.txt

Update: it works! Ara's content shows up on DuckDuckGo searches only, as far as I can tell.

Google has some indexed search results of past versions of a few pages but they're mostly dead links so I can live with that.

Show thread

@joshavanier thank you! that's exciting. I may do something similar because fuck you know who. Haha.

@joshavanier This will probably not work completely, because “if other pages point to your page with descriptive text, your page could still be indexed without visiting the page.”¹. You could use <meta name="googlebot" content="noindex" />² to at least keep google out.

¹ https://support.google.com/webmasters/answer/6062608?hl=en ² https://developers.google.com/search/reference/robots_meta_tag

@tastytea Huh, that's interesting. Thanks for pointing it out

Sign in to participate in the conversation
Merveilles

Revel in the marvels of the universe. We are a collective of forward-thinking individuals who strive to better ourselves and our surroundings through constant creation. We express ourselves through music, art, games, and writing. We also put great value in play. A warm welcome to any like-minded people who feel these ideals resonate with them. Check out our Patreon to see our donations.