/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

www.dannyguo.com
| | lukealexdavis.co.uk

I wrote some thoughts about robots.txt and how you should use it.
2.2 parsecs

Travel
| |
| | seirdy.one

I added an entry to my robots.txt to block ChatGPT's crawler, but blocking crawling isn't the same as blocking indexing; it looks like Google chose to use the
1.9 parsecs

Travel
| |
| | www.thisdaysportion.com

[AI summary] The author disables Google indexing for their personal site to prioritize a word-of-mouth community over search engine marketing.
3.0 parsecs

Travel
| |
| | bitsofco.de

Articles on frontend development and more.
23.5 parsecs

Travel
|