/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

lukealexdavis.co.uk
| | seirdy.one

I added an entry to my robots.txt to block ChatGPT's crawler, but blocking crawling isn't the same as blocking indexing; it looks like Google chose to use the
3.0 parsecs

Travel
| |
| | audisto.com

Use our scalable indexability checker to test how a robots directive noindex, robots.txt directive, canonical link, hreflang or duplicate content affects the indexability and SEO of your website.
2.8 parsecs

Travel
| |
| | mmazzarolo.com

A robots.txt file tells search engine crawlers which pages or files the crawler can or can't request from your site. Next.js does not generate a robots.txt out-of-the-box, so here are a couple of options on how to create it.
2.6 parsecs

Travel
| |
| | www.alistairshepherd.uk

How you can use Netlify to set up your own GeoIP API service with no rate limits, payment plans or tracking!
13.7 parsecs

Travel
|