/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

 www.marginalia.nu
For Webmasters @ marginalia.nu
| | www.dannyguo.com
How to Prevent a Website Page From Showing Up in Search Results
2.0 parsecs away

Travel
| | [AI summary] A guide explaining how to prevent specific pages from appearing in search engine results using meta tags and HTTP headers instead of robots.txt.
| | seirdy.one
Opting out of LLM indexing - Seirdy
2.7 parsecs away

Travel
| | I added an entry to my robots.txt to block ChatGPT's crawler, but blocking crawling isn't the same as blocking indexing; it looks like Google chose to use the
| | arstechnica.com
Sites scramble to block ChatGPT web crawler after instructions emerge | Ars Technica
4.3 parsecs away

Travel
| | Restrictions don't apply to current OpenAI models, but will affect future versions.
| | jabberwocking.com
The New York Times has sued OpenAI for copyright infringement. They should lose. Kevin Drum
15.0 parsecs away

Travel
| The New York Times is suing Microsoft and OpenAI for training their AI software on Times stories: In a complaint filed Wednesday, the Times said the technology companies exploited its content without permission to create their AI products, including OpenAIs humanlike chatbot ChatGPT and Microsofts Copilot. The tools were trained on millions of pieces of Times content, the suit said, and