/explore
|
You are here 
|
tracydurnell.com | ||
| | | | |
manuelmoreale.com
This is the 33rd edition of People and Blogs, the series where I ask interesting people to talk about themselves and their blogs. Today we have Tracy ... |
|
| | | | | ||
| | | | |
ericlathrop.com
All sorts of companies are building machine learning models by crawling the web for training data. This is a form of copyright laundering, and the legality is questionable. |
|
| | | | | ||
| | | | |
www.jeremiak.com
How I sniffed the user agent in an edge function to prevent some AI crawlers from accessing my site. |
|
| | | | | ||
| | | | |
tsak.dev
With the recent news of OpenAI's web crawler respecting robots.txt and the ensuing scramble by seemingly everybody ensuring their robots.txt is blocking GPTBot, I was thinking if there wasn't a better solution to help our future AI overlords make sense of the world. As I am hosting all my sites on a tiny NUC using nginx and having previously played with its return directive I decided to reuse the same trick for visits of GPTBot. |
|
| | | |||
