Explore >> Select a destination
|
You are here 
|
www.searchenginejournal.com | ||
| | | | |
sixcolors.com
|
|
| | | | | Six Colors by Jason Snell, Dan Moren and friends | |
| | | | |
arstechnica.com
|
|
| | | | | Restrictions don't apply to current OpenAI models, but will affect future versions. | |
| | | | |
seirdy.one
|
|
| | | | | I added an entry to my robots.txt to block ChatGPT's crawler, but blocking crawling isn't the same as blocking indexing; it looks like Google chose to use the | |
| | | | |
tsak.dev
|
|
| | | With the recent news of OpenAI's web crawler respecting robots.txt and the ensuing scramble by seemingly everybody ensuring their robots.txt is blocking GPTBot, I was thinking if there wasn't a better solution to help our future AI overlords make sense of the world. As I am hosting all my sites on a tiny NUC using nginx and having previously played with its return directive I decided to reuse the same trick for visits of GPTBot. | ||
