Outer Web | Explore

/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.

You are here		coryd.dev Go ahead and block AI web crawlers
\|	\|	www.coryd.dev Go ahead and block AI web crawlers Cory Dransfeldt	0.0 parsecs away Travel
\|	\|	AI companies are crawling the open web to, ostensibly, improve the quality of their models and products. This process is extractive and accrues the benefit to said companies, not the owners of sites both small and large.	0.0 parsecs away Travel
\|	\|	www.theverge.com Now you can block OpenAI's web crawler \| The Verge	1.2 parsecs away Travel
\|	\|	Website owners can stop OpenAI's new web crawler GPTBot from using information from sites to train its GPT models with a simple addition to the metadata.	1.2 parsecs away Travel
\|	\|	ericlathrop.com Blocking AI (Machine Learning) Bots from Training on Your Website Content by Eric Lathrop	1.6 parsecs away Travel
\|	\|	All sorts of companies are building machine learning models by crawling the web for training data. This is a form of copyright laundering, and the legality is questionable.	1.6 parsecs away Travel
\|	\|	url.town url.town	18.8 parsecs away Travel
\|		url.town is a web directory curated by the omg.lol community.	18.8 parsecs away Travel