Came across an interesting article and thought I’d share it. ChatGPT is pretty neat and useful for a lot of folks, but there are also those who don’t take too kindly to it scraping their data to train their LLMs (large language models). For example those who publish copyrighted works online, or thos…

How to prevent ChatGPT from crawling your website

Heroic_Nonsense (Erwin Leerentveld) 4 July 2024 12:35 17

Cloudflare have just announced a tool that helps you prevent AI-bots from scraping your website.

Cheers,
Erwin

2 Likes

Topic		Replies	Views
Defeating AI scraping Classic	2	45	7 November 2024
How do you prevent a page form beeing seen by any search engines Classic	21	2008	25 February 2016
What do I need to specify in my robots.txt fie Classic	4	546	9 June 2018
Robots text to preclude indexing of one page only Classic	5	228	27 May 2021
How to hide pages using htaccess Classic	16	2322	23 June 2018