Kudurru, the new tool from the creator of Have I Been Trained?, can help artists block web scrapers and even “poison” the scraping by sending back the wrong image.

OpenAI’s spree of licensing agreements is paying off already—at least in terms of getting publishers to lower their guard.

If you're worried about AI bots scraping your website content to train AI, Cloudflare can help you fight back. The company, which claims to proxy about 20% of the web, has introduced a new tool ...

AI giants send bots out to crawl the web and scrape data for free. Adding insult to injury, the bots are disrupting sites and making cloud bills spike.

Internet giant Cloudflare says it detected Perplexity crawling and scraping websites, even after customers had added technical blocks telling Perplexity not to scrape their pages.

OpenAI and Anthropic have said publicly they respect robots.txt. But they are among the biggest tech companies ignoring the rule, BI has learned.

AI-powered search engines (e.g., OpenAI’s ChatGPT, Perplexity) are failing to drive meaningful traffic to publishers while their web scraping activities increase. That’s one big takeaway from ...

Cloudflare turns AI against itself with endless maze of irrelevant facts New approach punishes AI companies that ignore "no crawl" directives.

With robots.txt preferences widely ignored, the AI Preferences Working Group is developing a new way for publishers to shield content from AI bot scraping.

AI startup Perplexity is accused of scraping content from websites that block such actions. Cloudflare reported deceptive methods used by Perplexity to bypass restrictions.

I'm on a mission to review 1,000 marketing software tools and share my findings with over 100,000 small business owners worldwide. In an age where digital tools can make or break your business, I ...