Do Son Major publishers are blocking the Internet Archive to stop AI firms from stealing data. Discover how the "ia_archiver" became collateral damage in the AI wars.
data scraping
The Distillation War: Anthropic Accuses DeepSeek and Chinese Rivals of ‘Industrial-Scale’ Data Theft
The Distillation War: Anthropic Accuses DeepSeek and Chinese Rivals of ‘Industrial-Scale’ Data Theft
Anthropic claims DeepSeek and other Chinese AI firms used 24,000 accounts to "pilfer" Claude's data. Inside the high-stakes battle for LLM training secrets.
Amazon and Microsoft launch competing AI content marketplaces, turning the "Wild West" of data scraping into a multi-billion dollar licensing frontier.
Reddit has filed a lawsuit against Perplexity and three data brokers, accusing them of unauthorized, "industrial-scale" scraping of its content for AI training.
Reddit is blocking the Internet Archive from crawling its site, citing concerns that AI companies are using it as a workaround to scrape data for free.
Mastodon updates its Terms of Service, formally prohibiting unauthorized AI data scraping and LLM training, effective July 1, 2025. Other Fediverse instances may follow.
Elon Musk's X (formerly Twitter) has updated its API terms, banning AI model training on its data. This move protects Grok while impacting developers.
Reddit is suing AI firm Anthropic for unauthorized data scraping to train AI models, alleging violations of its user agreement and seeking damages.