Anthropic’s crawler is ignoring websites’ anti-AI scraping policies
Anthropic’s crawler is ignoring websites’ anti-AI scraping policies Image: The VergeThe ClaudeBot web crawler that Anthropic uses to scrape training data for AI models like Claude has hammered iFixit’s website almost a million times in a 24-hour period, seemingly violating the repair company’s Terms of Use in the process.
“If any of those requests accessed our terms of service, they would have told you that use...