The New York Times blocks OpenAI’s web crawler

The New York Occasions has blocked OpenAI’s internet crawler, which means that OpenAI can’t use content material from the publication to coach its AI fashions. In case you verify the NYT’s robots.txt page, you’ll be able to see that the NYT disallows GPTBot, the crawler that OpenAI launched earlier this month. Primarily based on the Web Archive’s Wayback Machine, it seems NYT blocked the crawler as early as August seventeenth.

The change comes after the NYT up to date its phrases of service at first of this month to ban the usage of its content material to train AI models. New York Occasions spokesperson Charlie Stadtlander spokesperson declined to remark. OpenAI didn’t instantly reply to a request for remark.

Replace August twenty first, 7:55PM ET: The New York Occasions declined to remark.