Identifying AI Web Scrapers Using Canary Tokens
This paper proposes a novel technique for accurately and automatically inferring LLM-related scrapers and demonstrates that the approach can reliably identify which scrapers feed which LLM, including several that are not publicly known or disclosed by the companies.