Scraping the web into your vector DB: EDPB's new rules
At its 122nd plenary on 7 July 2026 the EDPB adopted draft Guidelines 03/2026 on web scraping for generative AI and draft Guidelines 02/2026 on anonymisation, the first comprehensive GDPR framework for large-scale scraping of public web data into AI pipelines. We walk through the legitimate interest test, the new legal weight of robots.txt and ai.txt, the Article 9 lifecycle safeguards, and what it means for teams ingesting web content into RAG on Azure.