Meta Shelves Web-Scraping Clause From Business Terms After Backlash

Meta indefinitely paused new business terms letting it scrape website content, after court injunctions and a UK regulatory probe.

Nov 21, 2026 - 07:12
4 min read
 0
Meta Shelves Web-Scraping Clause From Business Terms After Backlash

On November 20th, Meta was set to start treating every small business that runs ads on Facebook or Instagram as fair game for its web crawlers. That date came and went with the policy shelved instead, less than three weeks after Meta quietly pushed the start date back once already.

What the clause actually tried to do

Back in September, Meta rewrote the commercial terms that apply to anyone using a Meta Business account — the dashboard behind ad campaigns, WhatsApp Business catalogues, and Instagram shopping tags. Buried in the update was language letting Meta "crawl" and "scrape" web content connected to those accounts. In plain terms, scraping means automatically pulling data off a website rather than a person reading it manually, and crawling is the bot that goes page to page doing it. Meta said this only covered ads and business tools. Legal experts who read the fine print disagreed, warning it could sweep in entire news websites and blogs, since so many publishers also run a Meta Business account just to manage their Facebook page or ad budget.

The optics got worse when outlets noticed Meta had quietly dropped the word "train" from an earlier draft, without changing what the clause actually permitted. That looked less like a concession and more like a rewrite aimed at the headlines rather than the substance — exactly the kind of move that invites the scrutiny it got.

Regulators and courts moved faster than Meta expected

The pushback wasn't limited to angry blog posts. Courts in Norway and Brazil issued preliminary injunctions — early court orders that block a company from doing something while a case is still being argued — specifically against the new terms. The UK's Competition and Markets Authority opened a formal investigation. And in Washington, senators from both parties sent a joint letter asking Mark Zuckerberg to withdraw the update outright, which is the kind of bipartisan agreement that rarely happens over a terms-of-service page.

"The update to our commercial terms is not about scraping news sites," Meta spokesperson Daniel Roberts told The Verge, adding that the company's crawling practices weren't changing and that site owners could still opt out through robots.txt.

Robots.txt is a small text file website owners can publish that tells automated bots which pages they're allowed to visit — it's a request, not a lock, and compliance depends entirely on the crawler choosing to honor it. That's exactly why legal experts stayed unconvinced: a company that writes itself broad scraping permission in its own terms doesn't need to respect a file it has no legal obligation to read.

Why Indian businesses should care, even without an injunction of their own

No Indian court or regulator has weighed in on this one, and that silence is itself worth noticing. India is Meta's single largest market by user count across Facebook, Instagram, and WhatsApp, and millions of small Indian merchants — from Tier-2 boutique sellers to D2C brands — run their entire storefront through Meta's Business Suite. If the clause had gone live globally, their product listings, catalogues, and linked websites would have fallen under the same terms that Norwegian and Brazilian judges found troubling enough to block. India's own Digital Personal Data Protection Act gives individuals rights over personal data, but it wasn't built with AI-training-scale web scraping of business content in mind, and no Indian authority has publicly tested whether it would even apply here. For now, Indian businesses got the benefit of a European court's skepticism, not a protection written into their own law.

What actually changes, and what doesn't

  • The new terms are paused indefinitely — not cancelled. Meta's existing, older terms stay in effect in the meantime.
  • The start date had already slipped once, from October 30 to November 20, before this pause.
  • Meta maintains its crawling behavior isn't changing regardless of how the terms are worded.
  • Legal scrutiny of the clause's actual wording — not just its headline-grabbing bits — is still ongoing in multiple jurisdictions.

This connects to a broader fight playing out over who gets to decide what AI companies can scrape in the first place — Code24 covered the industry's attempt to standardize that through a single shared robots.txt rule earlier this year, an effort that only works if companies actually treat the file as binding rather than optional.

A pause bought by injunctions in Oslo and São Paulo and a stern letter from Washington doesn't automatically protect a shop owner in Surat or Coimbatore running the same Business Suite account. If this clause — or something close to it — comes back once the legal pressure eases, it will likely return quietly, in the kind of terms-of-service update almost nobody reads before clicking accept.

Short URL: https://code24.in/a77c7ff4

What's Your Reaction?

Like Like 0
Dislike Dislike 0
Love Love 0
Funny Funny 0
Angry Angry 0
Sad Sad 0
Wow Wow 0
Ashif Sadique As an full-stack developer, I'm passionate about sharing tutorials and tips that aid other programmers. With expertise in PHP, Python, Laravel, Angular, Vue, Node, Javascript, JQuery, MySql, Codeigniter, and Bootstrap. To me, consistency and hard work are the keys to success.