Meta Self-built AI Scans the entire internet, triggering alarms from independent developers
2026-08-08 14:15:25
According to CoinMeta, Meta's self-built AI search system is crawling web pages at high frequency across the internet. Independent developer Pieter Levels claims that Meta has been frequently crawling multiple websites under his domain this week, causing one of the VPS servers to trigger load alarms multiple times. According to Datadome's statistics, in the second quarter of this year, Meta's two AI crawlers issued a total of 9.1 billion requests. Among them, the meta-webindexer crawler responsible for building the search index saw a 163% increase in a single quarter, and in June, its request volume surpassed that of the training crawler for the first time. Meta was exposed in 2024 for building its own search engine, with the aim of reducing dependence on Google and Bing. Despite the accelerated expansion of the search index, such intensive crawling has hardly brought any real users to the websites.
Bullish 0
Bearish 0
Source:Internet
This content is for market information only and does not constitute investment advice.