Meta Self-built AI Scans the entire internet, triggering alarms from independent developers
2026-08-08 14:15:25
According to CoinMeta, Meta's self-built AI search system is crawling web pages at high frequency across the internet. Independent developer Pieter Levels claims that Meta has been frequently crawling multiple websites under his domain this week, causing one of the VPS servers to trigger load alarms multiple times. According to Datadome's statistics, in the second quarter of this year, Meta's two AI crawlers issued a total of 9.1 billion requests. Among them, the meta-webindexer crawler responsible for building the search index saw a 163% increase in a single quarter, and in June, its request volume surpassed that of the training crawler for the first time. Meta was exposed in 2024 for building its own search engine, with the aim of reducing dependence on Google and Bing. Despite the accelerated expansion of the search index, such intensive crawling has hardly brought any real users to the websites.
Source:Internet
This content is for market information only and does not constitute investment advice.
Follow HKWDB official accounts to stay updated
Hot Articles
Refresh

Web3: Circle obtains New York trust license, expanding USDC custody business.
07-31 22:04

Tesla reportedly plans to divest its China business to pave the way for integration with SpaceX.
07-31 21:54

web3: Foreign media: RWA perpetual contracts may expand faster than tokenization
07-31 21:24

Web3: Foreign media: Analysts say the real catalyst for XRP is not the Clarity Act.
07-31 20:55

Foreign media: Trump's children's accounts are unlikely to replace comprehensive family financial planning
07-31 20:24

