EAGLE-4 increases the generation speed of Qwen by 3.6 times, and mobile phones with CPU can also see a 3-fold speed increase
2026-10-21 19:13:27
According to CoinMeta, Eagle has released EAGLE-4, upgrading its inference and decoding solutions and improving the generation speed of Qwen. The new version focuses on reducing the computational overhead of the draft model and allows for adjustment of the prediction scale based on hardware performance and the number of concurrent tasks. On four NVIDIA B300 GPU, the single-request generation speed of Qwen (3.8-27B) has increased from 240.5 token per second to 863.8 token, a 3.6-fold improvement. When 512 requests are running simultaneously, the total throughput has increased from 21,200 token per second to 28,300, representing a 34% increase. There has also been a significant improvement on mobile devices; on a Motorola Razr with 70 Ultra, Gemma-4-E2B-IT achieved a 3.2-fold increase in long-text generation speed using only CPU, with task completion time reduced from 43 seconds to 14 seconds, and the energy consumption per token decreased by 53%. The code for EAGLE-4 has been made public, supporting integration with SGLang, VLLM, and the experimental TokenSpeed. However, the new version uses a restrictive commercial license, and commercial use requires separate authorization.
Source:Internet
This content is for market information only and does not constitute investment advice.
Follow HKWDB official accounts to stay updated

Hot Articles
Refresh

Bitcoin Price Today: ETF $527M Inflow Rebound or Bull Trap?
4h ago

US Memory Chip Stocks Surge: Can SanDisk's $70B Rally Last?
10-20 12:24

How to Get US Stock News in China? 4 Free Channels
10-16 19:24

What Is a Bitcoin ETF? $104.8B AUM, 6.38% Market Cap Explained
10-15 17:03

Microsoft Stock: $551, $2.5 From High, Breakout or Pullback?
10-14 14:56



