Alibaba Cloud (BABA) has detailed a GPU pooling system that it claims reduced the number of Nvidia (NVDA) H20s required by 82% when serving dozens of LLMs of up to 72B parameters, Vincent Chow of The South China Morning Post reports.
Claim 30% Off TipRanks
Trade NVDA with leveragePublished first on TheFly – the ultimate source for real-time, market-moving breaking financial news. Try Now>>
Read More on BABA:
- Bullish flow in Alibaba with shares up 4.15%
- Midday Fly By: AWS hit by outage, Kering sells beauty unit
- JD.com, Ant pause stablecoin plans after regulators raise concerns, FT reports
- Alibaba’s Stock Soars: AI and Cloud Drive Growth
- Cathie Wood Invests $12.3M in Alibaba Stock (BABA) as Wall Street Grows More Bullish