Alibaba Cloud (BABA) has detailed a GPU pooling system that it claims reduced the number of Nvidia (NVDA) H20s required by 82% when serving dozens of LLMs of up to 72B parameters, Vincent Chow of The South China Morning Post reports.
Elevate Your Investing Strategy:
- Take advantage of TipRanks Premium at 50% off! Unlock powerful investing tools, advanced data, and expert analyst insights to help you invest with confidence.
Published first on TheFly – the ultimate source for real-time, market-moving breaking financial news. Try Now>>
Read More on BABA:
- Bullish flow in Alibaba with shares up 4.15%
- Midday Fly By: AWS hit by outage, Kering sells beauty unit
- JD.com, Ant pause stablecoin plans after regulators raise concerns, FT reports
- Alibaba’s Stock Soars: AI and Cloud Drive Growth
- Cathie Wood Invests $12.3M in Alibaba Stock (BABA) as Wall Street Grows More Bullish