February 23, 2024


The Nvidia logo displayed on a phone screen and microchip and are seen in this photo taken in Krakow, Poland, on July 19, 2023.

Nurphoto | Nurphoto | Getty Images

Nvidia is building a new business unit focused on designing bespoke chips for cloud computing firms and others, including advanced artificial intelligence processors, according to nine sources familiar with the company’s plans.

The dominant global designer and supplier of AI chips aims to capture a portion of an exploding market for custom AI chips and to protect itself from the growing number of companies interested in finding alternatives to its products.

The Santa Clara, California-based company currently controls about 80% of the market for high-end AI chips, a position that has sent its market value up 40% so far this year to $1.73 trillion after it more than tripled in 2023.

Its customers, which include ChatGPT creator OpenAI, Microsoft, Alphabet and Meta Platforms, have raced to snap up the dwindling supply of Nvidia chips to compete in the rapidly emerging generative AI sector.

Nvidia’s H100 and A100 chips serve as a generalized, all-purpose AI processor for many of those major customers. But the tech companies have started to develop their own internal chips for specific needs. Doing so helps reduce energy consumption, and potentially can shrink the cost and time to design.

Nvidia is now attempting to play a role in helping these companies develop custom AI chips that have flowed to rival firms such as Broadcom and Marvell Technology, according to the sources who declined to be identified because they were not authorized to speak publicly.

“If you’re really trying to optimize on things like power, or optimize on cost for your application, you can’t afford to go drop an H100 or A100 in there,” Greg Reichow, general partner at venture capital firm Eclipse Ventures said in an interview. “You want to have the exact right mixture of compute and just the kind of compute that you need.”

Nvidia does not disclose H100 prices, which are higher than for the prior-generation A100, but each chip can sell from $16,000 to $100,000 depending on the volume purchased and other factors. Meta has said it plans to bring its total stock to 350,000 H100s this year.

Nvidia officials have met with representatives from Amazon.com, Meta, Microsoft, Google and OpenAI to discuss making custom chips for them, according to two sources familiar with the meetings. Beyond data center chips, the company has pursued telecom, automotive and video game customers.

In 2022, Nvidia said it would let third-party customers integrate some of its proprietary networking technology with their own chips. The company has said nothing about the program since, and Reuters is reporting its wider ambitions for the first time.

A Nvidia spokesperson declined to comment beyond the company’s 2022 announcement.

Dina McKinney, a former Advanced Micro Devices and Marvell executive, heads Nvidia’s custom unit and her team’s goal is to make its technology available for customers in cloud, 5G wireless, video games and automotives, according to a LinkedIn profile. Those mentions were scrubbed and her title was changed after Reuters sought comment from Nvidia.

Amazon, Google, Microsoft, Meta and OpenAI declined to comment.

$30 billion market

According to estimates from research firm 650 Group’s Alan Weckel, the data center custom chip market will grow to as much as $10 billion this year, and double that in 2025.

The broader custom chip market was worth roughly $30 billion in 2023, which amounts to roughly 5% of annual global chip sales, according to Needham analyst Charles Shi.

Currently, custom silicon design for data centers is dominated by Broadcom and Marvell.

In a typical arrangement, a design partner such as Nvidia would offer intellectual property and technology, but leave the chip fabrication, packaging and additional steps to Taiwan Semiconductor Manufacturing Co. or another contract chip manufacturer.

Nvidia moving into this territory has the potential to eat into Broadcom and Marvell sales.

“With Broadcom’s custom silicon business touching $10 billion, and Marvell’s around $2 billion, this is a real threat,” said Dylan Patel, founder of the silicon research group SemiAnalysis. “It’s a real big negative – there’s more competition entering the fray.”

Beyond AI



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *

Batman138 Bro138 Dolar138 Gas138 Gudang138 Hoki99 Ligaciputra Panen77 Zeus138 Kilat77 Planet88 Gaspol168 Sikat88 Rupiah138 Garuda138 Gacor77 Roma77 Sensa138 Panen138 Slot138 Gaco88 Elanggame Candy99 Cair77 Max7 Best188 Space77 Sky77 Luxury777 Maxwin138 Bosswin168 Cocol88 Slot5000 Babe138 Luxury138 Jet77 Bonanza138 Bos88 Aquaslot Taktik88 Lord88 Indobet Slot69 Paus138 Tiktok88 Panengg Bingo4d Stars77 77dragon Warung168 Receh88 Online138 Tambang88 Asia77 Klik4d Bdslot88 Gajah138 Bigwin138 Markas138 Yuk69 Emas168 Key4d Harta138  Gopek178 Imbaslot Imbajp Deluna4d Luxury333 Pentaslot Luxury111 Cair77 Gboslot Pandora188 Olxtoto Slotvip Eslot Kuy138 Imbagacor Bimabet