AI chips are hot. Here's what they're for and why investors see gold

The hottest thing in technology is an unprepossessing sliver of silicon closely related to the chips that power video game graphics.

Watch Video

This photo provided by the chipmaker Nvidia shows the company’s HGX H100 module, which can use as many as eight AI chips to train artificial intelligence systems and perform other tasks. (Nvidia via AP)

The hottest thing in technology is an unprepossessing sliver of silicon closely related to the chips that power video game graphics. It's an artificial intelligence chip, designed specifically to make building AI systems such as ChatGPT faster and cheaper.

Such chips have suddenly taken center stage in what some experts consider an AI revolution that could reshape the technology sector — and possibly the world along with it. Shares of Nvidia, the leading designer of AI chips, rocketed up almost 25% last Thursday after the company forecast a huge jump in revenue that analysts said indicated soaring sales of its products. The company was briefly worth 80 billion transistors — about 13 million more than Apple's latest high-end processor for its MacBook Pro laptop. Unsurprisingly, this technology isn't cheap; at one online retailer, the H100 lists for $30,000.

Nvidia doesn't fabricate these complex GPU chips itself, a task that would require enormous investments in new factories. Instead it relies on Asian chip foundries such as Taiwan Semiconductor Manufacturing Co. and Korea's Samsung Electronics.

Some of the biggest customers for AI chips are cloud-computing services such as those run by Amazon and Microsoft. By renting out their AI computing power, those services make it possible for smaller companies and groups that couldn't afford to build their own AI systems from scratch to use cloud-based tools to help with tasks that can range from drug discovery to customer management.

OTHER USES AND COMPETITION

Parallel processing has many uses outside of AI. A few years ago, for instance, Nvidia graphics cards were in short supply because cryptocurrency miners, who set up banks of computers to solve thorny mathematical problems for bitcoin rewards, had snapped up most of them. That problem faded as the cryptocurrency market collapsed in early 2022.

Analysts say Nvidia will inevitably face tougher competition. One potential rival is Advanced Micro Devices, which already faces off with Nvidia in the market for computer graphics chips. AMD has recently taken steps to bolster its own lineup of AI chips.

Nvidia is based in Santa Clara, California. Co-founder Jensen Huang remains the company's president and chief executive.