# Microsoft Strung Together Tens of Thousands of Chips in a Pricey Supercomputer for OpenAI | Tech News (HT Tech)

> Now the software maker’s cloud technology supports AI products for the company and customers while it puts together a successor

# Microsoft Strung Together Tens of Thousands of Chips in a Pricey Supercomputer for OpenAI

## Now the software maker’s cloud technology supports AI products for the company and customers while it puts together a successor

Mar 14 2023, 07:14 IST

![Follow on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/follow-us-facebook.png)

![Follow on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/follow-us-facebook-hover.png)

![Share](https://images.hindustantimes.com/tech/static/revamp/images/png/Share.png)

![Share](https://images.hindustantimes.com/tech/static/revamp/images/png/Shareclicked.png)

![Share on WhatsApp](https://images.hindustantimes.com/tech/static/revamp/images/png/whatsapp.png)

![Share on WhatsApp](https://images.hindustantimes.com/tech/static/revamp/images/png/whatsapp-hover.png)

![Share on Twitter](https://images.hindustantimes.com/tech/static/revamp/images/png/twitter.png)

![Share on Twitter](https://images.hindustantimes.com/tech/static/revamp/images/png/twitter-hover.png)

![Share on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/facebook.png)

![Share on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/facebook-hover.png)

![Bookmark](https://images.hindustantimes.com/tech/static/revamp/images/png/Bookmark.png)

![Bookmarked](https://images.hindustantimes.com/tech/static/revamp/images/png/Bookmarked.png)

![Microsoft](https://images.hindustantimes.com/tech/img/2023/03/14/1600x900/Microsoft_1672984204326_1678758059588_1678758059588.jpg)

![icon](https://images.hindustantimes.com/tech/static/revamp/images/png/imageviewall.png)

Microsoft had to find ways to string together tens of thousands of Nvidia Corp.’s A100 graphics chips — the workhorse for training AI models — and change how it positions servers on racks to prevent power outages. (Bloomberg)

Choose better. Buy smarter.

- Best laptops under ₹50,000

- Best mobile phones under ₹30,000

- Best TVs under ₹50,000

Riva by HT Tech generates recommendations using proprietary AI analysis built on years of editorial expertise.

![Author Photo](https://images.hindustantimes.com/tech/static/revamp/images/png/HTTech-new-circle-logo.png)

### By BLOOMBERG

When Microsoft Corp. invested $1 billion in OpenAI in 2019, it agreed to build a massive, cutting-edge supercomputer for the artificial intelligence research startup. The only problem: Microsoft didn’t have anything like what OpenAI needed and wasn’t totally sure it could build something that big in its Azure cloud service without it breaking.

OpenAI was trying to train an increasingly large set of artificial intelligence programs called models, which were ingesting greater volumes of data and learning more and more parameters, the variables the AI system has sussed out through training and retraining. That meant OpenAI needed access to powerful cloud computing services for long periods of time.

To meet that challenge, Microsoft had to find ways to string together tens of thousands of Nvidia Corp.’s A100 graphics chips — the workhorse for training AI models — and change how it positions servers on racks to prevent power outages. Scott Guthrie, the Microsoft executive vice president who oversees cloud and AI, wouldn’t give a specific cost for the project, but said “it's probably larger” than several hundred million dollars.

Also read

click here.

“We built a system architecture that could operate and be reliable at a very large scale. That's what resulted in ChatGPT being possible,” said Nidhi Chappell, Microsoft general manager of Azure AI infrastructure. “That’s one model that came out of of it. There’s going to be many, many others.”

The technology allowed OpenAI to release ChatGPT, the viral chatbot that attracted more than 1 million users within days of going public in November and is now getting pulled into other companies’ business models, from those run by billionaire hedge fund founder Ken Griffin to food-delivery service Instacart Inc. As generative AI tools such as ChatGPT gain interest from businesses and consumers, more pressure will be put on cloud services providers like Microsoft, Amazon. com Inc. and Alphabet Inc.’s Google to ensure their data centers can provided the enormous computing power needed.

Now Microsoft uses that same set of resources it built for OpenAI to train and run its own large artificial intelligence models, including the new Bing search bot introduced last month. It also sells the system to other customers. The software giant is already at work on the next generation of the AI supercomputer, part of an expanded deal with OpenAI in which Microsoft added $10 billion to its investment.

“We didn't build them a custom thing — it started off as a custom thing, but we always built it in a way to generalize it so that anyone that wants to train a large language model can leverage the same improvements,” said Guthrie in an interview. “That's really helped us become a better cloud for AI broadly.”

Training a massive AI model requires a large pool of connected graphics processing units in one place like the AI supercomputer Microsoft assembled. Once a model is in use, answering all the queries users pose — called inference — requires a slightly different set up. Microsoft also deploys graphics chips for inference but those processors — hundreds of thousands of them — are geographically dispersed throughout the company’s more than 60 regions of data centers. Now the company is adding the latest Nvidia graphics chip for AI workloads — the H100 — and the newest version of Nvidia’s Infiniband networking technology to share data even faster, Microsoft said Monday in a blog post.

The new Bing is still in preview with Microsoft gradually adding more users from a waitlist. Guthrie’s team holds a daily meeting with about two dozen employees they’ve dubbed the “pit crew” after the group of mechanics that tune race cars in the middle of the race. The group’s job is to figure out how to bring greater amounts of computing capacity online quickly, as well as fix problems that crop up.

“It's very much a kind of a huddle, where it's like, ‘Hey, anyone has a good idea, let's put it on the table today, and let's discuss it and let's figure out OK, can we shave a few minutes here? Can we shave a few hours? A few days?’” Guthrie said.

A cloud service depends on thousands of different parts and items — the individual pieces of servers, pipes, concrete for the buildings, different metals and minerals — and a delay or short supply of any one component, no matter how tiny, can throw everything off. Recently, the pit crew had to deal with a shortage of cable trays — the basket-like contraptions that hold the cables coming off the machines. So they designed a new cable tray that Microsoft could manufacture itself or find somewhere to buy. They’ve also worked on ways to squish as many servers as possible in existing data centers around the world so they don’t have to wait for new buildings, Guthrie said.

When OpenAI or Microsoft is training a large AI model, the work happens at one time. It’s divided across all the GPUs and at certain points, the units need to talk to each other to share the work they’ve done. For the AI supercomputer, Microsoft had make sure the networking gear that handles the communication among all the chips could handle that load, and it had to develop software that gets the best use out of the GPUs and the networking equipment. The company has now come up with software that lets it train models with tens of trillions of parameters.

Because all the machines fire up at once, Microsoft had to think about where they were placed and where the power supplies were located. Otherwise you end up with the data center version of what happens when you turn on a microwave, toaster and vacuum cleaner at the same time in the kitchen, Guthrie said.

The company also had to make sure it could cool off all of those machines and chips, and uses evaporation, outside air in cooler climates and high-tech swamp coolers in hot ones, said Alistair Speirs, director of Azure global infrastructure.

Microsoft is going to keep working on customized server and chip designs and ways to optimize its supply chain in order to wring any speed gains, efficiency and cost-savings it can, Guthrie said.

“The model that is wowing the world right now is built on the supercomputer we started building couple of years ago. The new models will be built on the new supercomputer we're training now, which is much bigger and will enable even more sophistication,” he said.

Catch all the Latest Tech News, Mobile News, Laptop News, Gaming news, Wearables News , How To News, also keep up with us on Whatsapp channel,Twitter, Facebook, Google News, and Instagram. For our latest videos, subscribe to our YouTube channel.

14 Mar, 07:13 IST

artificial intelligence

microsoft

![HT Tech Awards](https://tech.hindustantimes.com/ht-tech-power-list-awards-2026/httech-awards-banner-new.webp)

### Related Stories

11 Nov 2026

10 Nov 2026

71,678,733,079,078

NEXT ARTICLE BEGINS

![View all](https://images.hindustantimes.com/tech/static/revamp/images/png/view-all-icon.png)

## Tips & Tricks

![Ghibli-style art](https://images.hindustantimes.com/tech/img/2025/03/28/414x233/ChatGPT_Ghibli_style_images_1743161814450_1743161814596.jpg)

### How to turn your photos into Ghibli-style art with ChatGPT for free: Step-by-step guide

![How to create an invitation using iPhone’s new Apple Invites app- Step-by-step guide](https://images.hindustantimes.com/tech/img/2025/02/14/414x233/invites_1738728829564_1739543695649.png)

### How to create an invitation using iPhone’s new Apple Invites app- Step-by-step guide

![Apple TV app arrives on Android phones and tablets: What you get and how to install it](https://images.hindustantimes.com/tech/img/2025/02/13/414x233/unnamed_1739426557335_1739426567634.jpg)

### Apple TV app arrives on Android phones and tablets: What you get and how to install it

![Vodafone Idea OTT plans](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Vodafone Idea users can now stream 17 OTT apps with one subscription: Here's how

![Android data transfer methods](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### How to transfer data from one Android to another using Google backup, USB-C cable, and more

## Editor’s Pick

![iPhone 16e launched with A18 chip, Apple AI—bringing flagship power on a budget: Check specs, price](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### iPhone 16e launched in India: All details about the new budget mobile from Apple

![DeepSeek was founded in China with only a fraction of the budget of the top AI companies in the US.](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### DeepSeek AI: How it works, who’s behind it, how it’s different from ChatGPT, and its big US market impact explained

![iPhone 17 Air likely to get this feature that iPhone 17 Pro models may miss out on](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### iPhone 17 Air likely to get this feature that iPhone 17 Pro models may miss out on

![Google Whisk AI explained: How remixing works, availability, and how it differs from Gemini](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Google Whisk AI explained: How remixing works, availability, and how it differs from Gemini

![iOS 18.4 beta arriving soon: Know why it is the biggest iPhone update](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### iOS 18.4 beta arriving soon: Know why it is the biggest iPhone update

## Trending Stories

![Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order

![Infinix Note 50s 5G+](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Infinix Note 50s 5G+ set to launch in India with 64MP camera and MediaTek Dimensity 7300 SoC

![Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more

![Apple Intelligence AI training](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Apple plans to train AI using your on-device data without accessing personal content or emails: Report

![CMF Buds 2](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### CMF Buds 2 key features and price revealed ahead of April 28 launch: Details inside

keep up with tech

![Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-facebook.png)

![Twitter](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-twitter.png)

![WhatsApp](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-whatsApp.png)

![Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-facebook.png)

## Gaming

![Check out these five gaming monitors under  <span class='webrupee'>₹</span>20,000,](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Top 5 gaming monitors under ₹20000 you should consider

![gaming consoles](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Grab gaming consoles at discounted rates during Amazon Great Indian Festival: Up to 72% off

![Pokémon GO Wild Area 2025](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Pokémon GO Wild Area 2025 to bring Grimmsnarl family, Shiny Hatenna, and global challenges

![Shade Silver](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Shade Silver free on Steam for a limited time: Here’s how to get it

![Call of duty](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png)

### Call of Duty: Black Ops 7 skips Switch 2 at launch, release date and price leak

![View all](https://images.hindustantimes.com/tech/static/revamp/images/png/view-all-icon.png)

## Trending News

### Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order

![Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order](https://images.livemint.com/static/static/1x1_img.gif)

### Infinix Note 50s 5G+ set to launch in India with 64MP camera and MediaTek Dimensity 7300 SoC

![Infinix Note 50s 5G+](https://images.livemint.com/static/static/1x1_img.gif)

### Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more

![Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more](https://images.livemint.com/static/static/1x1_img.gif)

### Apple plans to train AI using your on-device data without accessing personal content or emails: Report

![Apple Intelligence AI training](https://images.livemint.com/static/static/1x1_img.gif)

### CMF Buds 2 key features and price revealed ahead of April 28 launch: Details inside

![CMF Buds 2](https://images.livemint.com/static/static/1x1_img.gif)

## Trending Gadgets

Mobiles

Laptops

Tablets

![HT Tech](https://images.hindustantimes.com/tech/static/revamp/images/png/HT_tech-new.gif)

- https://tech.hindustantimes.com/tech/news/microsoft-strung-together-tens-of-thousands-of-chips-in-a-pricey-supercomputer-for-openai-71678733079078.html