HT TECH wants to start sending you push notifications. Click allow to subscribe

Meta Platforms to deploy in-house custom chips this year to power AI drive - memo

Facebook owner Meta Platforms plans to deploy into its data centers this year a new version of a custom chip aimed at supporting its artificial intelligence (AI) push, according to an internal company document seen by Reuters on Thursday.

By: REUTERS
Updated on: Feb 02 2024, 07:30 IST
Meta plans to develop a custom chip aimed at supporting its artificial intelligence (AI) push (unsplash)

Facebook owner Meta Platforms plans to deploy into its data centers this year a new version of a custom chip aimed at supporting its artificial intelligence (AI) push, according to an internal company document seen by Reuters on Thursday.

The chip, a second generation of an in-house silicon line Meta announced last year, could help to reduce Meta's dependence on the Nvidia chips that dominate the market and control the spiraling costs associated with running AI workloads as it races to launch AI products.

You may be interested in

Mobiles Tablets Laptops
7% OFF
Apple iPhone 15 Pro Max
  • Black Titanium
  • 8 GB RAM
  • 256 GB Storage
₹148,900₹159,900
Buy now
23% OFF
Samsung Galaxy S23 Ultra 5G
  • Green
  • 12 GB RAM
  • 256 GB Storage
₹115,999₹149,999
Buy now
Google Pixel 8 Pro
  • Obsidian
  • 12 GB RAM
  • 128 GB Storage
₹106,998
Check details
Apple iPhone 15 Plus
  • Black
  • 6 GB RAM
  • 128 GB Storage
₹87,900
Check details
21% OFF
Acer Swift Go SFG14 41 NX KG3SI 002 Laptop
  • 8 GB RAM
  • 512 GB SSD
₹58,990₹74,999
Buy now
39% OFF
Acer Aspire 5 A515 57G Laptop
  • 16 GB RAM
  • 512 GB SSD
₹54,949₹89,999
Buy now
22% OFF
Acer Aspire 3 A315 24 NX KDESI 004 Laptop
  • 8 GB RAM
  • 512 GB SSD
₹33,499₹42,999
Buy now
39% OFF
Asus VivoBook 15 X515JA BQ322WS Laptop
  • 8 GB RAM
  • 512 GB SSD
₹31,490₹51,990
Buy now
34% OFF
Xiaomi Pad 6
  • Mist Blue
  • 6 GB RAM
  • 128 GB Storage
₹26,299₹39,999
Buy now
55% OFF
Lenovo Tab M10 5G
  • Abyss Blue
  • 6 GB RAM
  • 128 GB Storage
₹20,999₹47,000
Buy now
32% OFF
Realme Pad 2
  • Imagination Grey
  • 6 GB RAM
  • 128 GB Storage
₹19,790₹28,999
Buy now
Honor Pad X9
  • Gray
  • 4 GB RAM
  • 128 GB Storage
₹14,999
Check details

The world's biggest social media company has been scrambling to boost its computing capacity for the power-hungry generative AI products it is pushing into apps Facebook, Instagram and WhatsApp and hardware devices like its Ray-Ban smartglasses, spending billions of dollars to amass arsenals of specialized chips and reconfigure data centers to accommodate them.

Also read: Looking for a smartphone? To check mobile finder click here.

We are on WhatsApp Channels. Click to join. 

At the scale at which Meta operates, a successful deployment of its own chip could potentially shave off hundreds of millions of dollars in annual energy costs and billions in chip purchasing costs, according to Dylan Patel, founder of the silicon research group SemiAnalysis.

The chips, infrastructure and energy required to run AI applications has become a giant sinkhole of investment for tech companies, to some degree offsetting gains made in the rush of excitement around the technology.

A Meta spokesperson confirmed the plan to put the updated chip into production in 2024, saying it would work in coordination with the hundreds of thousands of off-the-shelf graphics processing units (GPUs) - the go-to chips for AI - the company was buying.

"We see our internally developed accelerators to be highly complementary to commercially available GPUs in delivering the optimal mix of performance and efficiency on Meta-specific workloads," the spokesperson said in a statement.

Meta CEO Mark Zuckerberg last month said the company planned to have by the end of the year roughly 350,000 flagship "H100" processors from Nvidia, which produces the most sought-after GPUs used for AI. Combined with other suppliers, Meta would accumulate the equivalent compute capacity of 600,000 H100s in total, he said.

The deployment of its own chip as part of that plan is a positive turn for Meta's in-house AI silicon project, after a decision by executives in 2022 to pull the plug on the chip's first iteration.

The company instead opted to buy billions of dollars worth of Nvidia's GPUs, which have a near monopoly on an AI process called training that involves feeding enormous data sets into models to teach them how to perform tasks.

The new chip, referred to internally as "Artemis," like its predecessor can perform only a process known as inference in which the models are called on to use their algorithms to make ranking judgments and generate responses to user prompts.

Reuters last year reported that Meta is also working on a more ambitious chip that, like GPUs, would be capable of performing both training and inference.

The Menlo Park, California-based company shared details about the first generation of its Meta Training and Inference Accelerator (MTIA) program last year. The announcement portrayed that version of the chip as a learning opportunity.

Despite those early stumbles, an inference chip could be considerably more efficient at crunching Meta's recommendation models than the energy thirsty Nvidia processors, according to Patel.

"There is a lot of money and power being spent that could be saved," he said.

Also read other top stories today:

Facebook turns 20! Founded in 2004 by Mark Zuckerberg and three friends, the social media platform has 3 billion monthly users. It continues to expand and invest in innovations like artificial intelligence and virtual reality. Find out more here.

Can AI replace Air Traffic Controllers? ATCs play a crucial role in preventing collisions and ensuring the safe flow of air traffic. While technology can automate certain aspects of it, humans are likely to remain necessary for a long time. Check the reason here.

White robots raising questions! Social robots have physical bodies modelled on nonthreatening versions of humans or animals and are designed to interact with people. Then why are they white? Dive in here.

Catch all the Latest Tech News, Mobile News, Laptop News, Gaming news, Wearables News , How To News, also keep up with us on ,Twitter, Facebook, , and Instagram. For our latest videos, subscribe to our YouTube channel.

First Published Date: 02 Feb, 07:30 IST
NEXT ARTICLE BEGINS