HT TECH wants to start sending you push notifications. Click allow to subscribe

New Microsoft-Backed Startup Wants to Make AI Work As Intended

Synth Labs is tackling Silicon Valley’s tricky problem of aligning AI actions with human intentions.

By: BLOOMBERG
Updated on: Mar 01 2024, 07:08 IST
Synth Labs, a new company founded by industry experts, is addressing the issue of AI alignment by developing software tools to ensure AI systems behave according to intentions. (Pixabay)

 Artificial intelligence software doesn’t always do what the people building it want it to do — a potentially dangerous issue that has consumed some of the largest companies working on the technology. 

Big companies like OpenAI and Alphabet Inc.’s Google are increasingly  directing workers, money and computing power toward the problem. And Anthropic, an OpenAI competitor, has put it at the heart of its development of Claude, a product it bills as a safer kind of AI chatbot.   

You may be interested in

Mobiles Tablets Laptops
7% OFF
Apple iPhone 15 Pro Max
  • Black Titanium
  • 8 GB RAM
  • 256 GB Storage
₹148,900₹159,900
Buy now
15% OFF
Samsung Galaxy S24 Ultra
  • Titanium Black
  • 12 GB RAM
  • 256 GB Storage
₹114,990₹134,999
Buy now
27% OFF
Samsung Galaxy S23 Ultra 5G
  • Green
  • 12 GB RAM
  • 256 GB Storage
₹109,999₹149,999
Buy now
Vivo X100 Pro 5G
  • Asteroid Black
  • 16 GB RAM
  • 512 GB Storage
₹89,999
Check details
43% OFF
Acer Aspire 5 A515 57G Laptop
  • Gray
  • 16 GB RAM
  • 512 GB SSD
₹50,990₹89,999
Buy now
37% OFF
Acer Swift Go SFG14 41 NX KG3SI 002 Laptop
  • Pure Silver
  • 8 GB RAM
  • 512 GB SSD
₹49,839₹78,999
Buy now
17% OFF
Acer Aspire 3 A315 24 NX KDESI 004 Laptop
  • Silver
  • 8 GB RAM
  • 512 GB SSD
₹35,700₹42,999
Buy now
Asus VivoBook 15 X515JA BQ322WS Laptop
  • Transparent Silver
  • 8 GB RAM
  • 512 GB SSD
₹31,990
Check details
33% OFF
Xiaomi Pad 6
  • Mist Blue
  • 6 GB RAM
  • 128 GB Storage
₹26,999₹39,999
Buy now
31% OFF
Realme Pad 2
  • Imagination Grey
  • 6 GB RAM
  • 128 GB Storage
₹19,999₹28,999
Buy now
Lenovo Tab M10 5G
  • Abyss Blue
  • 6 GB RAM
  • 128 GB Storage
₹19,998
Buy now
Honor Pad X9
  • Gray
  • 4 GB RAM
  • 128 GB Storage
₹16,998
Check details

Starting this month, a new company called Synth Labs is also taking aim at the issue. Founded by a handful of prominent AI industry names, the company is emerging from stealth this week, and has raised seed funding from Microsoft Corp.’s venture capital fund, M12, and Eric Schmidt’s First Spark Ventures. Synth Labs is primarily focused on building software, some of it open source, to help a range of companies ensure that their AI systems act according to their intentions. It’s positioning itself as a company that’s working transparently and collaboratively.

Also read: Looking for a smartphone? To check mobile finder click here.

Alignment, as the issue is sometimes called, represents a technical challenge for AI applications such as chatbots that are built atop large language models, which are typically trained on huge swaths of internet data. The effort is complicated by the fact that people’s ethics and values — as well as their ideas of what AI should and should not be permitted to do — vary. Synth Labs’ products will aim to help steer and customize large language models, particularly models that are themselves open source.

The company got its start as a project within nonprofit AI research lab EleutherAI, worked on by two of the three founders — Louis Castricato and Nathan Lile — plus Synth Labs advisor and EleutherAI executive director Stella Biderman. Francis deSouza, former chief executive officer of biotechnology company Illumina Inc., is also a founder. Synth Labs declined to say how much money it had raised so far. 

Over the last few months the startup has built tools that can readily evaluate large language models on complex topics, Castricato said. The goal, he said, is to democratize access to easy-to-use tools that can automatically evaluate and align AI models. 

A recent research paper that Castricato, Lile and Biderman co-authored gives a sense for the company’s approach: The authors used responses to prompts, which were generated by OpenAI’s GPT-4 and Stability AI’s Stable Beluga 2 AI models, to create a dataset. That dataset was then used as part of an automated process to direct a chatbot to avoid talking about one topic and instead talk about another.

“The way that we’re thinking about designing some of these early tools really is all about giving you the opportunity to decide what alignment means for your business or your personal preferences,” Lile said. 

Also, read other top stories today:

Google Maps Glanceable directions update is rolling out to users and it provides new, easy-to-use navigation features. Some interesting details in this article. Check it out here

After Google Gemini sparked a racism row, CEO Sundar Pichai had some tough things to say. Read Sundar Pichai's tough talk to staff here.

Google's shoddy job! Google has a chronic habit of dashing off half-baked AI products and neglecting safety checks. Read all about it here.

One more thing! We are now on WhatsApp Channels! Follow us there so you never miss any updates from the world of technology. ‎To follow the HT Tech channel on WhatsApp, click here to join now!

Catch all the Latest Tech News, Mobile News, Laptop News, Gaming news, Wearables News , How To News, also keep up with us on ,Twitter, Facebook, , and Instagram. For our latest videos, subscribe to our YouTube channel.

First Published Date: 01 Mar, 07:08 IST

Sale

Mobiles Tablets Laptops
4% OFF
Samsung Galaxy S24 Ultra
  • Titanium Black
  • 12 GB RAM
  • 256 GB Storage
₹129,999₹134,999
Buy now
7% OFF
Apple iPhone 15 Pro Max
  • Black Titanium
  • 8 GB RAM
  • 256 GB Storage
₹148,900₹159,900
Buy now
13% OFF
Xiaomi 14
  • Matte Black
  • 12 GB RAM
  • 512 GB Storage
₹69,999₹79,999
Buy now
10% OFF
Apple iPhone 15 Plus
  • Black
  • 6 GB RAM
  • 128 GB Storage
₹80,590₹89,900
Buy now
38% OFF
Xiaomi Pad 6
  • Mist Blue
  • 6 GB RAM
  • 128 GB Storage
₹24,999₹39,999
Buy now
38% OFF
Lenovo Tab M10 5G
  • Abyss Blue
  • 6 GB RAM
  • 128 GB Storage
₹20,999₹34,000
Buy now
28% OFF
Realme Pad 2
  • Imagination Grey
  • 6 GB RAM
  • 128 GB Storage
₹17,999₹24,999
Buy now
41% OFF
Lenovo Tab M9
  • Frost Blue
  • 3 GB RAM
  • 32 GB Storage
₹9,449₹16,000
Buy now
38% OFF
Acer Aspire 3 A315 24 NX KDESI 004 Laptop
  • Silver
  • 8 GB RAM
  • 512 GB SSD
₹32,790₹52,999
Buy now
27% OFF
Infinix INBook X1 Neo XL22 Laptop Intel Celeron Quad Core 8 GB 256 GB SSD Windows 11
  • Blue
  • 4 GB RAM
  • 128 GB SSD
₹21,990₹29,990
Buy now
29% OFF
Asus ROG Zephyrus G14 GA401QH BM072TS Laptop
  • Grey
  • 8 GB RAM
  • 512 GB SSD
₹65,990₹92,990
Buy now
35% OFF
Asus VivoBook Pro 15 M6500RC HN741WS Laptop
  • Quiet Blue
  • 16 GB RAM
  • 512 GB SSD
₹67,990₹104,990
Buy now
NEXT ARTICLE BEGINS