# New Microsoft-Backed Startup Wants to Make AI Work As Intended | Tech News (HT Tech) > Synth Labs is tackling Silicon Valley’s tricky problem of aligning AI actions with human intentions. # New Microsoft-Backed Startup Wants to Make AI Work As Intended ## Synth Labs is tackling Silicon Valley’s tricky problem of aligning AI actions with human intentions. Mar 01 2024, 07:08 IST ![Follow on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/follow-us-facebook.png) ![Follow on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/follow-us-facebook-hover.png) ![Share](https://images.hindustantimes.com/tech/static/revamp/images/png/Share.png) ![Share](https://images.hindustantimes.com/tech/static/revamp/images/png/Shareclicked.png) ![Share on WhatsApp](https://images.hindustantimes.com/tech/static/revamp/images/png/whatsapp.png) ![Share on WhatsApp](https://images.hindustantimes.com/tech/static/revamp/images/png/whatsapp-hover.png) ![Share on Twitter](https://images.hindustantimes.com/tech/static/revamp/images/png/twitter.png) ![Share on Twitter](https://images.hindustantimes.com/tech/static/revamp/images/png/twitter-hover.png) ![Share on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/facebook.png) ![Share on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/facebook-hover.png) ![Bookmark](https://images.hindustantimes.com/tech/static/revamp/images/png/Bookmark.png) ![Bookmarked](https://images.hindustantimes.com/tech/static/revamp/images/png/Bookmarked.png) ![artificial intelligence](https://images.hindustantimes.com/tech/img/2024/03/01/1600x900/technology-5254039_1280_1708614115364_1709256923936.jpg) Synth Labs, a new company founded by industry experts, is addressing the issue of AI alignment by developing software tools to ensure AI systems behave according to intentions. (Pixabay) ![Author Photo](https://images.hindustantimes.com/tech/static/revamp/images/png/HTTech-new-circle-logo.png) ### By BLOOMBERG Artificial intelligence software doesn’t always do what the people building it want it to do — a potentially dangerous issue that has consumed some of the largest companies working on the technology. Big companies like OpenAI and Alphabet Inc.’s Google are increasingly directing workers, money and computing power toward the problem. And Anthropic, an OpenAI competitor, has put it at the heart of its development of Claude, a product it bills as a safer kind of AI chatbot. Starting this month, a new company called Synth Labs is also taking aim at the issue. Founded by a handful of prominent AI industry names, the company is emerging from stealth this week, and has raised seed funding from Microsoft Corp.’s venture capital fund, M12, and Eric Schmidt’s First Spark Ventures. Synth Labs is primarily focused on building software, some of it open source, to help a range of companies ensure that their AI systems act according to their intentions. It’s positioning itself as a company that’s working transparently and collaboratively. Also read click here. Alignment, as the issue is sometimes called, represents a technical challenge for AI applications such as chatbots that are built atop large language models, which are typically trained on huge swaths of internet data. The effort is complicated by the fact that people’s ethics and values — as well as their ideas of what AI should and should not be permitted to do — vary. Synth Labs’ products will aim to help steer and customize large language models, particularly models that are themselves open source. The company got its start as a project within nonprofit AI research lab EleutherAI, worked on by two of the three founders — Louis Castricato and Nathan Lile — plus Synth Labs advisor and EleutherAI executive director Stella Biderman. Francis deSouza, former chief executive officer of biotechnology company Illumina Inc., is also a founder. Synth Labs declined to say how much money it had raised so far. Over the last few months the startup has built tools that can readily evaluate large language models on complex topics, Castricato said. The goal, he said, is to democratize access to easy-to-use tools that can automatically evaluate and align AI models. A recent research paper that Castricato, Lile and Biderman co-authored gives a sense for the company’s approach: The authors used responses to prompts, which were generated by OpenAI’s GPT-4 and Stability AI’s Stable Beluga 2 AI models, to create a dataset. That dataset was then used as part of an automated process to direct a chatbot to avoid talking about one topic and instead talk about another. “The way that we’re thinking about designing some of these early tools really is all about giving you the opportunity to decide what alignment means for your business or your personal preferences,” Lile said. ## Also, read other top stories today: Google Maps Glanceable directions update is rolling out to users and it provides new, easy-to-use navigation features. Some interesting details in this article. Check it out here. After Google Gemini sparked a racism row, CEO Sundar Pichai had some tough things to say. Read Sundar Pichai's tough talk to staff here. Google's shoddy job! Google has a chronic habit of dashing off half-baked AI products and neglecting safety checks. Read all about it here. One more thing! We are now on WhatsApp Channels! Follow us there so you never miss any updates from the world of technology. ‎To follow the HT Tech channel on WhatsApp, click here to join now! Catch all the Latest Tech News, Mobile News, Laptop News, Gaming news, Wearables News , How To News, also keep up with us on Whatsapp channel,Twitter, Facebook, Google News, and Instagram. For our latest videos, subscribe to our YouTube channel. 01 Mar, 07:08 IST artificial intelligence ![HT Tech Awards](https://tech.hindustantimes.com/ht-tech-power-list-awards-2026/httech-awards-banner-new.webp) ### Related Stories 14 Sept 2026 71,709,231,700,078 NEXT ARTICLE BEGINS ![View all](https://images.hindustantimes.com/tech/static/revamp/images/png/view-all-icon.png) ## Tips & Tricks ![Ghibli-style art](https://images.hindustantimes.com/tech/img/2025/03/28/414x233/ChatGPT_Ghibli_style_images_1743161814450_1743161814596.jpg) ### How to turn your photos into Ghibli-style art with ChatGPT for free: Step-by-step guide ![How to create an invitation using iPhone’s new Apple Invites app- Step-by-step guide](https://images.hindustantimes.com/tech/img/2025/02/14/414x233/invites_1738728829564_1739543695649.png) ### How to create an invitation using iPhone’s new Apple Invites app- Step-by-step guide ![Apple TV app arrives on Android phones and tablets: What you get and how to install it](https://images.hindustantimes.com/tech/img/2025/02/13/414x233/unnamed_1739426557335_1739426567634.jpg) ### Apple TV app arrives on Android phones and tablets: What you get and how to install it ![Vodafone Idea OTT plans](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Vodafone Idea users can now stream 17 OTT apps with one subscription: Here's how ![Android data transfer methods](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### How to transfer data from one Android to another using Google backup, USB-C cable, and more ## Editor’s Pick ![iPhone 16e launched with A18 chip, Apple AI—bringing flagship power on a budget: Check specs, price](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### iPhone 16e launched in India: All details about the new budget mobile from Apple ![DeepSeek was founded in China with only a fraction of the budget of the top AI companies in the US.](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### DeepSeek AI: How it works, who’s behind it, how it’s different from ChatGPT, and its big US market impact explained ![iPhone 17 Air likely to get this feature that iPhone 17 Pro models may miss out on](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### iPhone 17 Air likely to get this feature that iPhone 17 Pro models may miss out on ![Google Whisk AI explained: How remixing works, availability, and how it differs from Gemini](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Google Whisk AI explained: How remixing works, availability, and how it differs from Gemini ![iOS 18.4 beta arriving soon: Know why it is the biggest iPhone update](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### iOS 18.4 beta arriving soon: Know why it is the biggest iPhone update ## Trending Stories ![Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order ![Infinix Note 50s 5G+](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Infinix Note 50s 5G+ set to launch in India with 64MP camera and MediaTek Dimensity 7300 SoC ![Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more ![Apple Intelligence AI training](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Apple plans to train AI using your on-device data without accessing personal content or emails: Report ![CMF Buds 2](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### CMF Buds 2 key features and price revealed ahead of April 28 launch: Details inside keep up with tech ![Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-facebook.png) ![Twitter](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-twitter.png) ![WhatsApp](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-whatsApp.png) ![Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-facebook.png) ## Gaming ![Check out these five gaming monitors under ₹20,000,](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Top 5 gaming monitors under ₹20000 you should consider ![gaming consoles](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Grab gaming consoles at discounted rates during Amazon Great Indian Festival: Up to 72% off ![Pokémon GO Wild Area 2025](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Pokémon GO Wild Area 2025 to bring Grimmsnarl family, Shiny Hatenna, and global challenges ![Shade Silver](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Shade Silver free on Steam for a limited time: Here’s how to get it ![Call of duty](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Call of Duty: Black Ops 7 skips Switch 2 at launch, release date and price leak ![View all](https://images.hindustantimes.com/tech/static/revamp/images/png/view-all-icon.png) ## Trending News ### Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order ![Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order](https://images.livemint.com/static/static/1x1_img.gif) ### Infinix Note 50s 5G+ set to launch in India with 64MP camera and MediaTek Dimensity 7300 SoC ![Infinix Note 50s 5G+](https://images.livemint.com/static/static/1x1_img.gif) ### Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more ![Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more](https://images.livemint.com/static/static/1x1_img.gif) ### Apple plans to train AI using your on-device data without accessing personal content or emails: Report ![Apple Intelligence AI training](https://images.livemint.com/static/static/1x1_img.gif) ### CMF Buds 2 key features and price revealed ahead of April 28 launch: Details inside ![CMF Buds 2](https://images.livemint.com/static/static/1x1_img.gif) ## Trending Gadgets Mobiles Laptops Tablets ![HT Tech](https://images.hindustantimes.com/tech/static/revamp/images/png/HT_tech-new.gif) - https://tech.hindustantimes.com/tech/news/new-microsoft-backed-startup-wants-to-make-ai-work-as-intended-71709231700078.html