HT TECH wants to start sending you push notifications. Click allow to subscribe

iPhone 16 Pro to get big AI upgrade with Ferret-UI: Know what it is

Apple pioneers AI integration in iPhone 16 Pro to enhance user experience. Discover Ferret-UI's capabilities and upcoming server-side tools for individual iPhones.

By: MD IJAJ KHAN
Updated on: Apr 15 2024, 07:51 IST
Apple's upcoming iPhone 16 Pro promises groundbreaking AI advancements to enhance user experience and accessibility. (AP)

Apple's iPhone has long been renowned for its sleek design and user-friendly interface, but the tech giant is now venturing into the realm of artificial intelligence (AI) to further elevate the user experience.

Ferret-UI Technology

In a recent research collaboration with Cornell University, Apple has revealed a groundbreaking advancement titled "Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs." This innovative system employs a multimodal large language model to comprehensively interpret mobile user interfaces, revolutionising how users interact with their iPhones, Forbes reported

You may be interested in

10% OFF
Apple iPhone 15
  • Black
  • 6 GB RAM
  • 128 GB Storage
₹71,590₹79,900
Buy now
10% OFF
Apple iPhone 14
  • Blue
  • 6 GB RAM
  • 128 GB Storage
₹62,800₹69,900
Buy now
13% OFF
Apple iPhone 13
  • Blue
  • 4 GB RAM
  • 128 GB Storage
₹52,090₹59,900
Buy now
IQOO 9T 5G
  • Alpha
  • 8 GB RAM
  • 128 GB Storage
₹45,799
Check details

Also read: iPhone 14 at Rs. 33,400 after discount on Amazon: Know full offer details

Not sure which
mobile to buy?

Ferret-UI, an evolution of the previously introduced Ferret system, boasts an array of capabilities, including icon recognition, text detection, widget parsing, and screen description. This enhanced functionality not only facilitates seamless navigation across various applications but also paves the way for enhanced accessibility features.

Moreover, Ferret-UI holds promise for developers, serving as a versatile testing tool for simulating diverse user scenarios and optimising app performance across different demographics.

Also read: Samsung Galaxy S25 Ultra leaks roundup: Expected specs, camera features and more

Server-Side Tools Unveiled

In a recent development, backend code discoveries by Nicolás Álvarez hint at additional server-side tools dubbed "Safari Browsing Assistant" and "Encrypted Visual Search." While these features align with the principles outlined in the Ferret-UI research, it's important to note that they remain subject to potential modifications or may serve as placeholders for future implementations.

Despite commendable strides in AI, Apple faced criticism for lagging behind Google in embracing AI-driven smartphones. However, with the impending Worldwide Developer Conference in June, Apple is poised to shed light on its AI roadmap, laying the groundwork for the highly anticipated iPhone 16 and iPhone 16 Pro slated for release in September.

Also read: Motorola Edge 50 Ultra leaked: Check details, Geekbench score

As the tech industry eagerly awaits Apple's next move, the academic revelations surrounding Apple's AI endeavours offer a glimpse into the company's trajectory as it strives to remain at the forefront of innovation.

Catch all the Latest Tech News, Mobile News, Laptop News, Gaming news, Wearables News , How To News, also keep up with us on ,Twitter, Facebook, , and Instagram. For our latest videos, subscribe to our YouTube channel.

First Published Date: 14 Apr, 18:03 IST
Tags:

Sale

10% OFF
Apple iPhone 13 512GB
  • Blue
  • 4 GB RAM
  • 512 GB Storage
₹80,999₹89,900
Buy now
12% OFF
Apple iPhone 14
  • Blue
  • 6 GB RAM
  • 128 GB Storage
₹52,590₹59,900
Buy now
11% OFF
Apple iPhone 15
  • Black
  • 6 GB RAM
  • 128 GB Storage
₹71,290₹79,900
Buy now
5% OFF
Apple iPhone 15 Pro
  • Black Titanium
  • 8 GB RAM
  • 128 GB Storage
₹127,990₹134,900
Buy now
NEXT ARTICLE BEGINS