AI tool ‘Rosetta’ helps Facebook, Instagram identify offensive memes

The AI tool can identify text in images and videos as well as transcribe it.

By: INDO ASIAN NEWS SERVICE
| Updated on: Sep 12 2018, 14:44 IST
Facebook’s AI tool understands text in images and videos.
Facebook’s AI tool understands text in images and videos. (Facebook)

In a bid to curtail offensive memes that promote hate speech, Facebook is building a novel artificial intelligence (AI) system that uses machine learning to identify text in images and videos as well as transcribe it.

While tools to transcribe text are nothing new, the company faces different challenges because of the size, sheer volume of photos shared each day on Facebook and Instagram, and the number of languages supported on its global platform.

You may be interested in

MobilesTablets Laptops
7% OFF
Apple iPhone 15 Pro Max
  • Black Titanium
  • 8 GB RAM
  • 256 GB Storage
Google Pixel 8 Pro
  • Obsidian
  • 12 GB RAM
  • 128 GB Storage
34% OFF
Samsung Galaxy S23 Ultra 5G
  • Green
  • 12 GB RAM
  • 256 GB Storage
Apple iPhone 15 Plus
  • Black
  • 6 GB RAM
  • 128 GB Storage

With the novel AI system called Rosetta, Facebook can process more than a billion public images and Instagram images and video frames (in a wide variety of languages) per day through the system efficiently.

Also read
Looking for a smartphone? To check mobile finder click here.

The extracted text is then used by downstream classifiers to immediately act upon policy-violating content or by product applications like photo search.

"Understanding text in images along with the context in which it appears also helps our systems to proactively identify inappropriate or harmful content and keep our community safe," the social media giant said in a blog post late on Tuesday.

"Text extracted from images is being used to improve the relevance and quality of photo search, automatically identifying content that violates our hate-speech policy on the platform in various languages, and improve the accuracy of classification of photos in News Feed to surface more personalised content," the networking giant noted.

Further, Facebook is also continuing to invest in extending the text recognition model for the wide number of languages used on its global platform.

Catch all the Latest Tech News, Mobile News, Laptop News, Gaming news, Wearables News , How To News, also keep up with us on Whatsapp channel,Twitter, Facebook, Google News, and Instagram. For our latest videos, subscribe to our YouTube channel.

First Published Date: 12 Sep, 14:44 IST
NEXT ARTICLE BEGINS