HT TECH wants to start sending you push notifications. Click allow to subscribe

AI can screen online hate speech and give control back to users: New research

Users could receive a warning alert with a ‘Hate O’Meter’ – the hate speech severity score – the sender’s name, and an option to view the content or delete it unseen, akin to spam and malware.

By: PRASUN SONWALKAR
Updated on: Aug 20 2022, 18:29 IST
A new research promises to detect online hate messages and assign them a rating allowing users to decide if they want to view it. (Getty Images/Representational)
A new research promises to detect online hate messages and assign them a rating allowing users to decide if they want to view it. (Getty Images/Representational)

As online hate speech in India and elsewhere is increasingly seen as a threat to democracy, researchers are developing artificial intelligence that will, like malware filters, make 'quarantining' or controlling exposure to hate speech possible without resorting to censorship.

The experts are using databases of threats and violent insults to build algorithms that can provide a score determining the likelihood of an online message containing forms of hate speech. As these algorithms get refined, potential hate speech could be identified and 'quarantined'.

You may be interested in

Mobiles Tablets Laptops
37% OFF
Google Pixel 2 128GB
  • Kinda Blue
  • 4 GB RAM
  • 128 GB Storage
₹62,990₹99,999
Buy now
38% OFF
Google Pixel 7 Pro 5G
  • Obsidian
  • 12 GB RAM
  • 128 GB Storage
₹61,990₹99,999
Buy now
7% OFF
Google Pixel 7 5G
  • Obsidian
  • 8 GB RAM
  • 128 GB Storage
₹40,990₹43,999
Buy now
11% OFF
Google Pixel 7A
  • Charcoal
  • 8 GB RAM
  • 128 GB Storage
₹38,990₹43,999
Buy now
21% OFF
Acer Swift Go SFG14 41 NX KG3SI 002 Laptop
  • Pure Silver
  • 8 GB RAM
  • 512 GB SSD
₹58,999₹74,999
Buy now
39% OFF
Acer Aspire 5 A515 57G Laptop
  • Gray
  • 16 GB RAM
  • 512 GB SSD
₹54,949₹89,999
Buy now
22% OFF
Acer Aspire 3 A315 24 NX KDESI 004 Laptop
  • Silver
  • 8 GB RAM
  • 512 GB SSD
₹33,499₹42,999
Buy now
40% OFF
Asus VivoBook 15 X515JA BQ322WS Laptop
  • Transparent Silver
  • 8 GB RAM
  • 512 GB SSD
₹31,350₹51,990
Buy now
34% OFF
Xiaomi Pad 6
  • Mist Blue
  • 6 GB RAM
  • 128 GB Storage
₹26,299₹39,999
Buy now
55% OFF
Lenovo Tab M10 5G
  • Abyss Blue
  • 6 GB RAM
  • 128 GB Storage
₹20,999₹47,000
Buy now
21% OFF
Realme Pad 2
  • Imagination Grey
  • 6 GB RAM
  • 128 GB Storage
₹19,749₹24,990
Buy now
Honor Pad X9
  • Gray
  • 4 GB RAM
  • 128 GB Storage
₹14,999
Check details

Users could receive a warning alert with a 'Hate O'Meter' - the hate speech severity score - the sender's name, and an option to view the content or delete it unseen, akin to spam and malware.

Also read: Looking for a smartphone? To check mobile finder click here.

"Hate speech is a form of intentional online harm, like malware, and can therefore be handled by means of quarantining," says co-author and linguist Stefanie Ullman. "In fact, a lot of hate speech is actually generated by software such as Twitter bots."

An example might involve a word like 'bitch': A misogynistic slur, but also a legitimate term in contexts such as dog breeding. It is the algorithmic analysis of where such a word sits syntactically - the types of surrounding words and semantic relations between them - that informs the hate speech score.

"Companies like Facebook, Twitter and Google generally respond reactively to hate speech," adds co-author and engineer Marcus Tomalin. "This may be okay for those who don't encounter it often. For others it's too little, too late."

"Many women and people from minority groups in the public eye receive anonymous hate speech for daring to have an online presence. We are seeing this deter people from entering or continuing in public life, often from groups in need of greater representation," he says.

The researchers say their proposal is not a magic bullet, but sits between the "extreme libertarian and authoritarian approaches" of either entirely permitting or prohibiting certain language online. It makes the user the arbiter.

Tomalin says: "Many people don't like the idea of an unelected corporation or micromanaging government deciding what we can and can't say to each other. Our system will flag when we should be careful, but it's always your call".

"It doesn't stop people posting or viewing what they like, but it gives much needed control to those being inundated with hate," added Tomalin.

Catch all the Latest Tech News, Mobile News, Laptop News, Gaming news, Wearables News , How To News, also keep up with us on ,Twitter, Facebook, , and Instagram. For our latest videos, subscribe to our YouTube channel.

First Published Date: 25 Dec, 20:06 IST

Sale

Mobiles Tablets Laptops
5% OFF
Google Pixel 7A
  • Charcoal
  • 8 GB RAM
  • 128 GB Storage
₹41,990₹43,999
Buy now
61% OFF
Samsung Galaxy S23 FE
  • Mint
  • 8 GB RAM
  • 128 GB Storage
₹34,999₹90,000
Buy now
7% OFF
Samsung Galaxy A55
  • Awesome Iceblue
  • 8 GB RAM
  • 128 GB Storage
₹39,999₹42,999
Buy now
25% OFF
Vivo V30 Pro
  • Classic Black
  • 8 GB RAM
  • 256 GB Storage
₹41,499₹54,999
Buy now
33% OFF
Xiaomi Pad 6
  • Mist Blue
  • 6 GB RAM
  • 128 GB Storage
₹26,999₹39,999
Buy now
53% OFF
Lenovo Tab M10 5G
  • Abyss Blue
  • 6 GB RAM
  • 128 GB Storage
₹21,999₹47,000
Buy now
30% OFF
Realme Pad 2
  • Imagination Grey
  • 6 GB RAM
  • 128 GB Storage
₹20,339₹28,999
Buy now
31% OFF
Samsung Galaxy Tab A7 Lite
  • Silver
  • 3 GB RAM
  • 32 GB Storage
₹9,990₹14,500
Buy now
23% OFF
Infinix INBook X1 Neo XL22 Laptop Intel Celeron Quad Core 8 GB 256 GB SSD Windows 11
  • Blue
  • 4 GB RAM
  • 128 GB SSD
₹22,990₹29,990
Buy now
33% OFF
Asus TUF Gaming F15 FX507ZV LP094W Laptop
  • Mecha Gray
  • 16 GB RAM
  • 512 GB SSD
₹57,990₹85,990
Buy now
37% OFF
Asus Vivobook K15 OLED KM513UA L712WS Laptop
  • Indie Black
  • 16 GB RAM
  • 512 GB SSD
₹51,990₹81,990
Buy now
30% OFF
Asus ROG Zephyrus G14 GA401IU HA246TS Laptop
  • Eclipse Grey
  • 16 GB RAM
  • 512 GB SSD
₹90,990₹129,990
Buy now