HT TECH wants to start sending you push notifications. Click allow to subscribe

AI models struggle to identify nonsense, says study

AI models struggle to differentiate between nonsense and natural language, highlighting limitations and raising concerns about their use in legal or medical settings.

By: AFP
Updated on: Sep 15 2023, 07:45 IST
The study found that all models tested made mistakes in differentiating between meaningful and gibberish sentences. (Pexels)
The study found that all models tested made mistakes in differentiating between meaningful and gibberish sentences. (Pexels)

The AI models that power chatbots and other applications still have difficulty distinguishing between nonsense and natural language, according to a study released on Thursday.

The researchers at Columbia University in the United States said their work revealed the limitations of current AI models and suggested it was too early to let them loose in legal or medical settings.

You may be interested in

Mobiles Tablets Laptops
22% OFF
Realme 9 5G SE
  • Starry Glow
  • 6 GB RAM
  • 128 GB Storage
₹19,499₹24,999
Buy now
Apple iPhone 15
  • Black
  • 6 GB RAM
  • 128 GB Storage
₹79,900
Check details
OnePlus Nord 2 8GB RAM
  • Grey Sierra
  • 8 GB RAM
  • 128 GB Storage
₹19,700
Check details
OnePlus 11
  • Titan Black
  • 8 GB RAM
  • 128 GB Storage
₹56,998
Check details
39% OFF
Acer Aspire 5 A515 57G Laptop
  • 16 GB RAM
  • 512 GB SSD
₹47,990₹78,999
Buy now
Asus VivoBook 15 X515JA BQ322WS Laptop
  • Transparent Silver
  • 8 GB RAM
  • 512 GB SSD
₹35,990
Check details
Lenovo Ideapad 3 15IML05 81WB012DIN Laptop
  • 8 GB RAM
  • 256 GB SSD
₹39,499
Check details
HP Pavilion 15 ec2004AX
  • Shadow Black
  • 8 GB DDR4 RAM
  • 512 GB SSD
₹54,890
Check details
Xiaomi Pad 6
  • Black
  • 6 GB RAM
  • 128 GB Storage
₹24,999
Check details
Lenovo Tab M10 Plus 3rd Gen LTE
  • Storm Grey
  • 6 GB RAM
  • 128 GB Storage
₹20,490
Check details
Realme Pad X
  • Glowing Grey
  • 4 GB RAM
  • 64 GB Storage
₹29,999
Check details
Realme Pad
  • Real Gold
  • 3 GB RAM
  • 32 GB Storage
₹22,999
Check details

They put nine AI models through their paces, firing hundreds of pairs of sentences at them and asking which were likely to be heard in everyday speech.

Also read: Looking for a smartphone? To check mobile finder click here.

They asked 100 people to make the same judgement on pairs of sentences like: "A buyer can own a genuine product also / One versed in circumference of highschool I rambled."

The research, published in the Nature Machine Intelligence journal, then weighed the AI answers against the human answers and found dramatic differences.

Sophisticated models like GPT-2, an earlier version of the model that powers viral chatbot ChatGPT, generally matched the human answers.

Other simpler models did less well.

But the researchers highlighted that all the models made mistakes.

"Every model exhibited blind spots, labelling some sentences as meaningful that human participants thought were gibberish," said psychology professor Christopher Baldassano, an author of the report.

"That should give us pause about the extent to which we want AI systems making important decisions, at least for now."

Tal Golan, another of the paper's authors, told AFP that the models were "an exciting technology that can complement human productivity dramatically".

However, he argued that "letting these models replace human decision-making in domains such as law, medicine, or student evaluation may be premature".

Among the pitfalls, he said, was the possibility that people might intentionally exploit the blind spots to manipulate the models.

AI models burst into public consciousness with the release of ChatGPT last year, which has since been credited with passing various exams and has been touted as a possible aide to doctors, lawyers and other professionals.

Follow HT Tech for the latest tech news and reviews , also keep up with us on ,Twitter, Facebook, , and Instagram. For our latest videos, subscribe to our YouTube channel.

First Published Date: 15 Sep, 07:45 IST

Sale

Mobiles Tablets Laptops
33% OFF
OnePlus Nord 2 8GB RAM
  • Grey Sierra
  • 8 GB RAM
  • 128 GB Storage
₹19,990₹29,999
Buy now
14% OFF
Apple iPhone 14 Plus
  • Blue
  • 6 GB RAM
  • 128 GB Storage
₹68,999₹79,900
Buy now
15% OFF
OPPO Find N2 Flip
  • Black
  • 8 GB RAM
  • 256 GB Storage
₹84,990₹99,999
Buy now
20% OFF
Vivo X90 Pro
  • Legendary Black
  • 12 GB RAM
  • 256 GB Storage
₹73,989₹91,999
Buy now
33% OFF
Xiaomi Pad 6
  • Black
  • 6 GB RAM
  • 128 GB Storage
₹26,999₹39,999
Buy now
38% OFF
Lenovo Tab M10 Plus 3rd Gen LTE
  • Storm Grey
  • 6 GB RAM
  • 128 GB Storage
₹21,100₹34,000
Buy now
15% OFF
Samsung Galaxy Tab S7 FE 128GB
  • Mystic Black
  • 6 GB RAM
  • 128 GB Storage
₹56,999₹66,999
Buy now
15% OFF
Samsung Galaxy Tab S8
  • Silver
  • 8 GB RAM
  • 128 GB Storage
₹56,999₹66,999
Buy now
20% OFF
Lenovo Ideapad 3 15IML05 81WB012DIN Laptop
  • 8 GB RAM
  • 256 GB SSD
₹37,499₹46,990
Buy now
38% OFF
Acer Aspire 7 A715 42G Laptop
  • Charcoal Black
  • 8 GB DDR4 RAM
  • 512 GB SSD
₹55,990₹89,999
Buy now
31% OFF
HP Chromebook 11a na0010nr 1F6F4UA Laptop
  • 4 GB RAM
  • 32 GB SSD
₹40,205₹58,297
Buy now
21% OFF
Acer Swift Go SFG14 41 NX KG3SI 002 Laptop
  • 8 GB RAM
  • 512 GB SSD
₹58,990₹74,999
Buy now
NEXT ARTICLE BEGINS