HOME > INQUIRER > Article

Text Size

small

medium

large


AI chatbots can’t summarize news accurately, says BBC study

AI chatbots can’t summarize news accurately, says BBC study

Provided by INQUIRER.net.


 The British Broadcasting Corporation’s latest study reveals that AI chatbots distort and mislead when they report the news. 




 Deborah Turness, the CEO of BBC News and Current Affairs, wrote in a blog that AI brings “endless opportunities.”




 However, companies developing AI tools were “playing with fire.” 




 READ: Encouraging the world to pay for online news




 “How long will it be before an AI-distorted headline causes significant real-world harm?” she asked.




AI chatbots fall short in news reporting






https://twitter.com/mediagazer/status/1889306072545927320





 The BBC gave the popular AI chatbots ChatGPT, Copilot, Google Gemini and Perplexity AI-generated content from the BBC website.




 Then, it asked them questions about the news.




 As a result, the AI bots provided answers with “significant inaccuracies” and distortions.




 For example, Google Gemini mistakenly stated that “The NHS advises people not to start vaping and recommends that smokers who want to quit should use other methods.” 




 The NHS does not recommend vaping as a way to quit smoking.




 Moreover, the BBC study found these insights regarding AI news reporting:





  • 51% of all AI chatbots’ answers to news questions had significant issues.




  • 19% of AI answers citing BBC had factual errors like incorrect statements, dates and numbers.




  • 13% of BBC article quotes had alterations from the original or were absent in the article cited.





 BBC chief Deborah Turness says “AI assistants do not discern between facts and opinion in news coverage.”




 Also, they don’t distinguish between current and archive material and tend to add opinions into their answers. 




 Nevertheless, Pete Archer, BBC Program Director for Generative AI, expects more people to use AI assistants. 




 That’s why they should provide audiences with accurate and trustworthy information. 




 The BBC and other publications should have control over how AI companies use their content. 




 The tech and media sectors must work together to ensure people can find trustworthy information in the age of AI.

INQUIRER

HEADLINES

POLITICS
Ishiba Orders Accelerated Infrastructure Inspections after Saitama Road Collapse
ECONOMY
KKR Successfully Completes Tender Offer for Fuji Soft after Bain's Withdrawal
SPORTS
Soccer: Arsenal Defender Tomiyasu Seen Out until Year-End after Knee Surgery
OTHER
Local Authorities Raid Aomori Hospital over Alleged Cover-up of Patient Murder

AFP-JIJI PRESS NEWS JOURNAL


Photos