HOME > INQUIRER > Article

Text Size

small

medium

large


AI chatbots can’t summarize news accurately, says BBC study

AI chatbots can’t summarize news accurately, says BBC study

Provided by INQUIRER.net.


 The British Broadcasting Corporation’s latest study reveals that AI chatbots distort and mislead when they report the news. 




 Deborah Turness, the CEO of BBC News and Current Affairs, wrote in a blog that AI brings “endless opportunities.”




 However, companies developing AI tools were “playing with fire.” 




 READ: Encouraging the world to pay for online news




 “How long will it be before an AI-distorted headline causes significant real-world harm?” she asked.




AI chatbots fall short in news reporting






https://twitter.com/mediagazer/status/1889306072545927320





 The BBC gave the popular AI chatbots ChatGPT, Copilot, Google Gemini and Perplexity AI-generated content from the BBC website.




 Then, it asked them questions about the news.




 As a result, the AI bots provided answers with “significant inaccuracies” and distortions.




 For example, Google Gemini mistakenly stated that “The NHS advises people not to start vaping and recommends that smokers who want to quit should use other methods.” 




 The NHS does not recommend vaping as a way to quit smoking.




 Moreover, the BBC study found these insights regarding AI news reporting:





  • 51% of all AI chatbots’ answers to news questions had significant issues.




  • 19% of AI answers citing BBC had factual errors like incorrect statements, dates and numbers.




  • 13% of BBC article quotes had alterations from the original or were absent in the article cited.





 BBC chief Deborah Turness says “AI assistants do not discern between facts and opinion in news coverage.”




 Also, they don’t distinguish between current and archive material and tend to add opinions into their answers. 




 Nevertheless, Pete Archer, BBC Program Director for Generative AI, expects more people to use AI assistants. 




 That’s why they should provide audiences with accurate and trustworthy information. 




 The BBC and other publications should have control over how AI companies use their content. 




 The tech and media sectors must work together to ensure people can find trustworthy information in the age of AI.

INQUIRER

HEADLINES

POLITICS
Japan PM Ishiba to Visit Vietnam, Philippines for 4 Days from April 27
ECONOMY
Foreign Visitors to Japan Up 13.5% to 3.49 M. Last Month, Record High for March
SPORTS
Task Force to Discuss Reform of Japan Games, Formerly National Sports Festival
OTHER
Painless Childbirth Cost Averages 600,000 Yen in Japan: Health Min. Panel Survey

AFP-JIJI PRESS NEWS JOURNAL


Photos