AI summaries turn real news into nonsense

AI summaries turn real news into nonsense, BBC finds

Research after Apple Intelligence fiasco shows bots still regularly
make stuff up
...
...
The research focused on OpenAI's ChatGPT, Microsoft's Copilot,
Google's Gemini, and Perplexity assistants, assessing their ability to
provide "accurate responses to questions about the news; and if their
answers faithfully represented BBC news stories used as sources."

The assistants were granted access to the BBC website for the duration
of the research and asked 100 questions about the news, being prompted
to draw from BBC News articles as sources where possible. Normally,
these models are "blocked" from accessing the broadcaster's websites,
the BBC said.

Responses were reviewed by BBC journalists, "all experts in the
question topics," on their accuracy, impartiality, and how well they
represented BBC content. Overall:



    51 percent of all AI answers to questions about the news were
judged to have significant issues of some form.

    19 percent of AI answers which cited BBC content introduced
factual errors - incorrect factual statements, numbers, and dates.

    13 percent of the quotes sourced from BBC articles were either
altered from the original source or not present in the article cited.

https://www.theregister.com/2025/02/12/bbc_ai_news_accuracy/