Pages

Tuesday, July 02, 2024

ChatGPT is hallucinating fake links to its news partners’ biggest investigations

 LLRX – Generative AI Resources 2024 – Referencing an article in this month’s Georgetown Law Technology Review, “…traditional AI algorithms normally operate by carrying out a specific function or completing a task using a data set that contains information on how that function or task has previously been done In other words, traditional AI is able to follow a set of rules, make predictions, or utilize instructions to complete a task; but it is not creating anything new in doing so.

 Generative AI (GAI) has the ability to create something new, specifically new content.” Marcus P. Zillman new resource guide spans subject matters including law, economics, education, information technology, planning and strategic deployment and use of GAI, as well a best practices and governance



ChatGPT is hallucinating fake links to its news partners’ biggest investigations

NiemanLab, Andrew Deck: “Over the past year, several major news media companies have signed on the dotted line with OpenAI, entering a content licensing partnership with the developer of ChatGPT. 

Most of those partnership announcements state that as part of the deals, ChatGPT will produce attributed summaries of each media company’s reporting and link to their publications’ websites.On June 13, I reported that despite its deal, ChatGPT is outputting hallucinated links to one such partnered publication, Business Insider. Using details from a leaked letter written by the Business Insider Union’s steward, I confirmed the chatbot is generating fake URLs for some of the outlet’s biggest investigations and directing some users to 404 errors instead of real article pages. 

Now, my reporting confirms that ChatGPT is hallucinating URLs for at least 10 other publications that are part of OpenAI’s ongoing licensing deals. These publications include The Associated Press, The Wall Street Journal, the Financial Times, The Times (UK), Le Monde, El País, The Atlantic, The Verge, Vox, and Politico.In my testing, I repeatedly prompted ChatGPT to link out to these publications’ marquee articles, including Pulitzer Prize-winning stories and years-long investigations. These types of stories are editorial investments that can be both incredibly valuable to a brand’s reputation, and incredibly costly to produce. 

All together, my tests show that ChatGPT is currently unable to reliably link out to even these most noteworthy stories by partner publications. While the specific language differs, most partnered media companies have explicitly stated that ChatGPT will link out to their websites. “Queries that surface The Atlantic will include attribution and a link to read the full article on theatlantic.com,” reads The Atlantic’s licensing deal announcement from last month.

 “ChatGPT’s answers to user queries will include attribution and links to the full articles for transparency and further information,” reads a similar announcement by Berlin-based publisher Axel Springer from December 2023. OpenAI has also pitched news publishers “priority placement and ‘richer brand expression’ in chat conversations” and “more prominent link treatments” in ChatGPT, according to reporting earlier this year by Adweek on leaked OpenAI slide decks.