Zum Inhalt springen

Abstract

Comprehensive analyses of diverging patterns in the journalistic coverage of major controversial topics are often limited by the volume of content that such analyses can realistically process. In-depth research typically relies on the manual coding of content for a variety of aspects – for instance, which stakeholders are represented in news coverage, how are issues framed and solutions presented, what terms and language is used to describe the problem. But manual coding is labour- and resource-intensive, and therefore does not scale well; large-scale and longitudinal analyses of news content are therefore rare and limit themselves to a small number of aspects to be coded. This presentation outlines possible approaches for the use of Large Language Models (LLMs) to augment and extend such work, with a particular focus on the use of such approaches to detect patterns of polarisation in the news media. These approaches use emerging LLMs in the role of human content coders, training and testing them against a manually coded subset of the data and investigating the reliability, replicability, and limitations of such approaches. Although several obstacles to this work still remain, a successful implementation has the potential to substantially enhance and upscale the analysis of large news corpora.

Bio

Axel Bruns is an Australian Laureate Fellow and Professor in the Digital Media Research Centre at Queensland University of Technology in Brisbane, Australia, and a Chief Investigator in the ARC Centre of Excellence for Automated Decision-Making and Society. His books include Are Filter Bubbles Real? (2019) and Gatewatching and News Curation: Journalism, Social Media, and the Public Sphere (2018), and the edited collections Digitizing Democracy (2019), the Routledge Companion to Social Media and Politics (2016), and Twitter and Society (2014). His current research focusses on the study of public communication in digital and social media environments, with particular attention to the dynamics of polarisation, partisanship, and problematic information, and their implications for our understanding of the contemporary public sphere; his work draws especially on innovative new methods for analysing ‘big social data’. He served as President of the Association of Internet Researchers in 2017–19.