LaTex2Web logo

Documents Live, a web authoring and publishing system

If you see this, something is wrong

Table of contents

First published on Wednesday, Nov 4, 2026 and last modified on Wednesday, Nov 4, 2026

How Data Journalists Visualize Uncertainty: Editorial Constraints and Design Heuristics in Newsroom Practice

Carmen Garro viu:lab at the Hamburg University of Applied Sciences Email

Annemarie Wisbar viu:lab at the Hamburg University of Applied Sciences Email

Benjamin Possin viu:lab at the Hamburg University of Applied Sciences Email

Christoph Kinkeldey viu:lab at the Hamburg University of Applied Sciences Email

Keywords: Uncertainty visualization, data journalism, visual communication, qualitative research, design practice

Abstract

1 Introduction

2 Background

3 Workshop Design and Analysis

4 Findings

5 Discussion

6 Two-level design guidance

7 Limitations and Future Work

8 Conclusion

9 Acknowledgments

References

[1] Jonathan Alan Gray and Liliana Bounegru Data Journalism Handbook 2: Towards a Critical Data Practice European Journalism Centre 2019 Google-Books-ID: LtvoxQEACAAJ

[2] F. Yang and M. Cai and C. Mortenson and H. Fakhari and A. D. Lokmanoglu and J. Hullman and S. Franconeri and N. Diakopoulos and E. C. Nisbet and M. Kay Swaying the Public? Impacts of Election Forecast Visualizations on Emotion, Trust, and Intention in the 2022 U.S. Midterms IEEE Transactions on Visualization and Computer Graphics 2024 30 1 23–33 10.1109/TVCG.2023.3327356

[3] Antti Kause and Wändi Bruine de Bruin and Susana Domingos and Neha Mittal and Jason Lowe and Fai Fung Communications about uncertainty in scientific climate-related findings: A qualitative systematic review Environmental Research Letters 2021 16 5 053005 10.1088/1748-9326/abb265

[4] Jessica Hullman Why Authors Don’t Visualize Uncertainty IEEE Transactions on Visualization and Computer Graphics 2019 26 1 130–139 10.1109/TVCG.2019.2934287

[5] A. M. van der Bles and S. van der Linden and A. L. J. Freeman and D. J. Spiegelhalter The effects of communicating uncertainty on public trust in facts and numbers Proceedings of the National Academy of Sciences 2020 117 14 7672–7683 10.1073/pnas.1913678117

[6] Nadia Boukhelifa and Chris R. Johnson and Kristin Potter Visualization and Decision Making Design Under Uncertainty IEEE Comput. Graph. Appl. 2023 43 5 23–25 sep 10.1109/MCG.2023.3302172

[7] Krisha Mehta Maybe, Maybe Not: A Survey on Uncertainty in Visualization dec 2022 arXiv preprint 10.48550/arXiv.2301.07687

[8] Antonia Hadjimichael and Julius Schlumberger and Marjolijn Haasnoot Data visualisation for decision making under deep uncertainty: current challenges and opportunities Environmental Research Letters 2024 19 11 111011 Oct 10.1088/1748-9326/ad858b

[9] Suvodip Chakraborty and Peter Kiefer and Martin Raubal The influence of uncertainty visualization on cognitive load in a safety- and time-critical decision-making task International Journal of Geographical Information Science 2024 38 8 1583–1610 May 10.1080/13658816.2024.2348747

[10] Gabriel Ryan and Abigail Mosca and Remco Chang and Eugene Wu At a Glance: Pixel Approximate Entropy as a Measure of Line Chart Complexity IEEE Transactions on Visualization and Computer Graphics 2019 25 1 872-881 10.1109/TVCG.2018.2865264

[11] Melanie Bancilhon and Amanda Wright and Sunwoo Ha and R. Jordan Crouser and Alvitta Ottley Why Combining Text and Visualization Could Improve Bayesian Reasoning: A Cognitive Load Perspective Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems 2023 CHI '23 Association for Computing Machinery 10.1145/3544548.3581218

[12] Michael Fernandes and Logan Walls and Sean Munson and Jessica Hullman and Matthew Kay Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems 2018 CHI '18 144:1–144:12 ACM 10.1145/3173574.3173718

[13] Anne Marthe van der Bles and Sander van der Linden and Alexandra L. J. Freeman and James Mitchell and Ana B. Galvão and Lisa Zaval and David J. Spiegelhalter Communicating uncertainty about facts, numbers and science Royal Society Open Science 2019 6 5 181870 10.1098/rsos.181870

[14] Sarah Belia and Fiona Fidler and Jennifer Williams and Geoff Cumming Researchers misunderstand confidence intervals and standard error bars Psychological Methods 2005 10 4 389–396 10.1037/1082-989X.10.4.389

[15] Jake M. Hofman and Daniel G. Goldstein and Jessica Hullman How Visualizing Inferential Uncertainty Can Mislead Readers About Treatment Effects in Scientific Results Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems 2020 CHI '20 1–12 Association for Computing Machinery 10.1145/3313831.3376454

[16] S. Joslyn and S. Savelli Visualizing Uncertainty for Non-Expert End Users: The Challenge of the Deterministic Construal Error Frontiers in Computer Science 2021 2 590232 10.3389/fcomp.2020.590232

[17] Bruce G. Marcot Communicating Uncertainty 117–139 CRC Press 2020 Nov 10.1201/9780429299575-4

[18] Baruch Fischhoff Communicating Uncertainty: Fulfilling the Duty to Inform Issues in Science and Technology 2012 28 4 Summer 2012

[19] Christian Pentzold and Dominik Fechner Probabilistic Storytelling and Temporal Exigencies in Predictive Data Journalism Digital Journalism 2021 9 6 715–736 10.1080/21670811.2021.1878920

[20] Christian Pentzold and Daniela Fechner Data journalism’s many futures: Diagrammatic displays and prospective probabilities in data-driven news predictions Convergence: The International Journal of Research into New Media Technologies 2020 26 4 732–750 10.1177/1354856519880790

[21] Francesca Morini Data Journalism as “Terra Incognita'': Newcomers’ Tensions in Shifting Towards Data Journalism Epistemology Journalism Practice 2023 19 1 76–92 Mar 10.1080/17512786.2023.2185656

[22] Christopher J. Bryan and Elizabeth Tipton and David S. Yeager Behavioural science is unlikely to change the world without a heterogeneity revolution Nature Human Behaviour 2021 5 980–989 10.1038/s41562-021-01143-3

[23] Fang Yang and Connor R. Mortenson and Matthew C. Nisbet and Nicholas Diakopoulos and Michael Kay In Dice We Trust: Uncertainty Displays for Maintaining Trust in Election Forecasts Over Time Proceedings of the CHI Conference on Human Factors in Computing Systems 2024 1–24 10.1145/3613904.3642371

[24] Werner Krause and Christina Gahn Should we include margins of error in public opinion polls? European Journal of Political Research 2024 63 3 1082–1107 10.1111/1475-6765.12633

[25] Daniel Weiskopf Uncertainty Visualization: Concepts, Methods, and Applications in Biological Data Visualization Frontiers in Bioinformatics 2022 2 10.3389/fbinf.2022.793819

[26] Mowafak Allaham and Nicholas Diakopoulos Predicting COVID: Understanding audience responses to predictive journalism via online comments New Media & Society 2024 26 9 5314-5335 10.1177/14614448221135632

[27] Amit Jena and Ulrich Engelke and Tim Dwyer and Venkatesh Raiamanickam and Cecile Paris Uncertainty Visualisation: An Interactive Visual Survey 2020 IEEE Pacific Visualization Symposium (PacificVis) 2020 201-205 10.1109/PacificVis48177.2020.1014

[28] Rana Arafat and Colin Porlezza Exploring News Innovations, Journalistic Routines, and Role Perceptions during the COVID-19 Pandemic: A Case Study of Egyptian Journalists Journalism Studies 2023 24 14 1775–1796 Apr 10.1080/1461670x.2023.2192295

[29] Signe Ivask and Lenka Waschková Císařová Locked Up: Local Newsrooms Managing a Digital Shift at the Centre of the Covid-19 Outbreak Journalism Practice 2023 18 1 200–216 Oct 10.1080/17512786.2023.2266483

[30] Morten Skovsgaard and Lene Heiselberg and Kim Andersen The Context-Dependent Demand for Watchdog Journalism: Dynamics in Audience Expectations for Journalists’ Role Performance Journalism Practice 2024 18 9 2454–2475 May 10.1080/17512786.2024.2347340

[31] Dominic Detzen ‘A building of shame and disgrace’ or ‘trial by media’? Media framing of KPMG Netherlands’ head office Critical Perspectives on Accounting 2024 98 102676 Jan 10.1016/j.cpa.2023.102676

[32] Northwestern Buffett Institute for Global Affairs Visualizing a World of COVID-19 Uncertainty apr 2020 Accessed: 2026-03-31

[33] Michael Correll Position Paper: Are We Making Progress In Visualization Research? 2022 IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV) 2022 1-10 10.1109/BELIV57783.2022.00005

[34] Benjamin Possin and Christoph Kinkeldey Charting Scenarios: A Framework for Uncertainty Visualization in Data Journalism Practice aug 2025 Published: OSF preprint, poster abstract for VIS 2025 10.31219/osf.io/n3bk4_v1

[35] Christoph Kinkeldey and Alan M. MacEachren and Jochen Schiewe How to Assess Visual Communication of Uncertainty? A Systematic Review of Geospatial Uncertainty Visualisation User Studies The Cartographic Journal 2014 51 4 372–386 nov 10.1179/1743277414Y.0000000099

[36] Carmen Garro and Christoph Kinkeldey Uncertainty Visualization in Data Journalism: A Pilot Study on Election Polls in a DER SPIEGEL Online Article aug 2025 10.31235/osf.io/7g5ku_v1

[37] Ian T. Ruginski and Alexander P. Boone and Lace M. Padilla and Le Liu and Nahal Heydari and Heidi S. Kramer and Mary Hegarty and William B. Thompson and Donald H. House and Sarah H. Creem-Regehr Non-expert interpretations of hurricane forecast uncertainty visualizations Spatial Cognition & Computation 2016 16 2 154–172 10.1080/13875868.2015.1137577

[38] Kenneth Broad and Anthony Leiserowitz and Jessica Weinkle and Marissa Steketee Misinterpretations of the “Cone of Uncertainty” in Florida during the 2004 Hurricane Season Bulletin of the American Meteorological Society 2007 88 5 651–668 10.1175/BAMS-88-5-651

[39] Robert Kosara Presentation-Oriented Visualization Techniques Computer Graphics and Applications (CG&A) 2016 36 1 80–85 10.1109/MCG.2016.2

[40] Nadia Boukhelifa and Marc-Emmanuel Perrin and Samuel Huron and James Eagan How Data Workers Cope with Uncertainty: A Task Characterisation Study Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems 2017 CHI '17 3645–3656 Association for Computing Machinery 10.1145/3025453.3025738

[41] P. M. Allen and J. A. Edwards and F. J. Snyder and K. A. Makinson and D. M. Hamby The effect of cognitive load on decision making with graphically displayed uncertainty information Risk Analysis 2014 34 8 1495–1505 10.1111/risa.12161

[42] Lace MK Padilla and Maia Powell and Matthew Kay and Jessica Hullman Uncertain About Uncertainty: How Qualitative Expressions of Forecaster Confidence Impact Decision-Making With Uncertainty Visualizations Frontiers in Psychology 2021 11 579267 10.3389/fpsyg.2020.579267

[43] Dries, Christian and McDowell, M. and Schneider, C. R. and Rebitschek, F. G., The effect of uncertainty communication on public trust depends on belief-evidence consistency, PNAS Nexus, 2025, 4, 3, pgaf071, 10.1093/pnasnexus/pgaf071, 40115049, PMC11925018, Oxford University Press

[44] Springer, Aaron and Whittaker, Steve, Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information?, ACM Transactions on Interactive Intelligent Systems, 2020, 10, 4, 1–32, 2160-6455, 10.1145/3411764, ACM

[45] Peña-Araya, Vanessa and Martínez Fontaine, Consuelo and Wei, Xiang and Delpech, Guillaume and Bezerianos, Anastasia, Uncertainty in Science is Malleable. Advocating for User-Agency in Defining Uncertainty in Visualizations: a Case Study in Geology, 2025, 9798400713941, Association for Computing Machinery, New York, NY, USA, https://doi.org/10.1145/3706598.3713972 , 10.1145/3706598.3713972, Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, 1095, 18, , CHI '25

[46] Saske, Antonia and Koesten, Laura and Möller, Torsten and Staudner, Judith and Kritzinger, Sylvia, A Multidimensional Assessment Method for Visualization Understanding (MdamV), IEEE Transactions on Visualization and Computer Graphics, 32, 3, 2695–2708, 2026, 10.1109/TVCG.2026.3653265

[47] Segel, Edward and Heer, Jeffrey, IEEE Transactions on Visualization and Computer Graphics, Narrative Visualization: Telling Stories with Data, 2010, 16, 6, 1139-1148, 10.1109/TVCG.2010.179

[48] Hullman, Jessica and Diakopoulos, Nick, IEEE Transactions on Visualization and Computer Graphics, Visualization Rhetoric: Framing Effects in Narrative Visualization, 2011, 17, 12, 2231-2240, 10.1109/TVCG.2011.255

[49] Rahman, Md Dilshadur and Doppalapudi, Bhavana and Quadri, Ghulam Jilani and Rosen, Paul, IEEE Transactions on Visualization and Computer Graphics, A Survey on Annotations in Information Visualization: Empirical Studies, Applications and Challenges, 2025, 31, 12, 10439-10456, 10.1109/TVCG.2025.3600957

[50] Shneiderman, B., Proceedings 1996 IEEE Symposium on Visual Languages, The eyes have it: a task by data type taxonomy for information visualizations, 1996, , , 336-343, 10.1109/VL.1996.545307

[51] Kim, Hyeok and Moritz, Dominik and Hullman, Jessica, Design Patterns and Trade-Offs in Responsive Visualization for Communication, Computer Graphics Forum, 40, 3, 459–470, 2021, 10.1111/cgf.14321

[52] Goodwin, Sarah and Saunders, Thom and Aitken, Joanne and Baade, Peter and Chandrasiri, Upeksha and Cook, Dianne and Cramb, Susanna and Duncan, Earl and Kobakian, Stephanie and Roberts, Jessie and Mengersen, Kerrie, Designing the Australian Cancer Atlas: Visualizing Geostatistical Model Uncertainty for Multiple Audiences, Journal of the American Medical Informatics Association, 31, 11, 2447–2454, 2024, 10.1093/jamia/ocae212

[53] Varun Srivastava and Fan Lei and Alan MacEachren and Ross Maciejewski The Impact of Uncertainty Visualization on Trust in Thematic Maps Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems 2026 CHI '26 Association for Computing Machinery 10.1145/3772318.3790743

[54] Ghulam Jilani Quadri and Arran Zeyu Wang and Zhehao Wang and Jennifer Adorno and Paul Rosen and Danielle Albers Szafir Do You See What I See? A Qualitative Study Eliciting High-Level Visualization Comprehension Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems 2024 CHI '24 Association for Computing Machinery 10.1145/3613904.3642813

Discussion: login to participate.