A randomized comparison between league tables and funnel plots as an aid to health care decision-making
(2017) In International Journal for Quality in Health Care 28(6). p.816-823- Abstract
- Objective Comparison of provider performance is commonly used to inform health care decision-making. Little attention has been paid to how data presentations influence decisions. This study analyzes differences in suggested actions by decision-makers informed by league tables or funnel plots.
Design Decision-makers were invited to a survey and randomized to compare hospital performance using either league tables or funnel plots for four different measures within the area of cancer care. For each measure, decision-makers were asked to suggest actions towards 12–16 hospitals (no action, ask for more information, intervene) and provide feedback related to whether the information provided had been... (More) - Objective Comparison of provider performance is commonly used to inform health care decision-making. Little attention has been paid to how data presentations influence decisions. This study analyzes differences in suggested actions by decision-makers informed by league tables or funnel plots.
Design Decision-makers were invited to a survey and randomized to compare hospital performance using either league tables or funnel plots for four different measures within the area of cancer care. For each measure, decision-makers were asked to suggest actions towards 12–16 hospitals (no action, ask for more information, intervene) and provide feedback related to whether the information provided had been useful.
Setting Swedish health care.
Participants Two hundred and twenty-one decision-makers at administrative and clinical levels.
Intervention Data presentations in the form of league tables or funnel plots.
Main outcome measures Number of actions suggested by participants. Proportion of appropriate actions.
Results For all four measures, decision-makers tended to suggest more actions based on the information provided in league tables compared to funnel plots (44% vs. 21%, P < 0.001). Actions were on average more appropriate for funnel plots. However, when using funnel plots, decision-makers more often missed to react even when appropriate.
Conclusions The form of data presentation had an influence on decision-making. With league tables, decision-makers tended to suggest more actions compared to funnel plots. A difference in sensitivity and specificity conditioned by the form of presentation could also be identified, with different implications depending on the purpose of comparisons. Explanations and visualization aids are needed to support appropriate actions. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/03bd0f31-2467-49e6-aecf-ca2927b90372
- author
- Anell, Anders LU ; Hagberg, Oskar LU ; Liedberg, Fredrik LU and Ryden, Stefan
- organization
- publishing date
- 2017-02-01
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- quality measurement, quality management, experimental research, general methodology, audit, external quality assessment
- in
- International Journal for Quality in Health Care
- volume
- 28
- issue
- 6
- pages
- 816 - 823
- publisher
- Oxford University Press
- external identifiers
-
- scopus:85014433002
- pmid:28423165
- wos:000397053100025
- ISSN
- 1464-3677
- DOI
- 10.1093/intqhc/mzw125
- project
- Public Management Research
- language
- English
- LU publication?
- yes
- id
- 03bd0f31-2467-49e6-aecf-ca2927b90372
- date added to LUP
- 2016-10-11 15:49:17
- date last changed
- 2022-01-30 06:40:21
@article{03bd0f31-2467-49e6-aecf-ca2927b90372,
abstract = {{<b>Objective </b>Comparison of provider performance is commonly used to inform health care decision-making. Little attention has been paid to how data presentations influence decisions. This study analyzes differences in suggested actions by decision-makers informed by league tables or funnel plots.<br/><b><br/></b><b>Design </b>Decision-makers were invited to a survey and randomized to compare hospital performance using either league tables or funnel plots for four different measures within the area of cancer care. For each measure, decision-makers were asked to suggest actions towards 12–16 hospitals (no action, ask for more information, intervene) and provide feedback related to whether the information provided had been useful.<br/><b><br/></b><b>Setting </b>Swedish health care.<br/><b><br/></b><b>Participants </b>Two hundred and twenty-one decision-makers at administrative and clinical levels.<br/><b><br/></b><b>Intervention </b>Data presentations in the form of league tables or funnel plots.<br/><b><br/></b><b>Main outcome measures </b>Number of actions suggested by participants. Proportion of appropriate actions.<br/><b><br/></b><b>Results </b>For all four measures, decision-makers tended to suggest more actions based on the information provided in league tables compared to funnel plots (44% vs. 21%, P < 0.001). Actions were on average more appropriate for funnel plots. However, when using funnel plots, decision-makers more often missed to react even when appropriate.<br/><b>Conclusions </b>The form of data presentation had an influence on decision-making. With league tables, decision-makers tended to suggest more actions compared to funnel plots. A difference in sensitivity and specificity conditioned by the form of presentation could also be identified, with different implications depending on the purpose of comparisons. Explanations and visualization aids are needed to support appropriate actions.}},
author = {{Anell, Anders and Hagberg, Oskar and Liedberg, Fredrik and Ryden, Stefan}},
issn = {{1464-3677}},
keywords = {{quality measurement; quality management; experimental research; general methodology; audit; external quality assessment}},
language = {{eng}},
month = {{02}},
number = {{6}},
pages = {{816--823}},
publisher = {{Oxford University Press}},
series = {{International Journal for Quality in Health Care}},
title = {{A randomized comparison between league tables and funnel plots as an aid to health care decision-making}},
url = {{http://dx.doi.org/10.1093/intqhc/mzw125}},
doi = {{10.1093/intqhc/mzw125}},
volume = {{28}},
year = {{2017}},
}