Freeman, SC;
Fisher, D;
White, IR;
Auperin, A;
Carpenter, JR;
(2019)
Identifying inconsistency in network meta-analysis: Is the net heat plot a reliable method?
Statistics in Medicine
, 38
(29)
pp. 5547-5564.
10.1002/sim.8383.
Preview |
Text
White_Identifying inconsistency in network meta-analysis. Is the net heat plot a reliable method_VoR.pdf Download (2MB) | Preview |
Abstract
One of the biggest challenges for network meta-analysis is inconsistency, which occurs when the direct and indirect evidence conflict. Inconsistency causes problems for the estimation and interpretation of treatment effects and treatment contrasts. Krahn and colleagues proposed the net heat approach as a graphical tool for identifying and locating inconsistency within a network of randomized controlled trials. For networks with a treatment loop, the net heat plot displays statistics calculated by temporarily removing each design one at a time, in turn, and assessing the contribution of each remaining design to the inconsistency. The net heat plot takes the form of a matrix which is displayed graphically with coloring indicating the degree of inconsistency in the network. Applied to a network of individual participant data assessing overall survival in 7531 patients with lung cancer, we were surprised to find no evidence of important inconsistency from the net heat approach; this contradicted other approaches for assessing inconsistency such as the Bucher approach, Cochran's Q statistic, node-splitting, and the inconsistency parameter approach, which all suggested evidence of inconsistency within the network at the 5% level. Further theoretical work shows that the calculations underlying the net heat plot constitute an arbitrary weighting of the direct and indirect evidence which may be misleading. We illustrate this further using a simulation study and a network meta-analysis of 10 treatments for diabetes. We conclude that the net heat plot does not reliably signal inconsistency or identify designs that cause inconsistency.
| Type: | Article |
|---|---|
| Title: | Identifying inconsistency in network meta-analysis: Is the net heat plot a reliable method? |
| Location: | England |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1002/sim.8383 |
| Publisher version: | https://doi.org/10.1002/sim.8383 |
| Language: | English |
| Additional information: | © 2019 The Authors. Statistics in Medicine Published by John Wiley & Sons Ltd. This is an open access article under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/). |
| Keywords: | inconsistency, net heat plot, network meta-analysis |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Inst of Clinical Trials and Methodology > MRC Clinical Trials Unit at UCL |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10084744 |
Archive Staff Only
 |
View Item |
