Cramond, F;
O'Mara-Eves, A;
Doran-Constant, L;
Rice, AS;
Macleod, M;
Thomas, J;
(2018)
The development and evaluation of an online application to assist in the extraction of data from graphs for use in systematic reviews [version 2; referees: 3 approved].
Wellcome Open Research
, 3
, Article 157. 10.12688/wellcomeopenres.14738.2.
Preview |
Text
f7a4ca64-070d-43b2-abca-b1155fc5e99d_14738_-_james_thomas_v2.pdf - Published Version Download (1MB) | Preview |
Abstract
Background: The extraction of data from the reports of primary studies, on which the results of systematic reviews depend, needs to be carried out accurately. To aid reliability, it is recommended that two researchers carry out data extraction independently. The extraction of statistical data from graphs in PDF files is particularly challenging, as the process is usually completely manual, and reviewers need sometimes to revert to holding a ruler against the page to read off values: an inherently time-consuming and error-prone process. Methods: To mitigate some of the above problems we integrated and customised two existing JavaScript libraries to create a new web-based graphical data extraction tool to assist reviewers in extracting data from graphs. This tool aims to facilitate more accurate and timely data extraction through a user interface which can be used to extract data through mouse clicks. We carried out a non-inferiority evaluation to examine its performance in comparison to standard practice. Results: We found that the customised graphical data extraction tool is not inferior to users' prior preferred current approaches. Our study was not designed to show superiority, but suggests that there may be a saving in time of around 6 minutes per graph, accompanied by a substantial increase in accuracy. Conclusions: Our study suggests that the incorporation of this type of tool in online systematic review software would be beneficial in facilitating the production of accurate and timely evidence synthesis to improve decision-making.
| Type: | Article |
|---|---|
| Title: | The development and evaluation of an online application to assist in the extraction of data from graphs for use in systematic reviews [version 2; referees: 3 approved] |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.12688/wellcomeopenres.14738.2 |
| Publisher version: | https://doi.org/10.12688/wellcomeopenres.14738.2 |
| Language: | English |
| Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
| Keywords: | Systematic review, automation, data extraction, graphs |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Social Research Institute |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10069576 |
Archive Staff Only
 |
View Item |
