Search Resources

1 Result

View
Selected filters:
  • Scientific Data
Assessing data availability and research reproducibility in hydrology and water resources
Unrestricted Use
CC BY
Rating

There is broad interest to improve the reproducibility of published research. We developed a survey tool to assess the availability of digital research artifacts published alongside peer-reviewed journal articles (e.g. data, models, code, directions for use) and reproducibility of article results. We used the tool to assess 360 of the 1,989 articles published by six hydrology and water resources journals in 2017. Like studies from other fields, we reproduced results for only a small fraction of articles (1.6% of tested articles) using their available artifacts. We estimated, with 95% confidence, that results might be reproduced for only 0.6% to 6.8% of all 1,989 articles. Unlike prior studies, the survey tool identified key bottlenecks to making work more reproducible. Bottlenecks include: only some digital artifacts available (44% of articles), no directions (89%), or all artifacts available but results not reproducible (5%). The tool (or extensions) can help authors, journals, funders, and institutions to self-assess manuscripts, provide feedback to improve reproducibility, and recognize and reward reproducible articles as examples for others.

Subject:
Information Science
Physical Science
Hydrology
Material Type:
Reading
Provider:
Scientific Data
Author:
Adel M. Abdallah
David E. Rosenberg
Hadia Akbar
James H. Stagge
Nour A. Attallah
Ryan James
Date Added:
08/07/2020