Quantifying and addressing the prevalence and bias of study designs in the environmental and social sciences.

Autor: Christie AP; Conservation Science Group, Department of Zoology, University of Cambridge, The David Attenborough Building, Downing Street, Cambridge, CB3 3QZ, UK. alec.christie@hotmail.co.uk., Abecasis D; Centre of Marine Sciences (CCMar), Universidade do Algarve, Campus de Gambelas, 8005-139, Faro, Portugal., Adjeroud M; Institut de Recherche pour le Développement (IRD), UMR 9220 ENTROPIE & Laboratoire d'Excellence CORAIL, Université de Perpignan Via Domitia, 52 avenue Paul Alduy, 66860, Perpignan, France., Alonso JC; Museo Nacional de Ciencias Naturales, CSIC, Madrid, Spain., Amano T; School of Biological Sciences, University of Queensland, Brisbane, 4072, QLD, Australia., Anton A; Education Faculty of Bilbao, University of the Basque Country (UPV/EHU). Sarriena z/g E-48940 Leioa, Basque Country, Spain., Baldigo BP; U.S. Geological Survey, New York Water Science Center, 425 Jordan Rd., Troy, NY, 12180, USA., Barrientos R; Universidad Complutense de Madrid, Departamento de Biodiversidad, Ecología y Evolución, Facultad de Ciencias Biológicas, c/ José Antonio Novais, 12, E-28040, Madrid, Spain., Bicknell JE; Durrell Institute of Conservation and Ecology (DICE), School of Anthropology and Conservation, University of Kent, Canterbury, CT2 7NR, UK., Buhl DA; U.S. Geological Survey, Northern Prairie Wildlife Research Center, Jamestown, ND, 58401, USA., Cebrian J; Northern Gulf Institute, Mississippi State University, 1021 Balch Blvd, John C. Stennis Space Center, Mississippi, 39529, USA., Ceia RS; MARE - Marine and Environmental Sciences Centre, Dept. Life Sciences, University of Coimbra, Coimbra, Portugal.; CFE - Centre for Functional Ecology, Dept. Life Sciences, University of Coimbra, Coimbra, Portugal., Cibils-Martina L; Departamento de Ciencias Naturales, Universidad Nacional de Río Cuarto (UNRC), Córdoba, Argentina.; CONICET, Buenos Aires, Argentina., Clarke S; Marine Institute, Rinville, Oranmore, Galway, Ireland., Claudet J; National Center for Scientific Research, PSL Université Paris, CRIOBE, USR 3278 CNRS-EPHE-UPVD, Maison des Océans, 195 rue Saint-Jacques, 75005, Paris, France., Craig MD; School of Biological Sciences, University of Western Australia, Nedlands, WA, 6009, Australia.; School of Environmental and Conservation Sciences, Murdoch University, Murdoch, WA, 6150, Australia., Davoult D; Sorbonne Université, CNRS, UMR 7144, Station Biologique, F.29680, Roscoff, France., De Backer A; Flanders Research Institute for Agriculture, Fisheries and Food (ILVO), Ankerstraat 1, 8400, Ostend, Belgium., Donovan MK; Marine Science Institute, University of California Santa Barbara, Santa Barbara, CA, 93106, USA.; Hawaii Institute of Marine Biology, University of Hawaii at Manoa, Honolulu, HI, 96822, USA., Eddy TD; Baruch Institute for Marine & Coastal Sciences, University of South Carolina, Columbia, SC, USA.; Centre for Fisheries Ecosystems Research, Fisheries & Marine Institute, Memorial University of Newfoundland, St. John's, Canada.; School of Biological Sciences, Victoria University of Wellington, P O Box 600, Wellington, 6140, New Zealand., França FM; Lancaster Environment Centre, Lancaster University, LA1 4YQ, Lancaster, UK., Gardner JPA; School of Biological Sciences, Victoria University of Wellington, P O Box 600, Wellington, 6140, New Zealand., Harris BP; Fisheries, Aquatic Science and Technology Laboratory, Alaska Pacific University, 4101 University Dr., Anchorage, AK, 99508, USA., Huusko A; Natural Resources Institute Finland, Manamansalontie 90, 88300, Paltamo, Finland., Jones IL; Department of Biology, Memorial University, St. John's, NL, A1B 2R3, Canada., Kelaher BP; National Marine Science Centre and Marine Ecology Research Centre, Southern Cross University, 2 Bay Drive, Coffs Harbour, 2450, Australia., Kotiaho JS; Department of Biological and Environmental Science, University of Jyväskylä, Jyväskylä, Finland.; School of Resource Wisdom, University of Jyväskylä, Jyväskylä, Finland., López-Baucells A; Centre for Ecology, Evolution and Environmental Changes - cE3c, Faculty of Sciences, University of Lisbon, 1749-016, Lisbon, Portugal.; Biological Dynamics of Forest Fragments Project, National Institute for Amazonian Research and Smithsonian Tropical Research Institute, 69011-970, Manaus, Brazil.; Granollers Museum of Natural History, Granollers, Spain., Major HL; Department of Biological Sciences, University of New Brunswick, PO Box 5050, Saint John, NB, E2L 4L5, Canada., Mäki-Petäys A; Voimalohi Oy, Voimatie 23, Voimatie, 91100, Ii, Finland.; Natural Resources Institute Finland, Paavo Havaksen tie 3, 90014 University of Oulu, Oulu, Finland., Martín B; Fundación Migres CIMA Ctra, Cádiz, Spain.; Intergovernmental Oceanographic Commission of UNESCO, Marine Policy and Regional Coordination Section Paris 07, Paris, France., Martín CA; Universidad Complutense de Madrid, Departamento de Biodiversidad, Ecología y Evolución, Facultad de Ciencias Biológicas, c/ José Antonio Novais, 12, E-28040, Madrid, Spain., Martin PA; Conservation Science Group, Department of Zoology, University of Cambridge, The David Attenborough Building, Downing Street, Cambridge, CB3 3QZ, UK.; BioRISC, St. Catharine's College, Cambridge, CB2 1RL, UK., Mateos-Molina D; Departamento de Ecología e Hidrología, Universidad de Murcia, Campus de Espinardo, 30100, Murcia, Spain., McConnaughey RA; RACE Division, Alaska Fisheries Science Center, National Marine Fisheries Service, NOAA, 7600 Sand Point Way NE, Seattle, WA, 98115, USA., Meroni M; European Commission, Joint Research Centre (JRC), Ispra, VA, Italy., Meyer CFJ; Centre for Ecology, Evolution and Environmental Changes - cE3c, Faculty of Sciences, University of Lisbon, 1749-016, Lisbon, Portugal.; Biological Dynamics of Forest Fragments Project, National Institute for Amazonian Research and Smithsonian Tropical Research Institute, 69011-970, Manaus, Brazil.; School of Science, Engineering and Environment, University of Salford, Salford, M5 4WT, UK., Mills K; Victorian National Park Association, Carlton, VIC, Australia., Montefalcone M; Department of Earth, Environment and Life Sciences (DiSTAV), University of Genoa, Corso Europa 26, 16132, Genoa, Italy., Noreika N; Department of Ecology, Swedish University of Agricultural Sciences, Uppsala, Sweden.; Chair of Plant Health, Institute of Agricultural and Environmental Sciences, Estonian University of Life Sciences, Tartu, Estonia., Palacín C; Museo Nacional de Ciencias Naturales, CSIC, Madrid, Spain., Pande A; School of Biological Sciences, Victoria University of Wellington, P O Box 600, Wellington, 6140, New Zealand.; Biosecurity New Zealand - Tiakitanga Pūtaiao Aotearoa, Ministry for Primary Industries - Manatū Ahu Matua, 66 Ward St, PO Box 40742, Wallaceville, New Zealand.; National Institute of Water & Atmospheric Research Ltd (NIWA), 301 Evans Bay Parade, Greta Point Wellington, New Zealand., Pitcher CR; CSIRO Oceans & Atmosphere, Queensland Biosciences Precinct, 306 Carmody Road, ST. LUCIA QLD, 4067, Australia., Ponce C; Museo Nacional de Ciencias Naturales, CSIC, José Gutiérrez Abascal 2, E-28006, Madrid, Spain., Rinella M; Fort Keogh Livestock and Range Research Laboratory, 243 Fort Keogh Rd, Miles City, Montana, 59301, USA., Rocha R; Centre for Ecology, Evolution and Environmental Changes - cE3c, Faculty of Sciences, University of Lisbon, 1749-016, Lisbon, Portugal.; Biological Dynamics of Forest Fragments Project, National Institute for Amazonian Research and Smithsonian Tropical Research Institute, 69011-970, Manaus, Brazil.; CIBIO-InBIO, Research Centre in Biodiversity and Genetic Resources, University of Porto, Vairão, Portugal., Ruiz-Delgado MC; Departamento de Sistemas Físicos, Químicos y Naturales, Universidad Pablo de Olavide, ES-41013, Sevilla, Spain., Schmitter-Soto JJ; El Colegio de la Frontera Sur, A.P. 424, 77000, Chetumal, QR, Mexico., Shaffer JA; U.S. Geological Survey, Northern Prairie Wildlife Research Center, Jamestown, ND, 58401, USA., Sharma S; Division of Fish and Wildlife, New York State Department of Environmental Conservation, 625 Broadway, Albany, NY, 12233-4756, USA., Sher AA; University of Denver Department of Biological Sciences, Denver, CO, USA., Stagnol D; Sorbonne Université, CNRS, UMR 7144, Station Biologique, F.29680, Roscoff, France., Stanley TR; U.S. Geological Survey, Fort Collins Science Center, Fort Collins, CO, 80526, USA., Stokesbury KDE; School for Marine Science and Technology, University of Massachusetts Dartmouth, New Bedford, MA, USA., Torres A; Georges Lemaître Earth and Climate Research Centre, Earth and Life Institute, Université Catholique de Louvain, 1348, Louvain-la-Neuve, Belgium.; Center for Systems Integration and Sustainability, Department of Fisheries and Wildlife, 13 Michigan State University, East Lansing, MI, 48823, USA., Tully O; Marine Institute, Rinville, Oranmore, Galway, Ireland., Vehanen T; Natural Resources Institute Finland, Latokartanonkaari 9, 00790, Helsinki, Finland., Watts C; Manaaki Whenua - Landcare Research, Private Bag 3127, Hamilton, 3216, New Zealand., Zhao Q; Statistical Laboratory, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Wilberforce Road, Cambridge, CB3 0WB, UK., Sutherland WJ; Conservation Science Group, Department of Zoology, University of Cambridge, The David Attenborough Building, Downing Street, Cambridge, CB3 3QZ, UK.; BioRISC, St. Catharine's College, Cambridge, CB2 1RL, UK.
Jazyk: angličtina
Zdroj: Nature communications [Nat Commun] 2020 Dec 11; Vol. 11 (1), pp. 6377. Date of Electronic Publication: 2020 Dec 11.
DOI: 10.1038/s41467-020-20142-y
Abstrakt: Building trust in science and evidence-based decision-making depends heavily on the credibility of studies and their findings. Researchers employ many different study designs that vary in their risk of bias to evaluate the true effect of interventions or impacts. Here, we empirically quantify, on a large scale, the prevalence of different study designs and the magnitude of bias in their estimates. Randomised designs and controlled observational designs with pre-intervention sampling were used by just 23% of intervention studies in biodiversity conservation, and 36% of intervention studies in social science. We demonstrate, through pairwise within-study comparisons across 49 environmental datasets, that these types of designs usually give less biased estimates than simpler observational designs. We propose a model-based approach to combine study estimates that may suffer from different levels of study design bias, discuss the implications for evidence synthesis, and how to facilitate the use of more credible study designs.
Databáze: MEDLINE