How We Work


Last updated January 7th, 2018

AIASSA, E., HIGGINS, J. P. T., FRAMPTON, G. K., GREINER, M., AFONSO, A., AMZAL, B., DEEKS, J., DORNE, J. L., GLANVILLE, J., LÖVEI, G. L., NIENSTEDT, K., O’CONNOR, A. M., PULLIN, A. S., RAJIĆ, A. & VERLOO, D. 2015. Applicability and feasibility of systematic review for performing evidence-based risk assessment in food and feed safety. Critical Reviews in Food Science and Nutrition 55, 1026-1034.

ALTMAN, D.G. 1991. Measuring agreement. In: Altman D.G. (Ed.), Practical statistics for medical research. London: Chapman and Hall.

ARNQVIST, G. & WOOSTER, D. 1995. Meta-analysis: synthesizing research findings in ecology and evolution. Trends in Ecology & Evolution, 10, 236-240.

AVENELL, A., HANDOLL, H. & GRANT, A. 2001. Lessons for search strategies from a systematic review, in The Cochrane Library, of nutritional supplementation trials in patients after hip fracture. American Journal of Clinical Nutrition, 73, 505-510.

BAILEY, B. J. 2002. Duplicate publication in the field of otolaryngology-head and neck surgery. Otolaryngology Head and Neck Surgery, 126, 211-216.

BARDEN, J., EDWARDS, J. E., MCQUAY, H. J. & MOORE, R. A. 2003. Oral valdecoxib and injected parecoxib for acute postoperative pain: a quantitative systematic review. BMC Anesthesiology, 3, 1-1.

BERNARD, H.R., 2006. Research Methods in Anthropology: Qualitative and Quantitative Approaches. Altamira Press, Lanham, New York, Toronto, Oxford:  Rowman & Littlefield Publishers, Inc.

BAYLISS, H. R. & BEYER, F. R. 2015. Information retrieval for ecological syntheses. Research Synthesis Methods, 6, 136-148.

BAYLISS, H. R., HADDAWAY, N. R., EALES, J., FRAMPTON, G. K. & JAMES, K. L. 2016. Updating and amending systematic reviews and systematic maps in environmental management. Environmental Evidence, 5, 20.

BAYLISS, H. R., SCHINDLER, S., ADAM, M., ESSL, F. & RABITSCH, W. 2017. Environmental Evidence, 6:21

BERNES, C., CARPENTER, S. R., GÅRDMARK, A., LARSSON, P., PERSSON, L., SKOV, C., SPEED, J. D. M. & VAN DONK, E. 2015. What is the influence of a reduction of planktivorous and benthivorous fish on water quality in temperate eutrophic lakes? A systematic review. Environmental Evidence 4:7

BERO, L., ANGLEMYER, A., VESTERINEN, H. & KRAUTH, D. 2016. The relationship between study sponsorship, risks of bias, and research outcomes in atrazine exposure studies conducted in non-human animals: systematic review and meta-analysis. Environment International. 92-93, 597-604.

BOOTH, A. 2004. Formulating answerable questions. In: Booth, A. & Brice, A. (Eds.) Evidence-based practice: an information professional’s handbook. London: Facet.

BOOTH, A. 2010. How much searching is enough? Comprehensive versus optimal retrieval for technology assessments. International Journal of Technology Assessment in Health Care. 26(4), 431-435.

BORENSTEIN, M., HEDGES, L. V., HIGGINS, J. P. T. & ROTHSTEIN, H. R. 2009. Introduction to Meta-Analysis, John Wiley and Sons.

BOTTRILL, M., CHENG, S., GARSIDE, R., WONGBUSARAKUM, S., ROE, D., HOLLAND, M. B., EDMOND, J. & TURNER, W. R. 2014. What are the impacts of nature conservation interventions on human well-being: a systematic map protocol. Environmental Evidence 3, 16.

BOWLER, D., BUYUNG-ALI, L., KNIGHT, T., & PULLIN, A .S. 2009. The importance of nature for health: is there a specific benefit of contact with green space? Environmental Evidence:

BOWLER, D., BUYUNG-ALI L., KNIGHT, T. & PULLIN A. S. 2010. How effective is ‘greening’ of urban areas in reducing human exposure to ground level ozone concentrations, UV exposure and the ‘urban heat island effect’? Environmental Evidence:

BUSSELL, J., JONES, D. L., HEALEY, J. R. & PULLIN, A. S. 2010. How do draining and re-wetting affect carbon stores and greenhouse gas fluxes in peatland soils? CEE review 08-012 (SR49). Collaboration for Environmental Evidence:

BRAMER, W. M., GIUSTINI, D., KRAMER, B. M. R. & ANDERSON, P. F. 2013. The comparative recall of Google Scholar versus PubMed in identical searches for biomedical systematic review: a review of searches used in systematic reviews. Systematic Reviews 2, 115.

CAMPBELL COLLABORATION, STEERING GROUP OF THE CAMPBELL COLLABORATION 2014. Campbell Systematic Reviews: Policies and Guidelines. Campbell Policies and Guidelines Series No. 1. DOI:10.4073/cpg.2016.1

CENTRE FOR REVIEWS AND DISSEMINATION (CRD). 2009. Systematic Reviews. CRD’s Guidance for Undertaking Reviews in Health Care. York: CRD, University of York.

CHAN, A., HRÓBJARTSSON, A., HAAHR, M., GØTZSCHE, .P. & ALTMAN, D. 2004. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA;291,2457-65.

CHOI, W. S., SONG, S. W., OCK, S. M., KIM, C. M., LEE, J., CHANG, W. J. & KIM, S. H. 2014. Duplicate publication of articles used in meta-analysis in Korea. SpringerPlus, 3, 182.

COLLABORATION FOR ENVIRONMENTAL EVIDENCE (CEE). 2013. Guidelines for systematic review and evidence synthesis in environmental management. Version 4.2.

CORLETT, R. T. 2011. Trouble with the gray literature. Biotropica, 43, 3-5.

CÔTÉ, I. M., MOSQUEIRA, I. & REYNOLDS, J. D. 2001. Effects of marine reserve characteristics on the protection of fish populations: A meta-analysis. Journal of Fish Biology, 59, 178-189.

DAVIES, Z. G., TYLER, C., STEWART, G. B. & PULLIN, A. S. 2006. Are current management recommendations for conserving saproxylic invertebrates effective? CEE review 05-011 (SR17). Collaboration for Environmental Evidence:

DEEKS, J. J., HIGGINS, J. P. T. & ALTMAN, D. G. 2005. Analysing and presenting results. In: Higgins, J.P.T & Green, S. (Eds) Cochrane Handbook for Systematic Reviews of Interventions 4.2.5 [updated May 2005]; Section 8. (

DICKERSIN, K. 2005. Publication bias: recognizing the problem, understanding its origins and scope, and preventing harm. In: Rothstein, H. R., Sutton, A. J. & Borenstein, M. (Eds.) Publication bias in meta-analysis: prevention, assessment, and adjustments. London: Wiley.

DEPARTMENT FOR ENVIRONMENT FOOD AND RURAL AFFAIRS (DEFRA). 2015. Emerging tools and techniques to deliver timely and cost effective evidence reviews. Final Report WT1552. London, DEFRA.

DOERR, E. D., DORROUGH, J., DAVIES, M. J., DOERR, V. A. J. & MCINTYRE, S. 2015. Maximising the value of systematic reviews in ecology when data or resources are limited. Austral Ecology, 40, 1-11.

DOWNING, J. A., OSENBERG, C. W. & SARNELLE, O. 1999. Meta-analysis of marine nutrient-enrichment experiments: Variation in the magnitude of nutrient limitation. Ecology, 80, 1157-1167.

DUFFY, L., DUNLAP, K., GODDUHN, A. 2014. Bias, complexity, and uncertainty in ecosystem risk assessment: pharmaceuticals, a new challenge in scale and perspective. Environmental Research Letters. 9,091004,1-3.

DUFFIELD, S., AEBISCHER, N. 1994. The effect of spatial scale of treatment with dimethoate on invertebrate population recovery in winter wheat. Journal of Applied Ecology. 31,263-281.

EFSA (European Food and Safety Authority). 2010. Application of systematic review methodology to food and safety assessments to support decision making. EFSA Journal. 8(6), 1637.

EDWARDS, P., CLARKE, M., DIGUISEPPI, C., PRATAP, S., ROBERTS, I. & WENTZ, R. 2002. Identification of randomized controlled trials in systematic reviews: Accuracy and reliability of screening records. Statistics in Medicine, 21, 1635-1640.

EGGER, M., DAVEY-SMITH, G., SCHNEIDER, M., & MINDER, C. 1997. Bias in meta-analysis detected by a simple, graphical test. BMJ, 315, 629-634.

ENGLUND, G., SARNELLE, O. & COOPER, S. D. 1999. The importance of data-selection criteria: meta-analyses of stream predation experiments. Ecology, 80, 1132-1141.

FAZEY, I., SAILSBURY, J. G., LINDENMAYER, D. B., MAINDONALD, J. & DOUGLAS, R. 2004. Can methods applied in medicine be used to summarize and disseminate conservation research? Environmental Conservation, 31,190-198.

FELTON, A., KNIGHT, E., WOOD, J., ZAMMIT, C.& LINDENMAYER, D. B. 2010. A meta-analysis of fauna and flora species richness and abundance in plantations and pasture lands. CEE review 09-012 (SR73). Collaboration for Environmental Evidence:

FRAMPTON, G. K., LIVOREIL, B. & PETROKOFSKY, G. 2017. Eligibility screening in evidence synthesis of environmental management topics. Environmental Evidence, 6, 27.

GATES, S. 2002. Review of methodology of quantitative reviews using meta-analysis in ecology. Journal of Animal Ecology, 71, 547-557.

GERBER, A. S. & GREEN, D. P. 2012. Field Experiments: Design, Analysis, and Interpretation. W.W. Norton & Co.

GIBSON, G. & RUSSELL, I. 2006. Flying in Tune: Sexual Recognition in Mosquitoes. Current Biology 16 (13),1311-1316.

GIUSTINI, D. & BOULOS, M. N. K. 2013. Google Scholar is not enough to be used alone for systematic reviews. Online Journal of Public Health Informatics, 5, 1-9.

GLANVILLE, J. Searching bibliographic databases. [In press] In: Cooper, H. C., Hedges, L. V. & J. C. Valentine, C. (Eds). The Handbook of Research Synthesis and Meta-Analysis, 3rd edition. New York, NY: Russell Sage Foundation.

GLASS, G. 1976. Primary, secondary, and meta-analysis of research. Educational Researcher; 5, 3-8.

GØTZSCHE, P. C. 1989. Multiple publication of reports of drug trials. European Journal of Clinical Pharmacology 36, 429-432.

GØTZSCHE, P. C. & IOANNIDIS, J. P. A. 2012. Content area experts as authors: helpful or harmful for systematic reviews and meta-analyses? BMJ : British Medical Journal, 345, 4 pp.

GOUGH, D., OLIVER, S. & THOMAS, J. 2012. An introduction to systematic reviews, London, Sage Publications Ltd.

GRINDLAY, D. J. C., BRENNAN, M. L. & DEAN, R. S. 2012. Searching the veterinary literature: a comparison of the coverage of veterinary journals by nine bibliographic databases. Journal of Veterinary Medicine Education, 39, 404-412.

GUREVITCH, J. & HEDGES, L. V. 1999. Statistical issues in ecological meta-analyses. Ecology, 80, 1142–1149.

GUREVITCH J. & HEDGES L. V. 2001. Meta-analysis Combining the results of independent experiments. In: Scheiner, S. M. & J. Gurevitch, J. (Eds) Design and Analysis of Ecological Experiments. pp. 347-369. Oxford University Press, New York.

HADDAWAY, N. R. 2015. The use of web-scraping software in searching for grey literature. The Grey Journal, 11, 186-190.

HADDAWAY, N. R. & BAYLISS, H. R. 2015. Shades of grey: two forms of grey literature important for reviews in conservation. Biological Conservation, 191, 827-829.

HADDAWAY, N. R., COLLINS, A. M., COUGHLIN, D. & KIRK, S. 2015. The role of Google Scholar in evidence reviews and its applicability to grey literature searching. PLoS ONE, 10, e0138237.

HADDAWAY, N. R., COLLINS, A. M., COUGHLIN, D. & KIRK, S. 2017. A rapid method to increase transparency and efficiency in web-based searches. Environmental Evidence, 6, 1.

HADDAWAY, N.R., STYLES, D & PULLIN, A.S. 2014. Evidence on the environmental impacts of farm land abandonment in high altitude/mountain regions: a systematic map. Environmental Evidence 3, 17.

HIGGINS, J. P. T., ALTMAN, D., GØTZSCHE. P., JÜNI, P., MOHER, D., OXMAN, A., et al. 2011. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 343,d5928,1-9.

HIGGINS, J.P.T., DEEKS, J.J. 2011. Selecting studies and collecting data. In: Higgins, J. P. T. & Green, S, (Eds). Cochrane Handbook for Systematic Reviews of Interventions. Chichester: Wiley-Blackwell; pp. 151-86.

HIGGINS, J. P. T. & GREEN, S. 2011. Cochrane handbook for systematic reviews of interventions, Chichester, Wiley.

HILL, A. B. 1971. Principles of medical statistics.  Lancet 9: 312-20.

HOLMAN, L., HEAD, M., LANFEAR, R. & JENNIONS, M. 2015. Evidence of experimental bias in the life sciences: why we need blind data recording. PLoS Biology. 13(7),e1002190,1-12.

HOLST, R. & FUNK, C. J. 2005. State of the art of expert searching: results of a Medical Library association survey. Journal of the Medical Library Association, 93, 45-52.

HOPEWELL, S., MCDONALD, S., CLARKE, M. J. & EGGER, M. 2007. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database of Systematic Reviews, Issue 2.

IOANNIDIS, J. P. A. 2005. Why Most Published Research Findings Are False. PLoS Med 2(8): e124.

JAMES, K. L., RANDALL, N. P. & HADDAWAY, N. R. 2016. A methodology for systematic mapping in environmental sciences. Environmental Evidence, 5, 7.

JOHNSON, V., FITZPATRICK, I., FLOYD, R. & SIMMS, A. 2011. What is the evidence that scarcity and shocks in freshwater resources cause conflict instead of promoting collaboration? CEE review 10-010. Collaboration for Environmental Evidence:

KHAN, K. S., KUNZ, R., KLEIJNEN, J. & ANTES, G. 2003. Systematic reviews to support evidence-based medicine: how to apply findings of healthcare research. Royal Society of Medicine Press Ltd, London.

KHORSAN, R., CRAWFORD, C. 2014. External validity and model validity: a conceptual approach for systematic review methodology. Evidence-Based Complementary and Alternative Medicine. Volume 2014, Article ID 694804,1-12.

KIRKHAM, J., DWAN, K., ALTMAN, D., GAMBLE, C., DODD, S., SMYTH, R., et al. 2010. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ., 340, c365,1-10.

KORICHEVA, J, GUREVITCH, J & MENGERSEN, K. 2013.Handbook of meta-analysis in ecology and evolution. Princeton University Press.

KUGLEY, S., WADE, A., THOMAS, J., MAHOOD, Q., KLINT-JØRGENSEN, A. M., HAMMERSTRØM, K. & SATHE, N. 2016. Searching for studies: a guide to information retrieval for Campbell Systematic Reviews. Version 1.1. Campbell Methods Series. Method Guide 1. Oslo: The Campbell Collaboration.

LAND, M., GRANÉLI, W., GRIMWALL, A., HOFFMANN, C. C., MITSCH, W. J., TONDERSKI, K. S. & VERHOEVEN, J. T. A. 2013. How effective are created or restored freshwater wetlands for nitrogen and phosphorus removal? A systematic review protocol. Environmental Evidence, 2, 16.

LANGER, L., ERASMUS, Y., TANNOUS, N. & STEWART, R. 2017. How stakeholder engagement has led us to reconsider definitions of rigour in systematic reviews. Environmental Evidence, 6, 20.

LAU, J., IOANNIDIS, J. P. A., TERRIN, N, SCHMID, CH, & OLKIN, I. 2006. The case of the misleading funnel plot. BMJ 333: 597–600.

LEIMU, R. & KORICHEVA, J. 2004. Cumulative meta-analysis: a new tool for detection of temporal trends and publication bias in ecology. Proceedings of the Royal Society B: Biological Sciences, 271, 1961-1966.

LEIMU, R. & KORICHEVA, J. 2005. What determines the citation frequency of ecological papers? Trends in Ecology and Evolution, 20, 28-32.

LIBERATI, A., ALTMAN, D. G., TETZLAFF, J., MULROW, C., GØTZSCHE, P. C., IOANNIDIS, J. P. A., CLARKE, M., DEVEREAUX, P. J., KLEIJNEN, J. & MOHER, D. 2009. The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. PLoS Medicine, 6, e1000100.

LIPSEY M. W. & WILSON D. B. 2001. Practical Meta-analysis. Applied Social Research Methods Series. Volume 49. Sage Publications, Thousand Oaks, California.

LIVOREIL, B., GLANVILLE, J., HADDAWAY, N. R., BAYLISS, H., BETHEL, A., DE LACHAPELLE, F. F., ROBALINO, S., SAVILAAKSO, S., ZHOU, W., PETROKOFSKY, G. & FRAMPTON, G. 2017. Systematic searching for environmental evidence using multiple tools and sources. Environmental Evidence, 6, 23.

LORTIE, C. J., AARSSEN, L. W., BUDDEN, A. E., KORICHEVA, J. K., LEIMU, R. & TREGENZA, T. 2007. Publication bias and merit in ecology. Oikos, 116, 1247-1253.

MACKENZIE, R. S., MCMANUS, C., HARRISON, V., MASON, O. 2016. Reflections on the process of using systematic review techniques to evaluate the literature regarding the neurotoxicity of low level exposure to organophosphate pesticides. Environment International. 92-93:569-573.

MCDONAGH, M., PETERSON, K., RAINA, P., CHANG, S. & SHEKELLE, P. 2013. Avoiding Bias in Selecting Studies. Methods Guide for Effectiveness and Comparative Effectiveness Reviews. Rockville (MD), AHRQ Publication No. 13-EH045-EF. Agency for Healthcare Research and Quality (US)

MANT, R., JONES, D., REYNOLDS, B., ORMEROD, S. & PULLIN A. S. 2011. What is the impact of liming of streams and rivers on the abundance and diversity of fish and invertebrates? CEE review 09-015 (SR76). Collaboration for Environmental Evidence:

MAHOOD, Q., EERD, D. & IRVIN, E. 2014. Searching for grey literature for systematic reviews: challenges and benefits. Research Synthesis Methods, 3, 221-234.

MCKINNON, M. C., CHENG, S. H., DUPRE, S., EDMOND, J., GARSIDE, R., GLEW, L., HOLLAND, M. B., LEVINE, E., MASUDA, Y. J., MILLER, D. C., OLIVEIRA, I., REVENAZ, J., ROE, D., SHAMER, S., WILKIE, D., WONGBUSARAKUM, S. & WOODHOUSE, E. 2016. What are the effects of nature conservation on human well-being? A systematic map of empirical evidence from developing countries. Environmental Evidence, 5, 8.

MOHER, D., JADAD, A. R., NICHOL, G., PENMAN, M., TUGWELL, P. & WALSH, S. 1995. Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. Control Clinical Trials, 16, 62-73.

MULLINS, M. M., DELUCA, J. B., CREPAZ, N. & LYLES, C. M. 2014. Reporting quality of search methods in systematic reviews of HIV behavioural interventions (2000–2010); are the searches clearly explained, systematic and reproducible? Research Synthesis Methods, 5, 116-130.

NHS CENTRE FOR REVIEWS AND DISSEMINATION. 2001. Undertaking systematic review of research on effectiveness. NHS CRD, University of York.

NOYES, J., POPAY, J., PEARSON, A., HANNES, K. & BOOTH, A. 2011. Chapter 20: Qualitative research and Cochrane reviews. In: Higgins, J. P. T. & Green, S. (Eds), Cochrane Handbook for Systematic Reviews of Interventions Version 5.1. The Cochrane Collaboration.

OJANEN, M., MILLER, D., ZHOU, W., MSHALE, B., MWANGI, E. & PETROKOFSKY, G. 2014. What are the environmental impacts of property rights regimes in forests, fisheries and rangelands? A systematic review protocol. Environmental Evidence, 3, 19.

OJANEN, M., ZHOU, W., MILLER, D. C., NIETO, S. H., MSHALE, B. & PETROKOFSKY, G. 2017. What are the environmental impacts of property rights regimes in forests, fisheries and rangelands? Environmental Evidence, 6, 12.

O’LEARY, B. C., KVIST, K., BAYLISS, H. R., DERROIRE, G., HEALEY, J. R., HUGHES, K, KLEINSCHROTH, F., SCIBERRAS, M., WOODCOCK, P. & PULLIN, A. S. 2016. The reliability of evidence review methodology in environmental science and conservation. Environmental Science and Policy 64, 75-82.

ORTEGA, J. L. 2014. Academic search engines: a quantitative outlook. Online Information Review, 39, 435-436.

OSENBERG, C. W., SARNELLE, O., COOPER, S. D. & HOLT, R. D. 1999. Resolving ecological questions through meta-analysis: Goals, metrics, and models. Ecology, 80, 1105-1117.

PAGE, M., HIGGINS, J. 2016. Rethinking the assessment of risk of bias due to selective reporting: a cross-sectional study. Systematic Reviews. 5,108,1-8.

PEAT, J. 2001. Health sciences research: A handbook of quantitative methods. London: SAGE Publishers Ltd., 328 pp.

PETERSEN, K. & ALI, N. B. 2011. Identifying Strategies for Study Selection in Systematic Reviews and Maps. International Symposium on Empirical Software Engineering and Measurement. Banff, AB, Canada

PETTICREW, M. & ROBERTS, H. 2006. Systematic reviews in the social sciences. A practical guide, Oxford, Blackwell.

POPAY, J. 2006. Moving Beyond Effectiveness. Methodological issues in the synthesis of diverse sources of evidence. National Institute for Health and Clinical Evidence, UK.

PRIESNITZ, K. U., VAASEN, A. & GATHMANN, A. 2016. Baseline susceptibility of different European lepidopteran and coleopteran pests to Bt proteins expressed in Bt Maize: a systematic review. Environmental Evidence, 5, 27.

PULLIN, A. S., BANGPAN, M., DALRYMPLE, S. E., DICKSON, K., HADDAWAY, N. R., HEALEY, J. R., HAUARI, H., HOCKLEY, N., JONES, J. P. G., KNIGHT, T. M., VIGURS, C. & OLIVER, S. 2013. Human Well-Being Impacts of Terrestrial Protected Areas. Environmental Evidence 2:19.

PULLIN, A. S. & KNIGHT, T. M. 2003. Support for decision making in conservation practice: an evidence-based approach. Journal for Nature Conservation, 11, 83-90.

PULLIN, A. S., KNIGHT, T. M. & WATKINSON, A. R. 2009. Linking reductionist science and holistic policy using systematic reviews: unpacking environmental policy questions to construct an evidence-based framework. Journal of Applied Ecology, 46, 970-975.

RADER, T., MANN, M., STANSFIELD, C., COOPER, C. & SAMPSON, M. 2014. Methods for documenting systematic review searches: a discussion of common issues. Research Synthesis Methods, 5, 98-115.

RANDALL, N. P. & JAMES, K. L. 2012. The effectiveness of integrated farm management, organic farming and agri-environment schemes for conserving biodiversity in temperate Europe – A systematic map. Environmental Evidence, 1.

RATHBONE, J., HOFFMANN, T. & GLASZIOU, P. 2015. Faster title and abstract screening? Evaluating Abstrackr, a semi-automated online screening program for systematic reviewers. Systematic Reviews, 4, 80.

ROBERTS, P. D., STEWART, G. B. & PULLIN, A. S. 2006. Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine. Biological Conservation, 132, 409-423.

RODRÍGUEZ, L., HOGARTH, N. J., ZHOU, W., XIE, C., ZHANG, K. & PUTZEL, L. 2016. China’s conversion of cropland to forest program: a systematic review of the environmental and socioeconomic effects. Environmental Evidence, 5, 21.

ROONEY, A. A., BOYLES, A. L., WOLFE, M. S., BUCHER, J. R. & THAYER, K. A. 2014. Systematic review and evidence integration for literature-based environmental health science assessments. Environmental Health Perspectives, 122, 711-8.

ROSENTHAL, R., FODE, K. 1963. The effect of experimenter bias on the performance of the albino-rat. Behavioural Science. 8,183-9.

ROTHSTEIN, H. R., SUTTON, A. J. & BORENSTEIN, M. 2005. Chapter 1. Publication bias in meta-analysis. In: Rothstein, H. R., Sutton, A. J. & Borenstein, M. (Eds.) Publication bias in meta-analysis—prevention, assessment and adjustments. Chichester, UK : John Wiley & Sons, Ltd.

SAGOO, G. S., LITTLE, J. & HIGGINS, J. P. T. 2009. Systematic Reviews of Genetic Association Studies. PLoS Medicine, 6, e1000028.

SALEH, A. A., RATAJESKI, M. A. & BERTOLET, M. 2014. Grey literature searching for health sciences systematic reviews: a prospective study of time spent and resources utilised. Evidence Based Library and Information Practice, 9, 28-50.

SARGEANT, J. M. & O’CONNOR, A. M. 2014. Conducting systematic reviews of intervention questions ii: relevance screening, data extraction, assessing risk of bias, presenting the results and interpreting the findings. Zoonoses and Public Health, 61, 39-51.

SAYERS, A. 2007. Tips and tricks in performing a systematic review. British Journal of General Practice, 57, 759.

SCARGLE, J. D. 2000. Publication Bias: The “File-Drawer” Problem in Scientific Inference. Journal of Scientific Exploration 14: 91–106.

SCHAFER, J. L. 1997. Analysis of incomplete multivariate data. Chapman & Hall/CRC Monographs on Statistics & Applied. CRC Press.

SCHINDLER, S., LIVOREIL, B., PINTO, I. S., ARAUJO, R. M., ZULKA, K. P., PULLIN, A. S., SANTAMARIA, L., KROPIK, M., FERNANDEZ-MENDEZ, P. & WRBKA, T. 2016. The network BiodiversityKnowledge in practice: insights from three trial assessments. Biodiversity Conservation, 25, 1301-1318.

SCHULZ, K., CHALMERS, I., HAYES, R. & ALTMAN, D. 1995. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA, 273, 408-12.

SHARP, S. 1998. Meta-analysis regression: statistics, biostatistics, and epidemiology. Stata Technical Bulletin 42: 16-22.

SMART, J. M. & BURLING, D. 2001. Radiology and the Internet: a systematic review of patient information resources. Clinical Radiology, 56, 867-870.

SMITH, R. K., PULLIN, A. S., STEWART, G. B. & SUTHERLAND, W. J. 2010. Is predator control and effective strategy for enhancing bird populations? CEE review 08-001 (SR38). Collaboration for Environmental Evidence:

SOCIAL SCIENCE RESEARCH UNIT. 2016. Eppi Reviewer 4. London: Social Science Research Unit, Institute of Education, University of London.

SÖDERSTRÖM, B., HEDLUND, K., JACKSON, L. E., KÄTTERER, T., LUGATO, E., THOMSEN, I. K. & JØRGENSEN, H. B. 2014. What are the effects of agricultural management on soil organic carbon (SOC) stocks? Environmental Evidence,3, 2.

SONG, F., PAREKH, S., HOOPER, L., LOKE, Y. K., RYDER, J., SUTTON, A. J., HING, C., KWOK, C. S., PANG, C. & HARVEY, I. 2010. Dissemination and publication of research findings: an updated review of related biases. Health Technology Assessment, 14.

STEVENS, A., & MILNE, R. 1997. “The effectiveness revolution and public health”. In:  Scally, G. (Ed) Progress in Public Health, pp. 197-225. Royal Society of Medicine Press, London.

STEWART, G., COLES, C., & PULLIN, A. 2015. Applying evidence-based practice in conservation management: Lessons from the first systematic review and dissemination projects. Biological Conservation.126, 270-8.

STEWART, R. & LIABO, K. 2012. Involvement in research without compromising research quality. Journal of Health Services Research and Policy 17, 248-251.

THOMPSON, S. G. 1994. Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated. BMJ, 309, 1351.

TRAMÈR, M. R., REYNOLDS, D. J. M., MOORE, R. A. & MCQUAY, H. J. 1997. Impact of covert duplicate publication on meta-analysis: A case study. British Medical Journal, 315, 635-640.

VON ELM, E., POGLIA, G., WALDER, B. & TRAMÈR, M. R. 2004. Different patterns of duplicate publication: An analysis of articles used in systematic reviews. JAMA, 291, 974-980.

VON ELM E., TRAMÈR, M. R, JÜNI, P. & EGGER, M. Does duplicate publication of trials introduce bias in systematic reviews? A systematic review [abstract]. In: 11th Cochrane Colloquium: 2003 Oct 26-31; Barcelona, Spain.

WOOD, L., EGGER, M., GLUUD, L., SCHULZ, K., JÜNI, P., ALTMAN, D., et al. 2008. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ., 336, 601-605.

WORTMAN, P. 1994. Judging research quality. In: Cooper H. & Hedges L. (Eds), The Handbook of Research Synthesis. New York: Russell Sage Foundation. pp. 97-109

ZHANG, L., SAMPSON, M. & MCGOWAN, J. 2006. Reporting the role of expert searcher in Cochrane Reviews. Evidence Based Library and Information Practice, 1, 3-16.

Follow Us On Twitter Connect On Linkedin Make A Donation