Background

Anthropogenic degradation of marine ecosystems is widely accepted as a major social-ecological problem. The growing urgency to manage marine ecosystems more effectively has led to increasing application of spatial management measures (marine protected areas [MPAs], sectoral [e.g. fishery] closures and marine spatial planning [marine plans]). Understanding the methodologies used to evaluate the effectiveness of these measures against social, economic, and ecological outcomes is key for designing effective monitoring and evaluation programmes.

Methods

We used a pre-defined and tested search string focusing on intervention and outcome terms to search for relevant studies across four bibliographic databases, Google Scholar, 39 organisational websites, and one specialist data repository. Searches were conducted in English and restricted to the period 2009 to 2019 to align with current UK marine policy contexts. Relevant studies were restricted to UK-relevant coastal countries, as identified by key stakeholders. Search results were screened for relevance against pre-defined eligibility criteria first at title and abstract level, and then at full text. Articles assessed as not relevant at full text were recorded with reasons for exclusion. Two systematic map databases of meta-data and coded data from relevant primary and secondary studies, respectively, were produced.

Review findings

Over 19,500 search results were identified, resulting in 391 relevant primary articles, 33 secondary articles and 49 tertiary reviews. Relevant primary articles evaluated spatial management measures across a total of 22 social, economic and ecological outcomes; only 2.8% considered all three disciplines, with most focused exclusively on ecological (67.8%) or social (13.3%) evaluations. Secondary articles predominately focused on ecological evaluations (75.8%). The majority of the primary and secondary evidence base aimed to evaluate the effectiveness of MPAs (85.7% and 90.9% respectively), followed by fisheries closures (12.5%; 3.0%) with only 1.8% of primary, and 6.1% of secondary, articles focused on marine plans or on MPAs and fisheries closures combined. Most evaluations reported within primary articles were conducted for a single site (60.4%) or multiple individual sites (32.5%), with few evaluating networks of sites (6.9%). Secondary articles mostly evaluated multiple individual sites (93.9%). Most (70.3%) primary articles conducted principal evaluations, i.e. basic description of effects; 29.4% explored causation; and 0.3% undertook benefit evaluations. Secondary articles predominately explored causation (66.7%) with the remainder conducting principal evaluations. Australia (27.4%), the USA (18.4%) and the UK (11.3%) were most frequently studied by primary articles, with secondary articles reporting mostly global (66.7%) or European (18.2%) syntheses.

Conclusions

The systematic map reveals substantial bodies of evidence relating to methods of evaluating MPAs against ecological outcomes. However, key knowledge gaps include evaluation across social and economic outcomes and of overall merit and/or worth (benefit evaluation), as well as of: marine plans; networks of sites; real-time, temporary or seasonal closures; spatial management within offshore waters, and lagoon or estuary environments. Although the evidence base has grown over the past two decades, information to develop comprehensive evaluation frameworks remains insufficient. Greater understanding on how to evaluate the effectiveness of spatial management measures is required to support improved management of global ocean resources and spaces.