8 Making Decisions for Policy and Practice
© 2022 Chapter Authors, CC BY-NC 4.0 https://doi.org/10.11647/OBP.0321.08
Having collaborated with the community to decide upon the objectives, identified the major threats to be addressed, considered the possible options and assessed the evidence, the next stage is to decide what to do. Many decisions can be decided easily, as either obvious or trivial, thus requiring no additional assessment of different stages of the process. The harder decisions then require assessing the likely consequences of options and determining the preferred trade off. There is a range of approaches for making each of these stages more rigorous, reducing the likelihood of making inefficient decisions. These approaches are described with an account of the situations under which is most appropriate to address the conservation problem.
1 Monash University, School of Biological Sciences, Monash University, Clayton, VIC 3800, Australia
2 Centre for Environmental Policy, Imperial College, Princes Gardens, South Kensington, London, UK
3 School of BioSciences, University of Melbourne, Parkville 3052, Melbourne, Australia
4 Conservation Science Group, Department of Zoology, University of Cambridge, The David Attenborough Building, Pembroke Street, Cambridge, UK
8.1 What is a Structured Approach to Decision-Making?
The previous chapters have described the processes involved in preparing to make a decision: understanding the context for the decision (Chapters 6 and 7), clearly identifying the targets (Chapter 7), and compiling all the information required to make an informed choice (Chapters 2, 3, 4 and 5). Almost any conservation decision will need to use elements from these chapters.
This chapter describes the various stages in the decision process (Figure 8.1; Box 8.1) and provides tools to support the decision maker to integrate relevant information when considering potential alternatives, assessing trade-offs and deciding how to act. The same process can be adopted whether an individual is thinking through a decision alone or as part of a group. Using a structured process to consider the essential elements of the decision offers decision makers the opportunity to document the process involved in reaching their decision, which has three important advantages. First, decision makers can communicate the rationale behind the choice to stakeholders who can then decide whether any concerns they raised were considered (Moon et al., 2019). Second, it can ensure the decision-making process is transparent and repeatable, thus helping to identify where knowledge about the system needs to be improved (Hemming et al., 2022). Third, it provides an opportunity to scrutinise the process and potentially improve future decisions (Gregory et al., 2012; Schwartz et al., 2018). Capturing the rationale and evidence supporting a decision can be a form of knowledge transfer, making sure that future decision makers understand why past decisions were made (Christie et al., 2022). Implementing the decision then offers an opportunity to learn, update our understanding of the system, and work through the process again to refine our management (Gregory et al., 2012).
8.1.1 The process of decision making
We make decisions all the time, consciously or not. Some are simple matters that do not require much thought; deciding not to do anything is also a decision. Others are complex and multi-faceted with potentially irreversible consequences for which a structured process and careful consideration could guard against disaster. Regardless of how simple or complex the decision is, most are improved by, at least briefly, considering the different elements of the problem using the information currently available (Figure 8.1).
Box 8.1 outlines the general decision-making process with an example.
8.1.2 Summary of tools to help structure decisions
In this chapter we discuss tools that can support decision makers to work through the decision-making process. These can be used selectively, depending on the type of decision, the needs of the decision maker, and the time and resources available. The tools and the processes they promote can help decision makers be transparent about, and communicate the rationale behind, their decisions (Hemming et al., 2022). This helps engage stakeholders and promotes learning and improvement. Table 8.1 summarises the various tools, and provides examples of how each can be used and when it might be appropriate.
These tools can be carried out with different levels of complexity. They can be adapted for a decision (such as which vehicle to hire next season) in a process that takes a few minutes involving a few colleagues. On the other extreme, for a difficult and contentious issue, a series of workshops may bring together a broad community, allowing the creation of models to support decision making.
8.2 Filter Easy Decisions: Deciding Whether to Invest in Decision Making
It is a common misconception that a structured approach to decision making is a time consuming and complicated process reserved for the most challenging decisions. This does not need to be the case. Figure 8.2 illustrates appropriate levels of analysis for an imaginary 10,000 decisions. The main point is that most decisions can be dealt with almost instantaneously because the best course of action is self-evident, or the alternative actions have such small consequences that make little difference. Many others can be dealt with by simple processes. Detailed consideration necessary for only a small proportion of complex decisions in which there are competing objectives, and the actions may result in substantial differences.
8.2.1 Self-evident (high certainty) decisions
Many decisions are self-evident, drawing on existing, well-established knowledge. For example, a self-evident decision may include seeing a tourist on a boat pumping out their latrine into a lake and immediately asking them to stop, or discovering a harmful, invasive plant in a campsite, pulling it up and then reporting it.
Many decisions are implicit, simple continuations of the status quo. Decisions embedded in a set of procedures for the management of a protected area may include that a visitor centre opens at 9 am, a guided walk is available at 2 pm, and dogs are not allowed. Analysing every routine decision on every occasion would mean nothing else was ever done. However, it is worth occasionally reviewing the rationale and effectiveness of routine decisions, to avoid complacency (Hockings, 2003; Pullin and Knight, 2009). The process of kaizen (Section 7.4.2) may result in considerable benefits from sometimes looking at ways of improving routine practice (Sutherland, 2019).
8.2.2 Low-stakes decisions
Low-stakes decisions are those in which the outcomes matter so little that they do not justify further thought. This can be because the overall action is trivial (i.e. someone wants to sample the water from a critical bird breeding site, but after the breeding season so any disturbance will be minimal) or because the impact does not substantially extend to the project scope (i.e. a national hydrological project will affect an adjacent watershed but is expected to have minimal local impact, so local actions do not need to change).
8.2.3 High-stakes, low certainty decisions
Issues may be high-stakes for ecological, social, reputational or financial reasons (McShane et al., 2011). Some conservation decisions are high-stakes with irreversible consequences (Lindenmayer et al., 2013). An extreme example of this is species extinction. An estimated 617 vertebrate species alone have gone extinct since 1500 CE (Ceballos et al., 2015), many because of decisions that were made by humans (e.g. a bounty placed on the skins of the Tasmanian tiger, Thylacinus cynocephalus; Guiler and Godard, 1998), decisions that were not made (e.g. failure to ban hunting of Steller’s sea cow, Hydrodamalis gigas; Domning, 1978) or that were delayed (e.g. monitoring the decline but not implementing management action to protect the Christmas Island pipistrelle bat, Pipistrellus murrayi; Martin et al. 2012).
There are also considerable risks to decision makers associated with some conservation decisions. The US Fish and Wildlife Service has been sued hundreds of times by stakeholders seeking to challenge their decisions about whether or not to list species under the US Endangered Species Act 1973 (Schwartz, 2008). In these cases, decision makers must be able to defend their rationale in court for why a species does or does not meet the required standard.
Importantly, decision makers must be cognisant that decisions can have direct implications for stakeholders (Bennett et al., 2019). Changes to policies regarding the exploitation of natural resources can lead to the loss of livelihoods, for example where marine protected areas displace local fishers or protecting native forests displace forestry activities. Even when the consequences for local communities are not financial, conflicting values can lead to contentious decisions with significant political and social implications for decision makers and the broader community. In these cases, stakeholders may have very different objectives and values, and their differing perspectives may mean that the facts of the problem are contested (Redpath et al., 2013).
8.3 Preparing to Make the Decision
Many day-to-day decisions in conservation may be considered simple or low stakes, but as noted above, most decisions are improved by briefly considering the different elements of the problem using the information currently available. Quickly working through the structure of the decision can be a cost-effective way of assessing what is already known about the context of the decision (Gregory et al., 2012; Garrard et al., 2017). This may reveal that we already know enough to make the decision or identify issues that need to be investigated further or clarified.
8.3.1 Decision sketching
Decision sketching, also known as rapid prototyping, can be used to outline the components of the decision, providing a simple way for the decision maker to structure their knowledge about the problem and possible solutions (Garrard et al., 2017). It entails asking a series of questions relating to the who, what, why, how and when of the decision (Figure 8.1, Table 8.2; Schwartz et al., 2018; Hemming et al., 2022). It is often sufficient to enable the decision to be made.
Type |
Question |
Chapter |
Who |
Who has a stake in the decision? |
6 |
Who should be involved in making the decision? |
6 |
|
Who will be impacted by the decision? |
6 |
|
What |
What is the problem the decision maker is trying to solve? E.g. seabird nests being predated by invasive rodents; or uncontrolled wildfires impacting wildlife, tourism, and water supply. |
7 |
What is known about the cause of the problem? E.g. non-native rats targeting seabird eggs or illegal burning of heathland. |
7 |
|
What options are available to address the problem? E.g. baited traps; or reduce area of reserve scheduled for burning |
7 |
|
7 |
||
What resources are available to address the problem? |
7 |
|
What are the potential consequences associated with the different choices that could be made? |
7 |
|
What prompted the decisions? |
7 |
|
Why |
Why is this an important problem for the decision maker? |
7 |
Why is this an important problem for stakeholders? |
6 |
|
How |
How confident are they that those options will partially or fully address the problem? |
4 |
4 |
||
When |
When does the decision need to be made? |
7 |
By brainstorming the answers to these questions, decision makers can quickly identify whether they know enough to act confidently. Another advantage of decision sketching is that setting out the important elements of the decision may quickly eliminate potential choices because they are not practical given the resource constraints, or because none of the stakeholders prefer them. Likewise, considering the timeframe or urgency with which the decision needs to be made can prompt decision makers not to wait until they have perfect information (Lindenmayer et al., 2013). Where sketching the decision reveals knowledge gaps that impede a decision, the decision maker must ask how important it is to resolve that uncertainty before they act. In some cases, it may be worth investing time in reducing uncertainty before making a decision (Section 10.6); in other cases ‘learning by doing’ may be more appropriate (i.e. adaptive management). Because it is a rapid process, sketching the decision can be an iterative process, where issues are identified, knowledge is refined and the decision sketched again with any new information (Garrard et al., 2017).
Failing to consider a wide range of alternatives can risk decision makers defaulting to business as usual, even when that action has not been successful in the past (Gregory et al., 2012). It is likewise important that decision makers consider the consequences of delaying a decision or choosing not to act (Martin et al., 2017). Ideally, they have a strong evidence base from which to identify the range of different options and their likely consequences (Chapter 4). There are many tools that can help decision makers to organise their understanding of the system to identify leverage points that suggest potential actions (e.g. conceptual and mental models; Moon et al. 2019).
8.3.2 Benefit-cost/cost-effectiveness analyses
There are several decision-making tools to help calculate and compare cost-effectiveness of different actions, also known as return on investment (Section 2.4.4). These include economic analysis tools, such as cost-effectiveness analysis and benefit-cost analysis, which require detailed assessments of the costs and effects of actions (Cook et al., 2017). Cost-effectiveness analysis is particularly common when spending public funds but often is useful to identify how to deliver conservation effectively. It is appropriate when outcomes can be distilled into a single measure of utility, or there is a single, relevant criterion. Maximising the conservation outcomes under a given budget requires information on costs to be combined with information on the effectiveness of different actions, and for actions to be prioritised based on the evidence of their cost-effectiveness (Joseph et al., 2009). A conservation project may make claims that proposed actions are cost-effective, which can be supported or refuted by evidence.
There are many possible ways to combine information on effects and costs. For example, cost-effectiveness can be expressed as dollars per unit of conservation outcome. Cost-benefit analysis takes that process one step further, attempting to compare costs with the dollar value of the outcomes or benefits (Burgman, 2005). In this case, outcomes would be compared as the amount of conservation outcome per dollar, or in purely financial terms as the financial gain per dollar spent.
Economic analyses are widely used in healthcare, and whilst less frequently used in conservation, their use is increasing (Pienkowski et al., 2021). Other tools such as the Evidence to Decision tool (Section 9.10.3) encourages consideration of costs alongside other information in decision making (Christie et al., 2022). It is important to consider the direct (e.g. materials) and indirect costs (e.g. staff time) (Section 2.4.4; Iacona et al., 2018).
8.3.3 Clarifying objectives
If the objective is uncertain, or if individuals differ in what they see as the priorities, then there can be disagreement on the way forward. Resolving the purpose may reduce disagreement. Box 8.2 shows how conflicting ideas may be resolved by identifying core objectives.
8.3.4 Sketching means-ends networks
Means-ends networks can be used to separate fundamental objectives (the ‘ends’, the outcomes we want to achieve) from the means objectives (what we do to influence or generate those outcomes) (Gregory et al., 2012). A useful way to start is to collate statements of what is to be achieved, or avoided, in a particular decision context. Examining each statement, fundamental objectives are revealed by asking “why is that important?”, and means objectives are revealed by asking “how can that be achieved?” Fundamental objectives help define the reasons for a decision and are the focus of future deliberation and analysis. Means objectives can be used to help generate management options. Means-ends diagrams can be constructed by the decision maker alone, or as part of a participatory process with stakeholders (Section 8.3.2). They can be quickly and easily sketched with the available information and can be a useful communication tool to explain the fundamental objective and point to actions that could lead to that objective being achieved (Moon et al., 2019; Burgman et al., 2021).
8.4 Making Decisions
In reality, most conservation decisions have more than one objective, even if that is to keep within existing budgets and satisfy stakeholders (Possingham et al., 2001). Sometimes these issues are easy to navigate — the action is affordable and stakeholders agree. In other cases, financial, social and political considerations may be at odds (Williams and Kendall, 2017). In these cases, unstructured brainstorming may not reveal acceptable trade-offs among objectives for different alternatives. It can be helpful to use simple tools to lay out the decision based on how the different actions might perform relative to the different considerations (Gregory et al., 2012). This can identify where alternatives perform poorly across all objectives (lose-lose consequences), are costly, ineffective and unpopular. It can hopefully find a win-win solution. At the very least, it will reveal trade-offs that allow decision makers to make explicit choices. For example, the cheapest, most effective management action to deal with invasive plants may be to treat with herbicides but this may be unacceptable to some stakeholders who are concerned about poisons in the environment. The decision maker must then decide whether to take an unpopular action to remove plants manually. Being clear about the consequences allows a trade-off to be identified and whatever the decision is, it can then be communicated (Converse, 2020).
8.4.1 All decisions have consequences
It is important to consider the full range of possible decisions. While all decisions require choices, they do not always need to result in action; choosing not to do something can be equally, and sometimes more consequential than choosing to do something (e.g. Martin et al. 2012). This is an important distinction and why considering different alternatives is a crucial part of the decision-making process (Gregory and Keeney, 2002). Chapter 7 describes how a decision maker can derive alternatives and Chapters 2, 3 and 4 describe how to interpret the evidence. Sometimes there is good information about the alternative actions available, and the probability they will be effective under different circumstances. More often, there is considerable uncertainty about the consequences of different alternatives and the conditions under which one alternative may perform better than another (Burgman, 2005; Regan et al., 2005). Weighing up the pros and cons of each action can ensure transparency and create opportunities to learn and inform future decisions (Gregory et al., 2012). Where there is a clear understanding of the consequences of doing nothing, and the only alternative has a good chance of a better outcome, then the decision may be simple. Failing to consider the range of alternatives can mean failing to identify an innovative new approach (Christie et al., 2022). Likewise failing to consider the decision context may lead to conflict over the most appropriate management alternative (e.g. the best approach to reducing the impact of feral cats in communities with pet cats). So, while some decisions are no-brainers, in many cases at least briefly considering the essential elements of the decision and justification for the choice made, can ensure decisions are transparent and create opportunities to learn and inform future decisions.
8.5 Multi-Criteria Analysis
Most decisions comprise making a choice based on a range of different criteria such as the cost, likelihood of success, or acceptability to neighbours.
8.5.1 Consequences tables
When the aims have been established, the options that might help address the problem have been shortlisted, and the evidence accessed, the next stage is to present the details of these alternative actions to stakeholders so they can be compared. Presenting this as a consequence table offers a straightforward method to compare the different options and their consequences even if only rough estimates (Gregory et al., 2012). Different actions are likely to have different consequences for the things we care about (the fundamental objectives). The nature of conservation decisions means there is almost always at least one ecological, economic and social aim (Possingham et al., 2001).
The basic structure of a consequence table is a list of objectives, each with an associated performance measure, and a list of alternative actions (Table 8.1; see Keeney and Gregory, 2005). Alternatives should always include doing nothing or continuing doing what is already being done (status quo), as a point of comparison (i.e. are the proposed alternatives better than what is being done?). Each objective needs a specific and practical performance measure to enable comparisons between different actions (Gregory et al., 2012). If possible, performance measures should be appropriate metrics for the subject of interest rather than being proxies or indirect measures (Hemming et al., 2021). Ideally, the consequence table will include evidence-based, quantitative estimates such as the financial cost of implementing the different alternatives or the expected increase in the population of a threatened species (Failing and Gregory, 2003). Social values may be expressed best by constructed scales, such as Likert scales. Where it is not possible to estimate values precisely, it is still valuable to estimate the degree to which the performance measure is likely to increase or decrease under the proposed action, to assess the relative performance of alternatives. A range of different modelling tools (Section 9.11) can generate estimates of how performance measures might respond to different actions. Each cell of the consequence table should be accompanied by a measure of the precision of the estimate, such as a confidence interval, or a subjective credible interval (Hemming et al., 2018).
In addition to helping structure the decision, consequence tables are useful to reveal when alternatives are not genuinely different from one another. It can also become clear if an alternative performs poorly across all objectives or at least performs poorly relative to the other alternatives and so it is not worth further consideration (e.g. Walshe and Hemming, 2019). Considering the consequences of different alternatives across all of the objectives can also reveal where there are unavoidable trade-offs and we will have to choose which objectives to prioritise (Converse, 2020; Moon et al., 2019).
It can be difficult to define and classify fundamental objectives unambiguously. This is best done by creating a values hierarchy (Figure 8.3) that classifies the means, objectives and measures. The specification of measures helps to clarify what is meant by them. When making tradeoffs, it is important that nothing has been omitted, leading to hidden agendas in negotiations (for example, omitting political considerations may distort discussions about other objectives). It is also important to ensure nothing is double counted (for example, the fundamental objective of conserving threatened species should be kept separate from the objective of maintaining ecosystem services). Objectives hierarchies provide a means for ordering thinking about fundamental objectives, serving to distinguish means from ends, ensuring that all relevant values at stake are considered, and that nothing is double counted.
Consequence tables are not just a valuable tool to compare alternatives and assess trade-offs among objectives, they contain the essential elements of a decision. Constructing the consequence table can be a valuable process in itself. These need to be based on evidence for outcomes (Chapter 4).
An example of a consequences table is provided in Table 8.3. How is it then possible to make a decision?
Performance measure |
A Do nothing |
B Original DWA proposal |
C Full scheme |
D District suggestion |
E Wildlife group proposal |
F Grazers proposal |
G Fisheries group proposal |
|
Proposal |
Status quo |
Creating flood reservoir |
Restore original water features |
Connecting river with surrounding meadows |
Creation of pools |
Enhance river banks, plant hedges |
Restore shingle, fish passes, nesting island |
|
Ecological |
Breeding bird numbers |
No change |
Moderate evidence of moderate benefits |
Strong evidence of moderate benefits |
Moderate evidence of considerable benefit |
|||
Economic |
Fish numbers |
No change |
Weak evidence of moderate benefits |
Strong evidence of considerable benefits |
Moderate evidence of moderate benefits |
Moderate evidence of moderate benefits |
Overwhelming evidence of minor harms |
Moderate evidence of considerable benefits |
Water management |
Frequency of downstream flood events |
+5% |
-60% |
-80% |
-60% |
-10% |
+200% |
-20% |
Water quality |
Sediment in column |
-10% |
+10% |
+40% |
+10% |
+10% |
+5% |
-10% |
Cost |
0 |
$$ |
$$$$$ |
$$ |
$$ |
$$$ |
$$ |
|
Tourism interest |
Number non local visitors |
Low |
Very low |
Low |
No access |
Low |
Low |
Very low |
8.5.2 Checking for a dominant alternative
A dominant alternative is one that is better than all the other options being considered across all criteria. For example, option C in Table 8.3 might have been the superior option had it not been so expensive. If a dominant alternative option emerges then the decision could be considered resolved. There is no dominant alternative option in this scenario, so we need to reduce the number of alternatives based on the project aims and agreed trade-offs.
8.5.3 Revealing hidden values
All stakeholders and decision makers have unique perspectives on a decision and what is to be gained or lost from the outcomes of actions. For example, Vucetich et al. (2021) identified a wide range of motivations for conservation actions including care for future generations, present-day fairness, and utilitarian goals (Vucetich 2021). Values are amplified by cultural norms and world views (e.g., Riepe et al. 2021). Thus, for example, in managing a park, some stakeholders may oppose additional visitors because of their impacts, while others welcome visitors who pay to use facilities, some may welcome the return of stock grazing because it encourages a specific, valued bird species, while others oppose stock because fencing hinders dog walking and stock disturb wetland soils.
Typically, such values are captured and represented in values hierarchies and consequence tables. However, stakeholders may fail to disclose values for several reasons including because they were not asked about them, they did not anticipate them being affected by potential actions, or they did not know how to express them. Hidden values can derail discussions because stakeholders will negotiate for actions by weighting other factors correlated with their unstated objectives and preferred outcomes. They may be responsible when support for an action is equivocal, even though the consequence table suggests that there is a dominant alternative. Hidden values may be revealed by exploring options and objections through facilitated discussion of the consequence table, or in private discussion with a facilitator.
8.5.4 Excluding unacceptable options
Although all of the options in Table 8.3 were considered acceptable during the initial stages of the process it is apparent that some are now unacceptable for various reasons. Based on the project scope, budget and aims, it is clear from the analysis shown in Table 8.3 that, although beneficial, option C is unacceptably expensive — the cost exceeds the allocated funds. Furthermore, option F would result in an unacceptable increase in flood risk to communities downstream so is also excluded. This leaves five options.
8.5.5 Excluding redundant criteria
In the example scenario in Table 8.3, the number of tourists is low and better catered for by other projects elsewhere in the valley. Tourism is not a priority for this project, so it is decided it will be excluded. The process of excluding redundant criteria can be used repeatedly as the table is simplified.
Performance measure |
A No change |
B Original DWA proposal |
D District suggestion |
E Modified DWA proposal |
G Fisheries group proposal |
|
Ecological |
Breeding birds |
No change |
Moderate evidence of considerable benefit |
Moderate evidence of moderate benefits |
Moderate evidence of considerable benefit |
|
Economic |
Annual fish survey |
No change |
Weak evidence of moderate benefits |
Moderate evidence of moderate benefits |
Moderate evidence of moderate benefits |
Moderate evidence of considerable benefit |
Water management |
Flood events |
+5% |
-60% |
-60% |
-10% |
-20% |
Water quality |
Sediment in column. |
-10% |
+10% |
-10% |
+10% |
-10% |
Cost |
0 |
$$ |
$$ |
$$ |
$$ |
8.5.6 Removing dominated alternatives
The consequence Table 8.4 is simpler following the removal of two columns and one row. The next task is to try and simplify it further.
Dominated alternatives are options that are not superior to another in any criterion (Hemming et al., 2022). Option B is an inferior option that is equally as effective in reducing flood risk, for the same costs, as D but it has poorer ecological benefits (Table 8.4). Option E is also excluded as it has the same ecological benefits as option G but lower flood and water quality benefits. Options B and E are thus dominated alternatives and excluded. At each stage, we can exclude redundant criteria (see Section 8.5.4): water quality does not vary between the remaining options so is excluded.
As the table gets reduced more detail may be researched and added, for example, in Table 8.5 there is now a more detailed estimate of costs and the ecological consequences.
Performance measure |
A No change |
D District suggestion |
G Fisheries group proposal |
|
Ecological |
Breeding birds |
No change |
An estimated 3–15 further pairs of lapwing and a very likely (90–95%) chance that cranes will start nesting |
An estimated 3–15 further pairs of lapwing and a very likely (90–95%) chance that cranes will start nesting |
Economic |
Annual fish survey |
No change |
Likely to be a 5–20% increase in the main fish populations |
Likely to be a 50–100% increase in the main fish population and eels about as likely as not (40–60% chance) to return |
Water management |
Flood events |
+5% |
-60% |
-20% |
Cost |
0 |
$120k |
$130 |
The retained options all have a unique feature (and are thus not dominated). Option A is retained as it is cheaper than all others; D is retained as it has the highest flood protection; while G is retained as it has the highest ecological benefits. It is now necessary to consider the relative importance of these benefits.
Practical dominance
Imagine in the table that there is an option with a slightly better water quality measure but is much worse in all other comparisons. The decision might be made that this small difference does not outweigh the other disadvantages. For practical reasons it is dominated — hence practical dominance — and the option is eliminated.
8.5.7 Addressing trade-offs
Trade-offs arise when there is no dominant option, and the consequences vary in important ways across the options under consideration. Decision makers need to balance two issues: how much the fundamental aims vary over the alternatives; and how much stakeholders care about what they stand to gain or lose from each option. In doing so, they aim to maximise the expected net benefit or to minimise the chances of unacceptable outcomes.
There are four main ways of addressing trade-offs:
Apply weights to criteria
If each element of the table is given a score then one approach is to decide how important each criterion is and give each a weight reflecting their (agreed) value or utility (Gregory et al., 2012). Each score for an option is then multiplied by the relevant weight and the scores are summed to give a total score (or utility).
There are some tools for assigning weights. Analytic Hierarchic Processing is a process that entails asking a series of pairs of questions (what is the relative importance of sediment in the water against breeding birds), which then generates weights. If the uncertainties associated with the outcomes of each potential course of action are well understood then sensitivity analyses may be used to identify the options that are most likely to avoid unacceptable outcomes. This could be done by exploring ‘what if’ scenarios (e.g. Borsuk et al., 2003) or using models (Burgman, 2005). Weights can also be elicited from stakeholders (Walshe and Slade, 2020). In practice assigning weights is difficult (when buying lunch what is the relative importance of price, quantity, and taste?) but quickly resolves with specific examples (do you prefer this smaller tasty option or this equal price, bland but more substantial alternative?).
Common currencies
If each criterion can be converted into a common currency (usually money but can be biodiversity, time or risk) then the total net benefit of each can be calculated (e.g. cost-benefit analysis; Section 8.7). Thus the example could assess the cost of a flooding event and multiply it by the probability. The value of the water quality could be assessed just by the amount the water company might have to pay to clean the water or the value to the community of not having water with high sediment loads. Similarly, the total value of a change in fish or bird population can be assessed. With this approach, the total worth of each column can simply be added. In some cases, this is difficult (what is the value of a lapwing?) and some consider it unethical to equate environmental or social outcomes with money.
Negotiate a consensus
The consensus can be agreed upon by those involved through a process called deliberative decision making. In doing so, each stakeholder contemplates what they stand to gain or lose from each of the actions, and how much they are willing to forgo for one criterion to achieve gains on another. They also consider what others stand to gain or lose.
Even swaps
Even swaps entails considering what reduction in benefit of X would be needed to cancel out the gain in Y. For example, by asking whether people would sacrifice access along the river if there is a high probability (say 65%) of herons reoccupying the colony.
In the example, it could be asked how much people would swap an increase in flood protection for an increase in the fish population. It might be decided that flooding is really unpleasant to the community but that they would agree to a minor increase in risk for an improved fishery — perhaps 2% for moderate benefits and 5% for considerable benefits (Table 8.6).
Performance measure |
A No change |
D District suggestion |
G Fisheries group proposal |
|
Ecological |
Breeding birds |
No change |
An estimated 3–15 further pairs of lapwing and a very likely (90–95%) chance that cranes will start nesting |
An estimated 3–15 further pairs of lapwing and a very likely (90–95%) chance that cranes will start nesting |
Water management |
Flood events |
+5% |
-58% |
-15% |
Cost |
0 |
$120k |
$130 |
The next question might be the worth of the extra flood reduction. This can be in simple financial terms such as damage caused. It can also be in terms of reputation. Suppose it is decided that each percentage reduction in flood risk is worth $5k (Table 8.7).
Performance measure |
A No change |
D District suggestion |
G Fisheries group proposal |
|
Ecological |
Breeding birds |
No change |
An estimated 3–15 further pairs of lapwing and a very likely (90–95%) chance that cranes will start nesting |
An estimated 3–15 further pairs of lapwing and a very likely (90–95%) chance that cranes will start nesting |
Cost |
+$5k |
-$170k |
+$55 |
Option D is then a dominant alternative and selected. This approach of even swaps can be carried out for any sized table. It is better to start with the easy choices and hope that a solution appears before needing to make the more difficult choices.
8.5.8 Adding new options
Ideally, considering a wide range of alternative actions enables a decision maker to identify an option that will achieve the best outcomes for the subjects of interest. Often, there is no single option that achieves this (Gregory et al., 2012; Walshe and Hemming, 2019). The process of considering the various options, with their strengths and weaknesses, and confronting what the other stakeholders may gain or lose from each alternative option may lead to suggesting new alternative options.
It can be valuable to ask stakeholders to discuss the options and to suggest new courses of action that may satisfy all parties (Moon et al., 2019). In our scenario above, option D was preferred although it was not ideal for fish. A new alternative (H) was then suggested that provided greater benefit to fish but was slightly more expensive (Table 8.8). This was agreed as the preferred option.
Performance measure |
D District suggestion |
H District suggestion with meanders |
|
Ecological |
Breeding birds |
3–15 further pairs of lapwing and a very likely (90–95%) chance that cranes will start nesting |
6 further pairs of lapwing and a very likely (90–95%) chance that cranes will start nesting |
Economic |
Annual fish survey |
A 5–20% increase in the main fish populations |
A8 60–120% increase in the main fish population, eels likely (70–90% chance) to return and possible but unlikely (<30%) chance that salmon will return |
Water manage ment |
Flood events |
-60% |
-60% |
Cost |
$120k |
$125k |
The District suggestion (D) recommends a strategy that results in 3–15 pairs of lapwings. The best guess is that 10 pairs will establish. Suggestion H suggests that 6 additional pairs of lapwings will establish. Because appropriate ecological conditions are more certain, the prediction under suggestion H is more certain. Stakeholders or decision makers may prefer the expectation of 6 pairs over an expectation of 10 pairs, if the latter includes a more uncertain outcome that could be as low as 3 pairs. Thus, participants may trade an expectation of higher utility for an expectation of lower utility that nevertheless has a more reliable outcome. Attitude to risk is an inherent part of decision-making (Burgman, 2005; Cinner and Barnes, 2019), only possible if uncertainty is made explicit in consequence tables. In general, analyses that focus on detrimental or unacceptable outcomes are the domain of formal risk analysis.
8.5.9 Converting the table to ranks
Where possible, performance measures in a consequence table should be given realistic values. It is also possible to indicate broadly expected changes, such as a general increase in one objective and a general decrease in another. The consequence table can be confusing with a lot of information and a high number can indicate a beneficial (water clarity) or negative (costs, flood risk) outcome. It can be helpful to rank the options in each row (with 1 being the most favourable). The objectives that are most critical could also be placed at the top of the table. It is often clear as to which columns and rows can then be removed. Alternatively, it is possible to indicate the broadly expected changes, such as an increase in one objective and a general decrease in another and see if that leads to an answer without the need for more complex analysis.
8.6 Strategy Table
When there is a range of possible alternatives it can be useful to create a strategy table that organises alternatives into logical packages (see Table 8.9). This can be a useful way to see which alternatives are fundamentally different, rather than just different versions of the same thing.
Strategies |
Elements |
|||
Habitat management |
New habitat |
Reintroductions |
Monitoring |
|
Maintain existing status |
Retain existing practice |
Status quo |
None |
Monitor status in existing sites |
Reverse decline |
Reintroduce native herbivores |
Status quo |
None |
Monitor status in existing sites |
Return to former status |
Reintroduce native herbivores Recreate habitats Restore open areas |
Identify suitable sites Create agreements with landowners |
Establish propagation Programme Transplant individuals |
Monitor status in existing sites Test success of management of new sites Monitor success of reintroductions |
8.7 Classifying Decisions
8.7.1 Decisions within decisions
Problems or decisions are often spoken about as if they are a single choice, but conservation decisions are generally more like a series of linked choices. First, there is a choice about whether we need to act, often followed by a string of choices about what to do, and when and where to do it, that branch from the initial decision (Gregory et al., 2012). Mapping out the decision can help reveal the decisions within decisions and the important branch points that might lead to different considerations or trade-offs.
For example, if we decide to control an environmental weed because it is impacting something we care about, this leads to a choice about which method to use to remove the weed. Applying herbicide and physical removal can both control the weed, but physical removal is more expensive. If we choose physical removal then we can only treat half the area we could treat if we used herbicide. This leads to a decision about where to prioritise action. Herbicide needs to be applied annually, while physical removal is only needed every two or three years. We now need to decide when to act, to invest more resources now or in the future. This decision will influence whether we treat a smaller area with physical removal or treat a larger area with herbicide but reserve some of our budget to re-treat the same area. If we are not able to treat the same area of weed infestation then we may have to choose priority areas to target. Physical removal can be conducted all year round but herbicide application can only occur at certain times of the year. So the decision about how to act also creates a decision about when to act.
Decision sketching can help identify the different decisions and sub-decisions (Garrard et al., 2017). Given the nested or linked nature of many of these sub-decisions, tools like decision trees (see Figure 8.4) can be useful to identify the branch points and the different pathways and end points for the broader decision. Tools like Bayes Nets (Section 4.7.7) can also be useful to consider these linked decisions, by assigning probabilities to the different branch points.
8.8 Decision Trees
Decision trees are a means of identifying which action to adopt depending upon the circumstances by providing a series of choices. They have the merit of simplifying what separates the different options and creating a sequence of decisions that will identify the appropriate action. They are created by bringing together the range of possible actions, then removing those that are ineffective or inferior under all conditions to another. Ideally the higher choices are those that divide up the group more equally so producing a shorter tree. Figure 8.4 shows a decision tree created from the evidence for the effectiveness of different actions from Conservation Evidence for treating the invasive aquatic plant Crassula helmsii.
Multiple decision trees can be used to identify trade-offs between completing actions (Oliver et al., 2012). These could be taken to the stakeholders to help achieve consensus (Section 8.12).
8.9 Creating Models
Models are useful ways of representing the world. They can clarify thinking by representing the elements of a problem and revealing assumptions about how the different components of a system are connected and interact to produce outcomes. They can be used to explore possible outcomes and give indications of future outcomes. Sometimes by challenging our assumptions, models give surprising results, and provide unexpected insights as to how a system functions. However, models are only as good as the information on which they are constructed. It is therefore important that the assumptions and information on which models are built are not just accepted. This can be a particular problem for quantitative models, where numbers can be derived from a computer model and accepted without question.
Models can be simple representations of a system, that allow the complexity of a system to be reduced to an appropriate level of simplicity by focusing on the most relevant aspects and making explicit assumptions about how actions lead to outcomes. Previous sections have already presented three ways in which concepts can be linked together. Mind maps (Section 4.7.4) are an informal means of representing the links between a wide range of ideas. Means-ends networks (Section 8.3.2) provide a relatively informal means of sketching the proposed actions (means) to the desired outcomes (ends). The Theory of change (Section 7.5.2) can be a well structured means of planning a proposal by showing the links between elements. Miradi (Section 9.10.2) is a well accepted means of presenting theories of change. In making decisions, conceptual and/or explicit qualitative or quantitative models provide the links between casual observations, data, and the all-important consequences of decisions. Ideally, the underlying choices of the models are explicit and can be subject to confirmation with data, and cross-examination with theory.
Decision makers and stakeholders generally have implicit models of how a system works. Helping individuals to make those ‘mental models’ explicit (e.g. by creating a diagram) can have a wide range of benefits (Moon et al., 2019). Firstly, eliciting mental models can help individuals to recognise the assumptions they are making about a system (Moon et al., 2017). When done as part of a group process, eliciting mental models provide an opportunity to create a conceptual model of how a system works based on the collective knowledge of a group (e.g. Colvin et al., 2016). This group process can also help to create a shared vision for how to achieve a particular outcome. But it can also help groups with different perspectives to understand the assumptions and preferences and knowledge of other stakeholders, even if they do not share those views. By sharing mental models, it is possible to share knowledge, but also to correct misconceptions, permit solutions to be negotiated and help in conflict resolution by providing people with an opportunity to share their point of view based on their own knowledge and experiences (Moon et al., 2019).
Figure 8.5 shows the conventional process of building models to support decision making. It also shows the type of decision making adopted by the processes described in this book in which evidence use and expert elicitation play major roles. Evidence from all available sources provides the platform for developing ideas of cause and effect, transforming those ideas into equations and parameters, and validating the assumptions made in developing the model and estimating its parameters. Model building may conclude with a conceptual model that guides the creation of a consequence table. Alternatively, it may lead to a suite of different mathematical and statistical models for some or all of the elements in a consequence table. These ideas were introduced in Section 2.7.
8.10 Achieving Consensus
Using the processes for stakeholder engagement presented in Chapter 6, the decision maker needs to present the different options and allow all stakeholders to evaluate the trade-offs to reach a consensus. It is most challenging when high-stakes decisions involve stakeholders with conflicting objectives. Behavioural consensus is effective when participants agree to negotiate to resolve conflict (Valverde, 2001).
The stages described previously can be approached at a range of scales from just two individuals to a range of teams. Workshops are especially useful when issues are complex and require the extraction of a wide set of evidence and views, if community involvement is key, or if there are substantially differing views, perhaps including conflict. The consequence tables described above are a key element in negotiations. They summarise what is to be expected from each management option, providing a clear picture of what each participant stands to gain or lose from each action. The fundamental objectives encapsulate what participants care about. Once dominant and dominated alternatives and redundant objectives have been removed, the remaining table focuses participants on the core issues. The measures provide unambiguous representations of these key objectives.
The facilitator’s role is to look for areas in which participants may be willing to concede gains in the interests of finding a mutually acceptable, consensus solution. This requires participants to decide what they can tolerate, rather than seek an optimal outcome from their perspective. Valverde (2001) suggested a framework to achieve consensus that has its foundations in an approach developed by Kaplan (1992; see Burgman, 2005). It involves decomposing arguments (as in argument maps) into basic elements: claims, evidence, models that link claims to data and assumptions, and objections. Disagreements may be about facts, theories, data, or reasoning. Sources of disagreement may be semantic interpretations, different preferences and values, opinions about the validity of evidence, or adherence to different theories of cause and effect. Closure or resolution may be achieved through sound argument, agreeing that a particular position is ‘best’, or reaching a resolution that is acceptable to the participants and that is ‘fair’ rather than correct or optimal. Sometimes a conflict dissipates and is resolved because it turns out that the differences between actions are trivial. Participants may also trade the surety of an outcome for a particular objective for the expectation of the magnitude of the outcome. Thus, a participant may agree to a smaller expected adult fish population each year, if the variation in expected fish population size is also smaller or if the proposal includes marketing resulting in higher prices.
8.10.1 Dealing with conflict
Conflict arises when there is a difference in opinion between individuals or organisations about which options should be analysed, which objectives should be included, how options should be assessed, whether change is necessary or which trade-offs should be made (Redpath et al., 2013). The underlying principle is to discover the compromises that are most acceptable to the key stakeholders. This may include agreeing that some objectives are not essential or accepting that an option, whilst being ideal for one group, is unacceptable to others but that an alternative option is acceptable to both. In some cases the conclusion might be to acknowledge the conflict and accept that a compromise will not be found by the participants.
Conservation conflicts will likely increase (Redpath et al., 2013) and, where they do arise, it is likely due to a lack of communication and/or lack of understanding about the impacts of a particular action (Minderman et al., 2019). At a minimum, using transparent processes for decision-making can help clarify the information and rationale behind a decision.
Open and transparent processes, such as identifying the problem, gathering the evidence, and early engagement with stakeholders, can increase trust and help avoid misunderstanding. Sharing mental models can be useful to identify differences in the assumptions made by different groups. Making these assumptions clear at the start provides the opportunity to identify preferences and correct misconceptions (Moon et al., 2019).
References
Bennett, N.J., Di Franco, A. and Calò, A. 2019. Local support for conservation is associated with perceptions of good governance, social impacts, and ecological effectiveness. Conservation Letters 12: e12640, https://doi.org/10.1111/conl.12640.
Borsuk, M.E., Stow, C.A. and Reckhow, K.H. 2003. An integrated approach to TMDL development for the Neuse River Estuary using a Bayesian probability network model (Neu-BERN). Journal of Water Resources Planning and Management 129: 271–82, https://doi.org/10.1061/(ASCE)0733-9496(2003)129:4(271).
Burgman, M., Layman, H. and French, S. 2021. Eliciting model structures for multivariate probabilistic risk analysis, Frontiers in Applied Mathematics and Statistics 7: 1–10, https://doi.org/10.3389/fams.2021.668037.
Burgman, M. 2005. Risks and Decisions for Conservation and Environmental Management. (Cambridge: Cambridge University Press).
Cawson J.G., Hemming, V., Ackland, A., et al. 2020. Exploring the key drivers of forest flammability in wet eucalypt forests using expert-derived conceptual models. Landscape Ecology 35: 1775–98, https://doi.org/10.1007/s10980-020-01055-z.
Ceballos, G., Ehrlich, P.R., Barnosky, A.D., et al. 2015. Accelerated modern human–induced species losses: Entering the sixth mass extinction. Science Advances 1: e1400253, https://doi.org/10.1126/sciadv.1400253
Christie, A.P., Downey, H., Frick, W.F., et al. 2022. A practical conservation tool to combine diverse types of evidence for transparent evidence-based decision-making. Conservation Science and Practice 4: e579, https://doi.org/10.1111/csp2.579.
Cinner, J.E. and Barnes, M.L. 2019. Social dimensions of resilience in social-ecological systems. One Earth 1: 51–56, https://doi.org/10.1016/j.oneear.2019.08.003.
Colvin, R.M., Witt, G. B. and Lacey, J. 2016. Approaches to identifying stakeholders in environmental management: Insights from practitioners to go beyond the ‘usual suspects’. Land Use Policy 52: 266–76, https://doi.org/10.1016/j.landusepol.2015.12.032.
Converse, S.J. 2020. Introduction to multi-criteria decision analysis. In: Structured Decision Making: Case Studies in Natural Resource Management, ed. by M.C. Runge, et al. (Baltimore: Johns Hopkins University Press).
Cook, C.N., Pullin, A.S., Sutherland, W.J., et al. 2017. Considering cost alongside the effectiveness of management in evidence-based conservation: A systematic reporting protocol. Biological Conservation 209: 508–16,https://doi.org/10.1016/j.biocon.2017.03.022.
Domning, D.P. 1978. Sirenian evolution in the North Pacific Ocean. University of California Publication in Geological Sciences 118: 1–176.
Failing, L. and Gregory, R. 2003. Ten common mistakes in designing biodiversity indicators for forest policy. Journal of Environmental Management 68: 121– 32, https://doi.org/10.1016/S0301-4797(03)00014-8.
Garrard, G.E., Rumpff, L., Runge, M.C., et al. 2017. Rapid proto-typing for decision structuring: An efficient approach to conservation decision analysis. In: Decision-Making in Conservation and Natural Resource Management, ed. by N. Bunnefeld, et al. (Cambridge: Cambridge University Press).
Gregory, R.S. and Keeney, R.L. 2002. Making smarter environmental management decisions. Journal of the American Water Resources Association 38: 1601–12, https://doi.org/10.1111/j.1752-1688.2002.tb04367.x.
Gregory, R., Failing, L., Harstone, M., et al. 2012. Structured Decision Making: A Practical Guide to Environmental Management Choices (Hoboken: John Wiley & Sons).
Guiler, E. and Godard, P. 1998. Tasmanian Tiger: A Lesson to be Learnt (Perth: Abrolhos Publishing).
Hemming, V., Burgman, M.A., Hanea, A.M., et al. 2018. A practical guide to structured expert elicitation using the IDEA protocol. Methods in Ecology and Evolution 9: 169–80. https://doi.org/10.1111/2041-210X.12857.
Hemming, V., Camaclang, A.E., Adams, M.S., et al. 2022. An introduction to decision science for conservation. Conservation Biology 36: e13868, https://doi.org/10.1111/cobi.13868.
Hockings, M. 2003. Systems for assessing the effectiveness of management in protected areas. BioScience 53: 823–32, https://doi.org/10.1641/0006-3568(2003)053[0823:SFATEO]2.0.CO;2.
Iacona, G.D., Sutherland, W.J., Mappin, B., et al. 2018. Standardized reporting of the costs of management interventions for biodiversity conservation. Conservation Biology 32: 979–88, https://doi.org/10.1111/cobi.1319.
Joseph, L.N., Maloney, R.F. and Possingham, H.P. 2009. Optimal allocation of resources among threatened species: a project prioritization protocol. Conservation Biology 23: 328–38, https://doi.org/10.1111/j.1523-1739.2008.01124.x.
Kaplan, S. 1992. ‘Expert information’ versus ‘expert opinions.’ Another approach to the problem of eliciting / combining / using expert opinion in PRA. Reliability Engineering and System Safety 35: 61–72, https://doi.org/10.1016/0951-8320(92)90023-E.
Keeney, R.L. 2004. Making better decision makers. Decision Analysis 1: 193–204, https://doi.org/10.1287/deca.1040.0009.
Keeney, R.L. and Gregory, R.S. 2005. Selecting attributes to measure the achievement of objectives. Operations Research 53: 1–11, https://www.jstor.org/stable/25146843.
Knight, A.T., Cook, C.N., Redford, K.H., et al. 2019. Improving conservation practice with principles and tools from systems thinking and evaluation. Sustainability Science 14: 1531–48, https://doi.org/10.1007/s11625-019-00676-x.
Lindenmayer, D.B., Piggott, M.P. and Wintle, B.A. 2013. Counting the books while the library burns: Why conservation monitoring programs need a plan for action. Frontiers in Ecology and the Environment 11: 549–55, https://doi.org/10.1890/120220.
Martin, T.G., Nally, S., Burbidge, A.A., et al. 2012. Acting fast helps avoid extinction. Conservation Letters 5: 274–80, https://doi.org/10.1111/j.1755-263X.2012.00239.x
Martin, T.G., Camaclang, A.E., Possingham, H.P., et al. 2017. Timing of protection of critical habitat matters. Conservation Letters 10: 308–16, https://doi.org/10.1111/conl.12266.
McShane, T.O., Hirsch, P.D., Trung, T.C., et al. 2011. Hard choices: Making trade-offs between biodiversity conservation and human well-being. Biological Conservation 144: 966–72, https://doi.org/10.1016/j.biocon.2010.04.038.
Minderman, J., Cusack, J.J., Duthie, A.B., et al. 2019. Decision trees for data publishing may exacerbate conservation conflict. Nature Ecology & Evolution 3: 31818, https://doi.org/10.1038/s41559-019-0804-7.
Moon, K., Blackman, D.A., Adams, V. M., et al. 2017. Perception matrices: An adaptation of repertory grid technique. Land Use Policy 64: 451–60, https://doi.org/10.1016/j.landusepol.2017.03.023.
Moon, K., Guerrero, A.M., Adams, V.M., et al. 2019. Mental models for conservation research and practice. Conservation Letters 12: e12642,https://doi.org/10.1111/conl.12642.
Oliver, T.H., Smithers, R.J., Bailey, S., et al. 2012. A decision framework for considering climate change adaptation in biodiversity conservation planning. Journal of Applied Ecology 49: 1247–55, https://doi.org/10.1111/1365-2664.12003.
Pienkowski, T., Cook, C., Verma, M., et al. 2021. Conservation cost‐effectiveness: A review of the evidence base. Conservation Science and Practice 3: e357,https://doi.org/10.1111/csp2.357.
Possingham, H.P., Andelman, S.J., Noon, B.R., et al. 2001. Making smart conservation decisions. In: Conservation Biology: Research Priorities for the Next Decade, ed. by M.E. Soule, M.E. and Orians, G.H. (Washington: Island Press).
Pullin, A.S and Knight, T.M. 2009. Doing more good than harm — Building an evidence-base for conservation and environmental management. Biological Conservation 142: 931–34, https://doi.org/10.1016/j.biocon.2009.01.010.
Redpath, S.M., Young, J., Evely, A., et al. 2013. Understanding and managing conservation conflicts. Trends in Ecology & Evolution 28: 100–09, https://doi.org/10.1016/j.tree.2012.08.021.
Regan, H.M., Ben-Haim, Y., Langford, B., et al. 2005. Robust decision‐making under severe uncertainty for conservation management. Ecological Applications 15: 1471–77, https://doi.org/10.1890/03-5419.
Riepe, C., Liebe, U., Fujitani, M., et al. 2021. Values, beliefs, norms, and conservation-oriented behaviors toward native fish biodiversity in rivers: evidence from four European countries. Society & Natural Resources, 34, 703–24, https://doi.org/10.1080/08941920.2021.1890865
Schwartz, M.W. 2008. The performance of the Endangered Species Act. Annual Review of Ecology, Evolution, and Systematics 39: 279–99, https://doi.org/10.1146/annurev.ecolsys.39.110707.173538.
Schwartz, M.W., Cook, C.N., Pressey, R.L., et al. 2018. Decision Support Frameworks and Tools for Conservation. Conservation Letters 11: e12385, https://doi.org/10.1111/conl.12385.
Sutherland, W.J. 2019. Kaizen Conservation? Oryx 53: 397–98. https://doi.org/10.1017/S0030605319000619.
Valverde, L.J. 2001. Expert judgement resolution in technically-intensive policy disputes. In: Assessment and Management of Environmental Risks, ed. by I. Linkov and J. Palma-Oliveira (Dordrecht: Kluwer Academic).
Vucetich, J.A., Bruskotter, J.T., van Eeden, L.M., et al. 2021. How scholars prioritize the competing values of conservation and sustainability. Biological Conservation, 257:.109126. https://doi.org/10.1016/j.biocon.2021.109126
Walshe, T.V. and Hemming, V. 2019. Gabo Island Structured Decision-Making: Report on outcomes from a workshop held October 2011 and penguin surveys conducted 2008–2016. (Unpublished Report, School of Biosciences, The University of Melbourne).
Walshe, T. and Slade, S. 2020. Coral reef fin fish spawning closures for coral reef fin fish. In: Structured Decision Making: Case Studies in Natural Resource Management, ed. by M.C. Runge, et al. (Baltimore: John Hopkins University Press).
Williams, P. J. and Kendall, W.L. 2017. A guide to multi-objective optimization for ecological problems with an application to cackling goose management. Ecological Modelling 343: 54–67, https://doi.org/10.1016/j.ecolmodel.2016.10.010.