115
Purpose of This Presentation • To guide the implementation of large scale monitoring surveys of Native Bee populations (e.g., global, national, regional, large protected areas) • To present conservative monitoring protocols that can be adjusted to suit local conditions • To provide the background and justification for the those guidelines

FAO Bee Survey Design Talk

Embed Size (px)

DESCRIPTION

A presentation made in March of 2009 in Brazil to the FAO on bee sampling issues.

Citation preview

Page 1: FAO Bee Survey Design Talk

Purpose of This Presentation

• To guide the implementation of large scale monitoring surveys of Native Bee populations (e.g., global, national, regional, large protected areas)

• To present conservative monitoring protocols that can be adjusted to suit local conditions

• To provide the background and justification for the those guidelines

Page 2: FAO Bee Survey Design Talk

NOT the Purpose of This Presentation

• To present a one-size-fits-all protocol; goals, objectives, and situations differ and so too must the answer to what is the best set of surveys for a situation

• To present information about INVENTORIES; inventories have as their objective an enumeration of the species present, monitoring is designed to look at changes over time; monitoring and inventory can inform each other, but almost always would be approached differently

Page 3: FAO Bee Survey Design Talk

Also NOT the Purpose…

• Provide a protocol for your RESEARCH project• This information can certainly be used to

inform how you would sample bees in your research project but it would all most certainly need to be modified to meet your specific analytical needs

Page 4: FAO Bee Survey Design Talk

The World Suspects That Bees are Declining

Shrill Carder Bumblebee DistributionData from NBN, with particular thanks to BWARS.

Page 5: FAO Bee Survey Design Talk

The Problem

We do not know the magnitude of the crisis nor have identified how and where to target our conservation

measures because until now, there is

NO GLOBAL MONITORING PROGRAM

Page 6: FAO Bee Survey Design Talk

Outline of Things to Come in This Presentation

• Guidelines for monitoring• Sampling techniques for bees• Number of traps to use• Pan trap variables (e.g. color, size)• Response variables• Number of sites to sample• Proposed monitoring plan

Page 7: FAO Bee Survey Design Talk

What Makes a Good Pollinator Monitoring Program?

• Clearly defined questions• Repeatable• Low variance• Low cost• Accurately measures change in most or all of

the pollinator community

Page 8: FAO Bee Survey Design Talk

Monitoring - GoalsMonitoring - Goals

What is the story you want to tell?What is the story you want to tell?What species do you want to talk about?What species do you want to talk about?What level of trend do you want to detect?What level of trend do you want to detect?Over what time period?Over what time period?Example: We want to be able to detect a 20% Example: We want to be able to detect a 20%

change in 15 common species over 10 years (PAY change in 15 common species over 10 years (PAY ATTENTION HERE: We didn’t say we would detect ATTENTION HERE: We didn’t say we would detect these declines, just that we could if they were to these declines, just that we could if they were to occur)occur)

How often are you willing to cry wolf?How often are you willing to cry wolf?What sort of power to detect a trend do you want?What sort of power to detect a trend do you want?

Page 9: FAO Bee Survey Design Talk

Most ImportantMost Important

1.1. Clearly Define the Goals and Clearly Define the Goals and ObjectivesObjectives

2.2. Define How the Information Will Define How the Information Will be usedbe used

Page 10: FAO Bee Survey Design Talk

2 Categories of Problems

1. How many samples do I need to track changes?

2. Does my current monitoring program have adequate precision to do the job?

Page 11: FAO Bee Survey Design Talk

Goals: Define What You Want Out of Your Monitoring Program

Then We Can Have a Talk About Sample Sizes

• Biological goals– Write down which species you plan to monitor along with

a rationale for those choices

• Statistical goals– With how much precision do you want to talk about your

animal’s status?– What geographic place and scale do you want information

for?– What do you mean by status?… a list, a map, trends?

Page 12: FAO Bee Survey Design Talk

3 Factors Affect Your Sample Size

• Variability of your Sample• Your Definition of Precision • What you Mean by Trend

Page 13: FAO Bee Survey Design Talk

A Measure of Variability

• To describe variability in counts of bees we use the CV (Coefficient of Variation)

• CV = SD/Mean• The CV is a standardized way of talking about

variability that takes into account the fact that the mean and SD are positively correlated

Page 14: FAO Bee Survey Design Talk

Variance = Variability in Monitoring

• High CVs mean:– Trends are harder to extract from the year to year

background noise of the counts– More samples needed to detect a trend of a given

magnitude– Costs will be higher

• The source of the variance doesn’t matter• The CV should be lowered where possible –

e.g., standardizing on time of year

Page 15: FAO Bee Survey Design Talk

Defining Precision in Monitoring

• How often are you willing to cry wolf?• i.e., Setting the Alpha Level

• How powerful do you want your test to be?• i.e., Setting the Power Level

• Are you really only interested in declines?• i.e., Setting a 1 or 2-tailed test

Page 16: FAO Bee Survey Design Talk

What do you Mean by Trend?Your Answer Affects the # of Samples you Need

• Over What Time Period?• (2 years, 5, 10, 25?)

• When is a trend not a trend?• Yes! 0% is Not a Trend• But is 1%? How about 20%?• You have to decide what the

smallest trend is you want to detect

Page 17: FAO Bee Survey Design Talk

Our Favorite Monitoring Objectives

Trend = 50% decline over a set period of time Precision = Alpha 0.2, Power 0.9, 2-tailed Look at 10 and 25 year scenarios

Page 18: FAO Bee Survey Design Talk

Time Conquers AllSome Broad Results of our Simulations

• The Number of Sites You Need to Sample will be High When you are Looking to Detect Trends over <10 Years

• For Surveys Run for at Least 20 Years the Maximum Number of Plots Needed (Under Reasonable Scenarios) is only 13

Page 19: FAO Bee Survey Design Talk

Those Nasty Zeros

• Sample sizes must be INCREASED by the proportion of zero counts or places where the species does not occur• For example, if you want to track a species and

you calculate that you need 20 plots, but that species only shows up on about 50% of the plots then you would need 40 not 20 plots

• Hint: Keep Counts High by collecting a lot of bees at each sampling location

Page 20: FAO Bee Survey Design Talk

Some Examples of How Counts of Animals and Plants Vary: Mean Percent CV’s Taken from the

Literature Large Mammals 14 Grasses/Sedges 21 Herbs 21 Turtles 33 Large Birds 36 Lizards 42 Salmonids 47 Caddisflies 50 Snakes 54 Dragonflies 57 Small Birds 57 Beetles 58 Small Mammals 60

Spiders 64 Medium Mammals 65 Non-Salmonids 71 Moths 90 Bats 93 Butterflies 111 Drosophilid Flies 131

Bees? You will see how they fit in later in the slide show.

Page 21: FAO Bee Survey Design Talk

CV’s are Very Predictable (at least if you are an amphibian). Correlation between CV of amphibian counts during first and last

5 years of long-term count series

0.0 0.2 0.4 0.6 0.8 1.0 1.2FIRST5

0.0

0.2

0.4

0.6

0.8

1.0

1.2S

IXT

OT

EN

Page 22: FAO Bee Survey Design Talk

Some Background on Bee Sampling: How have Bees been Sampled in the Past?

• Pan/Bowl/Moericke/Funnel traps• Netting• Malaise traps• Counts at flowers• Trap nests• Bait Stations

Page 23: FAO Bee Survey Design Talk

A Bit More about Pan Type of Traps

• Pan, Bowl, Funnel, and Moericke traps – All have the same basic idea: Attract bees using the color of the trap and then drown them in the trap’s liquids– Inexpensive– No “observer” bias– Easily standardized– Captures a broad spectrum of bee species (but some groups

not well represented)

• Downside– No host plant data– Some bee species very poorly sampled

Page 24: FAO Bee Survey Design Talk

Monitoring – General Bee Issues to Monitoring – General Bee Issues to ConsiderConsider

Year-to-Year Variance HIGH, HIGH, HIGHYear-to-Year Variance HIGH, HIGH, HIGHSomething to think about: What is your measure of a Something to think about: What is your measure of a

bee population?bee population?Traditional Measure: Numbers of INDIVIDUALS caughtTraditional Measure: Numbers of INDIVIDUALS caughtBetter: Number of PLACES caughtBetter: Number of PLACES caught

Page 25: FAO Bee Survey Design Talk

So, Back to Bees and Calculating What Should be Sampled and How

• We used data from previous studies to compare coefficients of variation across techniques and situations

• And…explore what the relationship is between Species Richness, Abundance and their CVs

• And… look at if there is a benefit to getting more samples

Page 26: FAO Bee Survey Design Talk

We Thank These Generous People who Shared their Published and Unpublished

Data• Jim Cane – Georgia• Gordon Frankie - California• Terry Griswold – California• Rob Jean - Indiana• Emanuel Kula – Czech Republic• Gretchen LeBuhn – California• Bob Minckley - Mexico, Arizona• D.F. Owen – Great Britain• Frank Parker – Utah• Dave Roubik - Panama• Karen Wetherill – New Mexico

Page 27: FAO Bee Survey Design Talk

Definitions: How we Calculated the summary CVs Used in the Next Set of Slides for an

Individual Site• Species Richness – We counted all the species

found each year, calculated the SD across those years, and then divided by the mean species richness

• Bee Abundance – We counted all the bees for all the bee species found within a year, calculated the SD across those year, and then divided by the mean bee abundance

• More on next slide

Page 28: FAO Bee Survey Design Talk

More Definitions

• Individual Species Abundance – In this case FOR EACH SPECIES we calculate a yearly total, then, also for each species, we estimate calculate a SD across the years, and divide that by the mean…THEN we take the MEAN OF THOSE INDIVIDUAL CVs

• Top 5 Species – In this case FOR JUST THE TOP 5 MOST ABUNDANT SPECIES we do the same thing we just talked about above

Page 29: FAO Bee Survey Design Talk

Relationship Bee Abundance and CV of Species Richness at a Site – A Nice, Highly Significant, Negative Relationship

Log Total Numbers

CV

of

Ric

hnes

s

Page 30: FAO Bee Survey Design Talk

Relationship Between Species Richness and CV of Species Richness – Basically the Same

Relationship, Just a Bit Noisier

Mean Species Richness

CV

of

Ric

hnes

s

Page 31: FAO Bee Survey Design Talk

Relationship Between Species Richness and CV of Bee Abundance – Similar relationship, but looser still

Mean Species Richness

CV

of

Abu

ndan

ce

Page 32: FAO Bee Survey Design Talk

Relationship Between Mean Bee Abundance and CV of Abundance - Ditto

Log Total Numbers

CV

Abu

ndan

ce

Page 33: FAO Bee Survey Design Talk

Possible Take Home Messages of The Last 4 Graphs

• Possible Interpretation #1: Where bees are abundant, bee populations are more stable

• Possible Interpretation #2: If you catch more bees you will lower your CV and consequently your monitoring program will be better able to detect trends

• Possible Interpretation #3: Easy to catch bees have low sampling variability

Page 34: FAO Bee Survey Design Talk

Which Bee Survey Technique Minimizes Variance of Bee Counts?• We compared yearly CVs across techniques

for the following measures of a bee population:– Bee Abundance– Species Richness– Individual Species Abundance– Top 5 Species

Page 35: FAO Bee Survey Design Talk

Comparison of Techniques:Bee Abundance – No Real Difference

Between Techniques

Bait Bowl Funnel Malaise Moericke Netting Trap Visual

CV

Page 36: FAO Bee Survey Design Talk

Comparison of Techniques:Individual Species Abundance – Note low CVs

for Bait and High for Funnel and Moericke

Bait Bowl Funnel Malaise Moericke Netting Trap Visual

CV

Page 37: FAO Bee Survey Design Talk

Comparison of Techniques:Species Richness – About the same, except for

bait, which is quite low

Bait Bowl Funnel Malaise Moericke Netting Trap Visual

CV

Page 38: FAO Bee Survey Design Talk

Comparison of Techniques:Top 5 Species: Same interpretation as the last

one

Bait Bowl Funnel Malaise Moericke Netting Trap Visual

CV

Page 39: FAO Bee Survey Design Talk

OK, Now Something a Little Different

• The next slides show results for individual sites – 16 sites were available for analysis for bowls– 13 sites for netting

• Take a look at how the CV’s varied among these sites

Page 40: FAO Bee Survey Design Talk

Bowl CVs: Individual Species Abundance – Super High!

0

20

40

60

80

100

120

140

160

180

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

Page 41: FAO Bee Survey Design Talk

Netting CVs: Individual Species Abundance – Whoa, Nellie! Also Super High!

0

20

40

60

80

100

120

140

160

180

1 2 3 4 5 6 7 8 9 10 11 12 13

CV

Page 42: FAO Bee Survey Design Talk

Bowl CVs: Top 5 Species – Better, Much Lower

0

20

40

60

80

100

120

140

160

180

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

CV

Page 43: FAO Bee Survey Design Talk

Netting CVs: Top 5 Species – Similar, Better, Much Lower

0

20

40

60

80

100

120

140

160

180

1 2 3 4 5 6 7 8 9 10 11 12 13

CV

Page 44: FAO Bee Survey Design Talk

Bowl CVs: Bee Abundance – Oh My, Quite Nice!

0

20

40

60

80

100

120

140

160

180

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

CV

Page 45: FAO Bee Survey Design Talk

Netting CVs: Bee Abundance – Sweet!

0

20

40

60

80

100

120

140

160

180

1 2 3 4 5 6 7 8 9 10 11 12 13

CV

Page 46: FAO Bee Survey Design Talk

Summary- Which Technique?

• Relatively little difference in CV across techniques – With the exception of very low fluctuations of bees coming into bait traps, but unfortunately bait traps work only for some Euglossine species in the New World tropics

• Our recommendation: Pan Traps or Moericke traps– Inexpensive,– No observer bias– Easy

Page 47: FAO Bee Survey Design Talk

What Measure of a Population to Use?

• Note that species that occur at low numbers in surveys have high CVs and are unlikely to be monitored well

• Note that species that occur commonly have (on average) much better CVs and are thus trends in their populations are much more likely to be detected

• If you pool all the individuals caught regardless of species into one grand category, you have wonderful CVs and can detect quite small changes in the number of “bees”

• Ditto on simply tracking changes in the number of species detected

Page 48: FAO Bee Survey Design Talk

To Sum Up the Previous Slide

• Bee monitoring programs will have excellent abilities to detect changes in the total number of individuals and species and moderate abilities to detect changes in the common species

• If you want to detect changes in rare species, you need to increase your probability of detecting them by altering your sampling techniques and strategies and not depend on a generic monitoring program to track everything

Page 49: FAO Bee Survey Design Talk

How many bowl traps in a transect should we use?

• What follows was taken from Leo Shapiro’s and Collaborators Unpublished Work (being readied for publication)

• Used 4 data sets with large numbers of bowls and where bee captures were recorded for each individual bowl

• Randomly sampled from data to create accumulation curves

• Where curve saturates (flattens), there is little gain in the number of species estimated

Page 50: FAO Bee Survey Design Talk

Accumulation curves for pan trapsExamples of

Page 51: FAO Bee Survey Design Talk

Summary- How many traps?

• Curve saturates on average at 15-20 pan traps• Previously we showed that CV decreased with

more species• Recommendation: 24 pan traps per transect,

or 3 Moericke traps, this satisfies both having sufficient number of traps per transect and capturing enough specimens

Page 52: FAO Bee Survey Design Talk

What type of pan traps should we use?

• Size• Color• Number• Distance apart• Sampling time

Page 53: FAO Bee Survey Design Talk

df=6,147, F-value=0.20, p-value=0.977 12 oz

6 oz

1oz

2 oz

3.25 oz

4 oz

0.7 oz

No significant difference

Size of pan traps

Page 54: FAO Bee Survey Design Talk

Is pan trap color really important?

Compare how many individuals are caught in different colored bowls for key species

Page 55: FAO Bee Survey Design Talk

Color of Pan Trap- Numerous trials on East Coast of

U.S.

Blue UV

Yellow UV

Pale BlueUV

Pale Blue

White

White UV

Blue

Yellow

Page 56: FAO Bee Survey Design Talk

Data for The Following Slides

• Were taken from a large month-long USDA ARS study of bowl color run by the Smithsonian Parasitic Hymenoptera group in Calvert County, Maryland

• Note how each species has its own preferences• Note the large sample sizes• Also note how the florescent colors performed about

equally well as the non-florescent ones

Page 57: FAO Bee Survey Design Talk

A. aurata

600

3

738260

9

348

512 Blue

Clear

Fl. Blue

Fl. Yellow

Red

White

Yellow

Augochlorella aurata

Page 58: FAO Bee Survey Design Talk

A. nasonii8

2

5

58

44

92

Blue

Clear

Fl. Blue

Fl. Yellow

Red

White

Yellow

Andrena nasonii

Page 59: FAO Bee Survey Design Talk

A. violae

37

47

Blue

Clear

Fl. Blue

Fl. Yellow

Red

White

Yellow

Andrena violae

Page 60: FAO Bee Survey Design Talk

C. andreniformis62

2

51

58

1

235

29Blue

Clear

Fl. Blue

Fl. Yellow

Red

White

Yellow

Calliopsis andreniformis

Page 61: FAO Bee Survey Design Talk

  non-uv uv

Agapostemon 0 1

Andrena 0 1

Apis 0 1

Augochlora 1 1

Augochorella 1 3

Bombus 0 3

Calliopsis 2 6

Ceratina 4 11

Anthididum 0 3

Halictus 2 11

Heriades 0 1

Hylaeus 2 2

Lasioglossum 13 77

Melissodes 1 4

Osmia 1 0

Perdita 1 1

Sphecodes 0 2

Total 28 128

Genus

Are bees more attracted to fluorescent or non-fluorescent colored pan traps?

Data from Sam DroegeNote, that bowls were

placed adjacent to one another

Page 62: FAO Bee Survey Design Talk

Color is important

• Using multiple colors catch more species• Fluorescence dramatically increases catch, at

least under some circumstances

• Recommendation: Use 3 colors UV-blue, UV-yellow and white

Page 63: FAO Bee Survey Design Talk

Percentage of Bees Retrieved from each Scent

Control

Honey

OrangeBlossomLavender

Clove Oil

Sugar

13%

20%15%

20%

16% 16%

Does Adding Scents or Sweets in the Water in the Bowl Boost Catch?

Nope – Data from 10 trials with 5 replicates of each category – Maryland data

Page 64: FAO Bee Survey Design Talk

Total Averages

0.00

2.00

4.00

6.00

8.00

10.00

12.00

14.00

1 2 3 4 5 6

Treatment

Nu

mb

er o

f B

ees

Does Adding Salt Increase the Number of Bees Captured?

Not in Maryland it doesn’t - Same set up as last time, but note that salt in the New World tropics will attract bees but this has not been tried in traps

Treatments are different concentrations of salt in bowl traps

Page 65: FAO Bee Survey Design Talk

Scent is not important

• None of the scents or salt increased catch in Eastern North America

• Recommend: dishwasing liquid (Blue Dawn is our favorite)

• Note that several detergents and laundry soaps were trialed all worked the same but CITRUS based detergents DECREASED captures

Page 66: FAO Bee Survey Design Talk

How far apart should bowls be?

• Trapping web and paired studies suggests bowls should be 3-5 m apart

Colored dots indicate trap locations and colors indicate the number of bees captured, from these data traps were determined to not compete with each other when spaced >3m apart

Page 67: FAO Bee Survey Design Talk

When should we sample?When should we sample?Significant effect of time of yearSignificant effect of time of year

From Russell et al. powerline study, note that colors denote significant treatments yet samples fell into date groups in CCA ordination space

Page 68: FAO Bee Survey Design Talk

Change in Captures in May2-Day Time Intervals

Sampling period

Data from previously mentioned USDA study

Page 69: FAO Bee Survey Design Talk

What should we be measuring?The upcoming slides tell the story

Do we decrease variability by focusing on subsets of our bees? Remember how we calculated the CVs for the previous graphs? Well they are the same except we added two new ones (1. and 2. below) calculated the same way as the others.

1. Bees represented by an average of at least 1 individual

2. Bees represented by an average of at least 5 individuals

3. The Top 5 Species4. All Individual Bee Species5. Bee Abundance6. Bee Richness

Page 70: FAO Bee Survey Design Talk

Impact of Category and Pooling on the CV

Moericke Trap - Czech Republic - Kula Data

0

20

40

60

80

100

120

140

160

180

All Individuals >1 >5 Top 5 Abundance Richness

CV

Site

Birch

Spruce

Birch + Spruce

Note that pooling across sites had relatively little impact on CV

Page 71: FAO Bee Survey Design Talk

Impact of Category and Pooling on the CV

Funnel Trap - New Mexico - Wetherill Data

0

20

40

60

80

100

120

140

160

180

All Individuals >1 >5 Top 5 Abundance Richness

CV

Replicate

Site

Pooled

Note that pooling across replicates and sites had little impact on CV

Page 72: FAO Bee Survey Design Talk

Impact of Category and Combining Netting and Bowling on the CV

Bowl and Netting CV Comparison on the Same PlotsNote Osmia and Most Lasioglossum Not Included

California - Griswold

0

20

40

60

80

100

120

140

160

180

All Individuals >1 >5 Top 5 Abundance Richness

CV

Bowl + Netting

Netting

Bowl

Note that pooling netting and bowl trapping data has a slight but positive impact on CV

Page 73: FAO Bee Survey Design Talk

Impact of Category and Pooling across Sites

Trap Nests - California - Frankie

0

20

40

60

80

100

120

140

160

180

All Individuals >1 >5 Top 5 Abundance

CV

Site

Pooled

Note that pooling has a consistent slight positive impact on CV

Page 74: FAO Bee Survey Design Talk

Impact of Measuring Number of Occupied Cells vs Stems on CV

Trap Nests - Utah - Parker

0

20

40

60

80

100

120

140

160

180

All Individuals >1 >5 Top 5 Abundance

CV # Cells

# Stems

Note that using the number of occupied stems rather than the total number of occupied cells has a slight but consistent positive impact on CV

Page 75: FAO Bee Survey Design Talk

Impact of Pooling across sites on CV

Trap Nest Stems - Utah - Parker

0

20

40

60

80

100

120

140

160

180

All Individuals >1 >5 Top 5 Abundance

Site

Pooled

Very Interesting! In this case pooling across sites has a large positive impact on CV

Page 76: FAO Bee Survey Design Talk

Impact of Pooling From Individual Month to All Year

Bait Traps - Panama - Roubic

0

20

40

60

80

100

120

140

160

180

All Individuals >1 >5 Top 5

CV

By Month

All Year

Pooling across all the months of data Roubic’s site has a relatively large positive impact on CV

Page 77: FAO Bee Survey Design Talk

Impact of Category on CVNetting - Indiana - Jean

0

20

40

60

80

100

120

140

160

180

AllIndividuals

>1 >5 Top 5 Abundance Richness

CV Total

Page 78: FAO Bee Survey Design Talk

Impact of Category on CV

Malaise Trap - Bumblebees - Great Britain - Owen

0

20

40

60

80

100

120

140

160

180

All Individuals >1 >5 Top 5 Abundance Richness

CV

Page 79: FAO Bee Survey Design Talk

Impact of Category and Pooling across Sites on CV

Bowl - California - LeBuhn

0

20

40

60

80

100

120

140

160

180

All Individuals >1 >5 Top 5 Abundance

CV

Site

Pooled

Note the slight but relatively consistent positive impact on CV by pooling sites

Page 80: FAO Bee Survey Design Talk

CV Lessons

• Pooling across species – large gain• Pooling across time – large gain• Pooling across sites – only a small gain

– Due to high site differences?

Page 81: FAO Bee Survey Design Talk

Species by color: Yellow

Fly, 16%

Fly 1 2 3, 5%

Dolicho, 9%

Sarcophagid, 39%

Ant, 5%

Bee, 3%

Beetle, 3%

Spider, 3%

Wasp, 14%

Homopteran, 3%

Species by color: Blue

Fly, 28%

Fly 1 2 3, 12%

Dolicho, 11%Sarcophagid,

17%

Ant, 6%

Bee, 11%

Beetle, 6%

Spider, 4%

Wasp, 6%

Homopteran, 8%

Species by color: WhiteHomopteran,

2%

Wasp, 6%

Spider, 5%

Beetle, 4%

Bee, 5%

Ant, 12%

Sarcophagid, 15%

Dolicho, 14%

Fly 1 2 3, 2%

Fly, 35%

There are quite a few other taxa that end up in bowls that could be sampled.Taiwan Bowl Captures

Page 82: FAO Bee Survey Design Talk

How many sites do we need to sample and for how long?

• Key parameters are:– Degree of variability– Number of times (years) that you will sample– Effect size that you wish to detect (e.g. 5% decline

per year)

• Measures – How You Will Analyze the Data– Sign test: Number of sites that declined– Paired T-test: Magnitude of decline– Regression: Slope of decline

Page 83: FAO Bee Survey Design Talk

Warning – Statistics Ahead

• Hold on to your seats, we are going to get into some statistical issues now. You don’t have to worry about the details (unless you want to) but there are some important take home messages to, indeed, take home

• For most of you, you can skip through the following slides and get to the meat at the end

Page 84: FAO Bee Survey Design Talk

Sample Size Calculations

• We can estimate sample sizes if we plug in the various factors affecting samples sizes such as:– The time span you want to detect trends– The percent change in population you want to

detect– The alpha level you choose– The power level you choose– The type of analysis technique– The species’ CVs

Page 85: FAO Bee Survey Design Talk

We use Simulations to Estimate Samples Sizes (Really we are estimating statistical power here, but that’s a detail – Statistical power is the ability to statistically

detect a change if one were occurring)

• These simulations create mathematical populations with known declines (effect sizes)

• We choose how variable to make the simulated populations based on the CVs from real bee surveys

• Next we simulate sampling from these populations• Then we score the simulated sites for having

declined or not

Page 86: FAO Bee Survey Design Talk

Analytical Technique

• In this slide show we simulate surveys that use the Sign Test to detect changes

• If you are more of a regression kind of person you can check out similar analyses using regression at:

http://www.pwrc.usgs.gov/monmanual/samplesize.htm• The results are quite similar

Page 87: FAO Bee Survey Design Talk

Created populations with known declinesPercent of Population Remaining

For Various Percentage Annual Declines

Years

2 4 6 8 10

Per

cen

t R

em

ain

ing

0

20

40

60

80

100

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Page 88: FAO Bee Survey Design Talk

We Varied CVs, Effect sizes and Sampling Intervals

• CVs= Low (0.4-0.5), Medium (0.8-1.1) and High (1.6-1.8)

• Annual Declines = 2%, 5%, 7% and 10%• Sampling interval = every 2nd year or every

5th year

Page 89: FAO Bee Survey Design Talk

HOW MANY SAMPLES DO WE NEED TO DETECT TRENDS IN POLLINATOR POPULATIONS?

Page 90: FAO Bee Survey Design Talk

Power to Detect a Population Decline year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline 5% Annual Decline7% Annual Decline10% Annual Decline

No surprise here, its easier to detect a large decline than a small one, note that this is just a 2-year study

Page 91: FAO Bee Survey Design Talk

Power to Detect a Population Decline year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline 5% Annual Decline7% Annual Decline10% Annual Decline

EFFECTSIZE

Small decline

Big decline

Page 92: FAO Bee Survey Design Talk

Power to Detect a Population Decline year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline 5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline= 0.10, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to detect a Population Decline = 0.15, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to detect a Population Decline = 0.20, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Low CV – 2 years

Page 93: FAO Bee Survey Design Talk

Power to detect a Population Decline = 0.05, 5-year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.10, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.15, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.20, 5 -year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Low CV – 5 years

Page 94: FAO Bee Survey Design Talk

Power to Detect a Population Decline= 0.05, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline= 0.10, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.15, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.02% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.20, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Med CV - 2

Page 95: FAO Bee Survey Design Talk

Power to Detect a Population Decline = 0.05, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline 10% Annual Decline

Power to Detect a Population Decline = 0.10, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline= 0.15, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.20, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Med CV - 5

Page 96: FAO Bee Survey Design Talk

Power to Detect a Population Decline = 0.05, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.10, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.15, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.20, 2 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

High CV - 2

No surprise here, if you have high variability in your CVs you need tons of samples to detect a change

Page 97: FAO Bee Survey Design Talk

Power to Detect a Population Decline = 0.05, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.10, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.15, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.20, 5 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

High CV - 5

Page 98: FAO Bee Survey Design Talk

Power to Detect a Population Decline year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline 5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.05, 3 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

we

r

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.05, 4 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

we

r

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to detect a Population Decline = 0.05, 5-year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

wer

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.05, 7 - year study

Number of Sites Monitored

0 50 100 150 200 250 300

Po

we

r

0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Power to Detect a Population Decline = 0.05, 9 - year study

Number of Sites Monitored

0 50 100 150 200 250 300P

ow

er0.0

0.2

0.4

0.6

0.8

1.0

2% Annual Decline5% Annual Decline7% Annual Decline10% Annual Decline

Effect of Study Length on Power for Low CV

No surprise here….its easy to detect a trend over a longer period of time than a shorter one

Page 99: FAO Bee Survey Design Talk

Power results

Using the sign test, we have good power to detect even a 2% decline within 5 years across a range of CVs with only 100-300 sample sites.

We have slightly more power if we use a paired t-test.

Page 100: FAO Bee Survey Design Talk

More Lessons from Power Analyses

• If… you are interested in trends in only the common species, species richness, or total number of bees

• And… you are interested only in detecting large changes over long periods of time

• THEN: YOU NEED VERY VERY FEW SAMPLES!See next slide for more on this thought

Page 101: FAO Bee Survey Design Talk

More Thinking

• So, if you take the long view and set up monitoring programs for bees with a goal of detecting change over 10+ years then all of a sudden you need only a few samples

• Check the graph out on the next slide showing numbers needed for different year scenarios for different levels of CV

• CV makes a huge difference in the short run, but as you increase the number of years you monitor then it all converges on a lucky 13 sites (in this simulation using a regression analysis rather than sign test)

Page 102: FAO Bee Survey Design Talk
Page 103: FAO Bee Survey Design Talk

So to Summarize our Summaries

• To detect short-term changes (5 years) in bee populations you can detect global or regional changes with a network of 100-300 sampling locations

• To detect 10 year changes you can use networks of around 25

• To detect 25 year changes you can use 13 sites

Page 104: FAO Bee Survey Design Talk

The Difference Between Global, Regional, and Local Bee Sampling

• Scale doesn’t matter for the sample size estimates we just presented

• Thus the basic results would be the same for the Globe, Africa, Germany, or the U.S. State of Maryland (the nicest of all the states, by the way)

• What does differ is that the distribution of species varies and thus if you want to detect changes at the species level you will have to increase your numbers of samples regionally to make up for plots where the species doesn’t occur

• See next slide

Page 105: FAO Bee Survey Design Talk

More on That Thought

• So if you have a global network of bee surveys• You can, no problem at all, easily estimate

changes globally in the total number of bees and species richness

• But what if you wanted to estimate changes in the collective members of the genus Melitoma?

• It only occurs in the New World, hmmm

Page 106: FAO Bee Survey Design Talk

Distribution of Various Melitoma Species from www.discoverlife.org

Photo from University of Georgia

Page 107: FAO Bee Survey Design Talk

Ah….

• Then you need to proportionally increase your samples in the New World to account for the fact that Melitoma does not be occur on all of your survey sites throughout the world

• So, your decision as to what species, genera, or groupings of bees you want to survey will also influence how many samples you need simply based on their distributions and abundance

• Its your call, but just don’t forget that you can’t estimate a trend for something that isn’t there

Page 108: FAO Bee Survey Design Talk

Our Basic Sampling Plan for any Large Area (e.g., park, county, state, small country)– This

will detect a high percentage of species, detect modest declines in trends in total number of

bees, species richness, and common bee species over 10 year or greater intervals

• 25 transects• 24 pan traps per transect (8 of each color) (can

be replaced with 3 continuously run Moericke traps)

• Sample every 2 weeks• Sample every year

Page 109: FAO Bee Survey Design Talk

A Global or Continental Sampling Plan

• If changes in bee populations over 2-year intervals is important

• Large changes in total bee numbers or species richness could be detected with only 50-100 sampling locations

• Increasing this to 300 locations will allow greater regional assessments and more power to detect changes at the genus and species level

• If detecting short-term changes are less important then you can go for few sites

Page 110: FAO Bee Survey Design Talk

Where to Sample – Things to Consider in Terms of What you want to Talk

About• Do you want to talk about the entire globe,

state, or park?• Or do you want to talk about just some

portion of it (agricultural areas, cotton plantings, natural areas, national parks, roadsides)?

• Where you sample determines what kinds of statements you can make

Page 111: FAO Bee Survey Design Talk

Sampling: Random, Systematic, Chosen

• Random sampling – Classical way to choose where to sample

• Systematic – For natural communities usually a better way to place samples due to non-randomness of habitats and populations

• Chosen – You can pick and choose where to sample but if you do that then you can ONLY talk about those sites and not extrapolate to ANYWHERE else

Page 112: FAO Bee Survey Design Talk

What to count

• Minimum: Numbers of bees, wasps, flies without respect to species

• Or…You can ID bees to genus, morpho-species, species, sex

• A lot will depends on time, resources, availability of identification expertise

Page 113: FAO Bee Survey Design Talk

Specimen Processing

• Batch processing • Dry specimens• Store in bulk containers (e.g., petri dishes) by

sample location/date• Pin representative collection

– Rest remain unpinned

• Store in climate controlled environment – humidity is a problem, check for bugs

Page 114: FAO Bee Survey Design Talk

You can Analyze Monitoring Data in Many Ways

• Non-parametric sign test or Binomial test• Paired t-test• Simple Regression• Route Regression• Estimating Equations• Site Occupancy Models• Bayesian Approaches• Etc.

Page 115: FAO Bee Survey Design Talk

What You Will Get

• With 100 or more sites sampled, in 5 years (preferably 10), you will have the ability to detect 5% declines in some individual species, species richness and abundance

• With 25 sites sampled, you will be able to detect 5% declines in 10-25 years