-
Notifications
You must be signed in to change notification settings - Fork 6
/
Copy pathg_withinpop.Rmd
694 lines (441 loc) · 47.7 KB
/
g_withinpop.Rmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
---
title: What are the costs and constraints of behavioral flexibility in great-tailed grackles?
author: '[Logan CJ](http://CorinaLogan.com) (Max Planck Institute for Evolutionary Anthropology, MPI EVA, corina_logan@eva.mpg.de), Rowney C (MPI EVA), Bergeron L (University of California Santa Barbara, UCSB), McCune KB (UCSB), MacPherson M (UCSB), Bond A (Arizona State University), [Blackwell A](http://www.anth.ucsb.edu/faculty/blackwell/) (University of California, Santa Barbara / Washington State University), [Escalante A](http://igem.temple.edu/people/person/c0ca56d9e60be58ca9380514ed8ac51d) (Temple University), [Pacheco M](http://igem.temple.edu/people/person/6417596d4976b9cbfa2a5ba8062ed7b9) (Temple University), [Lukas D](http://dieterlukas.strikingly.com) (MPI EVA), [Wascher C](https://www.claudiawascher.com) (Anglia Ruskin University)'
date: '`r Sys.Date()`'
output:
html_document:
toc: true
toc_depth: 4
toc_float:
collapsed: false
code_folding: hide
md_document:
toc: true
pdf_document:
keep_tex: yes
latex_engine: xelatex
github_document:
toc: true
bibliography: /Users/corina/GitHub/grackles/Files/MyLibrary.bib
---
```{r setup, include=FALSE}
knitr::opts_chunk$set(echo = TRUE)
```
```{r}
#Make code wrap text so it doesn't go off the page when Knitting to PDF
library(knitr)
opts_chunk$set(tidy.opts=list(width.cutoff=60),tidy=TRUE)
```
***Click [here](https://github.com/corinalogan/grackles/blob/master/README.md) to navigate to the version-tracked reproducible manuscript (.Rmd file)***
###A. STATE OF THE DATA
This preregistration was written prior to collecting any data (note the behavioral data are covered by separate preregistrations: [flexibility](http://corinalogan.com/Preregistrations/g_flexmanip.html), [causal cognition](http://corinalogan.com/Preregistrations/g_causal.html), and [foraging](http://corinalogan.com/Preregistrations/g_flexforaging.html)). Hypotheses H7 and H8 were added along with a new collaborator (Dieter Lukas) and intestinal parasites were added to H5 along with a new collaborator (Claudia Wascher) after 18 blood samples had been collected.
###B. PARTITIONING THE RESULTS
We may publish the results from each hypothesis separately.
###C. HYPOTHESES
The way we define flexibility (individuals change behavior according to changing circumstances using learning from previous experiences) assumes that being flexible will always be associated with the higher fitness payoff (e.g., higher quality food rewards). Therefore, the reasons individuals might not be flexible are 1) there are indirect costs to flexibility (e.g., exploration, risks involved in uncertain choices), 2) individuals live in environments that rarely change or change randomly, or 3) individuals have internal constraints (e.g., not enough energy). Points [1](http://corinalogan.com/Preregistrations/g_exploration.html) and [2](http://corinalogan.com/Preregistrations/g_expansion.html) are being tested in different preregistrations. Here we test point 3.
#### H1: Behavioral flexibility and cognitive performance on other tests negatively correlates with mounting a stress response (in response to being captured) because all three variables are energetically costly.
**Prediction 1:** Individuals with higher serum glucocorticoid concentrations at the time of capture will perform more poorly in causal inference experiments (see [causal cognition preregistration](http://corinalogan.com/Preregistrations/g_causal.html)), solve fewer loci and switch between loci slower on the multi-access box, and require more trials to reverse preferences (see [flexibility preregistration](http://corinalogan.com/Preregistrations/g_flexmanip.html)).
**P1 alternative 1:** If flexibility positively correlates with serum glucocorticoid concentrations at the time of capture, this could be due to 1) the more dominant individuals incurring higher stress levels to maintain dominance, if the more dominant individuals are also more flexible; or 2) the more flexible individuals access higher quality resources and thus have more energy to mount a stress response.
**P1 alternative 2:** If flexibility and cognitive performance do not correlate with serum glucocorticoid concentrations at the time of capture, this indicates these traits are independent from each other or that they are related to another variable that was not measured.
#### H2: Behavioral flexibility and cognitive performance on other tests positively correlates with testosterone levels, as is found in other species (humans: @janowsky1994testosterone, @trumble2015testosterone; birds: @thompson2010neuroprotective).
**P2:** Individuals with higher circulating testosterone will perform better in causal inference experiments (see [causal cognition preregistration](http://corinalogan.com/Preregistrations/g_causal.html)), solve more loci and switch between loci faster on the multi-access box, and require fewer trials to reverse preferences (see [flexibility preregistration](http://corinalogan.com/Preregistrations/g_flexmanip.html)) because testosterone might have a neuroprotective effect (e.g., @thompson2010neuroprotective), and higher levels of testosterone indicate better energetic condition.
**P2 alternative 1a:** If flexibility and cognitive performance are negatively correlated with testosterone, this might indicate a potential indirect link with immune function, which negatively correlates with testosterone levels (@janowsky1994testosterone, @thompson2010neuroprotective, @trumble2015testosterone). If testosterone negatively correlates with immune function and immune function positively correlates with flexibility/cognition, then testosterone will negatively correlate with flexibility/cognition.
**P2 alternative 1b:** If flexibility negatively correlates with testosterone, but not other measures of condition, this might indicate that birds with higher testosterone are more invested in mating/competing, at a cost to flexibility and innovation. It may be that the less dominant birds have a greater need for flexibility due to their poorer ability to compete behaviorally with conspecifics.
**P2 alternative 2:** If flexibility and cognitive performance are not correlated with testosterone, this indicates these traits are independent from each other or that they are related to another variable that was not measured.
#### H3.1: There will be a negative correlation between behavioral flexibility and immune activation as a marker of poor condition.
**P3:** Individuals that are faster to reverse preferences (reversal learning) and switch to solving new options (multi-access box) (see [flexibility preregistration](http://corinalogan.com/Preregistrations/g_flexmanip.html)) will have lower total heterophil counts and lower levels of gene expression for inflammatory cytokines, due to their lower investment in actively fighting infections, leaving greater energy for cognitive resources such as flexibility.
**P3 alternative 1:** If no correlation is found, it is possible that this trade off is masked by a positive correlation between flexibility and testosterone (see H2; as in @janowsky1994testosterone, @thompson2010neuroprotective, @trumble2015testosterone).
**P3 alternative 2:** If a positive correlation is found, this indicates that 1) there could be a threshold level of health (immune function) above which flexibility is promoted, or 2) flexibility is positively correlated with encountering more parasites, which increase the immune response.
#### H3.2: Individuals that are less [neophilic](http://corinalogan.com/Preregistrations/g_exploration.html) will have higher immune activation and more immunosuppression.
**P4:** Individuals with elevated heterophils and inflammatory gene expression (immune activation) will avoid novel stimuli, due to the potential cost of exposure to novel parasites/pathogens. Similarly, individuals with low lymphocytes and low total leukocytes (which may indicate immunosuppression) may avoid novel pathogens.
**P4 alternative 1:** Alternatively, elevated heterophils and inflammatory cytokines may be protective against novel infections, rather than representing current infection. In this case they might be positively associated with neophilia.
**P4 alternative 2:** It is possible that neophilia increases exposure and thus leads to elevated heterophils and inflammation, thus the behavioral trait might cause the immune status. If this is supported, we expect other markers of infection to also positively associate with neophilia.
#### H3.3: There will be a positive correlation between flexibility and markers of basal immunity.
**P5:** We expect elevated lymphocytes, anti-inflammatory, and Th2 related gene expression (markers of basal immunity) to correlate with an increased ability to resist infection, and thus a greater capacity to invest in cognitively demanding tasks such as behavioral flexibility.
**P5 alternative 1:** Markers of basal immunity may be costly to maintain, and so may trade-off against costly cognitive abilities. However, such trade-offs may only be detectable after controlling for general markers of condition (see H4).
**P5 alternative 2:** There may be no correlation between immunity and flexibility at the individual level. They may simply be separate traits that assort independently.
#### H3.4: There will be a positive correlation between neophilia and markers of basal immunity
**P6:** We expect elevated lymphocytes, anti-inflammatory, and Th2 related gene expression (markers of basal immunity) to correlate with an increased ability to resist infection, and thus lower the cost of neophilia, resulting in greater neophilia.
**P6 alternative 1:** Markers of basal immunity may be costly to maintain and may indicate that an individual already has more available resources, thus lowering the need to seek new resources by investigating novel stimuli. If this is supported, we expect these individuals to already be in good condition (see H4).
**P6 alternative 2:** There may be no correlation between immunity and neophilia at the individual level. They may simply be separate traits that assort independently.
#### H4: Individuals that are more behaviorally flexible are in better condition (an indicator of available energy).
**P7:** A larger body size (heavier with longer tarsi, tails, and wings, higher hematocrit, higher red blood cell counts, and higher testosterone) will indicate better condition, and these individuals will be more flexible because they are less energetically constrained.
**P7 alternative 1:** If body size and flexibility negatively correlate, flexibility might relate less with condition and be used more as a strategy for competing with dominant conspecifics (thus investing more energy in competing rather than in flexibility).
**P7 alternative 2:** If body size and flexibility are not correlated, this indicates these traits are independent from each other or that they are related to another variable that was not measured.
#### H5: Individuals that are more behaviorally flexible have lower endoparasite loads (and thus a stronger immune system and more available energy).
**P8:** The more flexible individuals (on the multi-access box and in reversal learning) will have fewer haemosporidian parasite counts, lower haemosporidian parasite species diversity, and fewer fecal egg counts (an estimate of intestinal parasite load). We expect an individual’s physiological stress response (H1), immune system (H3), and condition (H3 and H4) to influence each other. Given that we do not yet know how these systems interact in great-tailed grackles, we expect that the flexible individuals will be less stressed and therefore ultimately in better condition. Regarding intestinal parasites, we expect individuals to be infected with a variety of nematode, coccidian and cestode species, most of which are directly transmitted via the fecal-oral route or via an intermediate host (e.g., earthworms, slugs). All individuals in a population are expected to be exposed to parasites in a similar way, but the more flexible individuals are expected be better able to cope with sources of stress (e.g., social stress) and therefore have a stronger immune system.
**P8 alternative 1:** If there is a positive relationship between flexibility and parasite loads (haemosporidian and/or intestinal), this could be because the more flexible individuals 1) eat a wider range of foods (see [foraging preregistration](http://corinalogan.com/Preregistrations/g_flexforaging.html)) and roam a larger geographic area and are thus exposed to more parasites, and/or 2) might be in poorer energetic condition and more susceptible to hosting more species.
**P8 alternative 2:** If there is no correlation between flexibility and parasite loads, this could indicate that these variables are independent from each other or that they are related to another variable that was not measured.
#### H6: Individuals that are more behaviorally flexible have microbiomes with higher species diversity, which could facilitate the digestion of diverse foods and the adaptation to new parasites/bacteria (@alberdi2016vertebrate).
**P9:** The more flexible individuals will have a larger number of species in their microbiome, which could facilitate the digestion of novel foods and the adaptation to new parasites/bacteria.
**P9 alternative 1:** There is no difference in the number of species in the grackle microbiome in relation to flexibility, potentially because 1) there is little between individual variation in the number of microbiome species each grackle hosts which could be due to their exploiting similar food sources, and/or 2) these variables are independent from each other or are related to another variable that was not measured.
**P9 alternative 2** The more flexible individuals will host fewer microbiome species, potentially because they exploit different food sources than the less flexible individuals.
#### H7: Individuals that are more behaviorally flexible mate with individuals that are more flexible.
**P10:** The more flexible individuals will mate with individuals that are also more flexible, potentially because flexible individuals use different parts of the habitat and are therefore more likely to encounter each other. Flexibility will be measured in a separate [preregistration](http://corinalogan.com/Preregistrations/g_flexmanip.html) and mate choice will be determined by genetically identifying the parents of offspring using ddRADseq.
**P10 alternative:** Traits other than flexibility determine who individuals mate with, for example, all females (not only the flexible ones) might choose males with longer tail feathers [@johnson2000male], larger body sizes [@johnson2000male], and/or specific territories.
#### H8: Individuals that are more behaviorally flexible have different fitness outcomes than the less flexible individuals. The following predictions are independent of each other and could indicate trade offs (i.e., there might be a positive association between flexibility and one fitness component, and a negative association with a different fitness component).
Flexibility will be measured in a separate [preregistration](http://corinalogan.com/Preregistrations/g_flexmanip.html), maternity and paternity will be identified using ddRADseq, maternity will also be inferred using behavioral observations during the breeding season.
The fitness components we will measure are:
- Females: number of eggs in the nest, number of nestlings, number of fledglings surviving to independence, number of offspring that survive to adulthood (1 year of age), adult survival between years, breeding probability in a given year.
- Males: number of juveniles sired, number of offspring that survive to adulthood (1 year of age), adult survival between years, territory holder (yes, no) in a given year, number of females in their territory.
**P11** Roaming males have lower fitness (number of offspring sired) than territory-holding males [@johnson2000male]. If this relationship holds for the populations in our investigation, then we will further investigate whether flexibility is related to male territory-holding (P11a,b, P12a,b).
**P11a:** The territory-holding males during the breeding season will be more flexible and have higher paternity rates [@johnson2000male] than roaming males. Territory-holding males might be better at 1) identifying better breeding habitats and/or 2) allying with other males to hold these territories. Territory-holding males will be identified using behavioral observations.
**P11a alternative:** The roaming males during the breeding season will be more flexible and have lower paternity rates [@johnson2000male] than territory-holding males. Roaming males must sneak copulations with females who nest within another male's territory, which could select for an increase in flexible behavior.
**P11b:** The more flexible territory-holding males will have higher paternity rates and number of females nesting in their territories, than the less flexible territory-holding males. The more flexible territory-holding males might be better at 1) identifying better breeding habitats and/or 2) allying with other males to hold these territories.
**P11b alternative:** The more flexible territory-holding males will not have higher paternity rates and number of females nesting in their territories, than the less flexible territory-holding males potentially because body size or other variables might play a larger role [@johnson2000male].
**P12:** The more flexible females will be better at keeping offspring alive either to the fledgling stage or to independence. Offspring survival will be measured through maternity identification of offspring who survived past one year of age.
**P12 alternative:** The more flexible females will not be better at keeping offspring alive, potentially because flexibility might be used for foraging and not in other contexts or, although there is variation in flexibility, the environment is more stable and flexibility does not ultimately offer an advantage.
**P13:** The more flexible individuals have higher survival between years potentially because they are better at coping with environmental change.
**P13 alternative 1:** The more flexible individuals have lower survival between years potentially because they encounter more risks.
**P13 alternative 2:** The more flexible individuals are not different in survival between years potentially because other variables are more strongly related to survival (e.g., immunity, parasite loads, etc.). The link between survival and flexibility is also under investigation in the [between population](http://corinalogan.com/Preregistrations/g_expansion.html) preregistration.
**P14** The more flexible females will have a larger number of eggs and nestlings per breeding attempt, and have a higher breeding probability in a given year, potentially because they are in better condition.
**P14 alternative 1** The more flexible females will have a smaller number of eggs and nestlings per breeding attempt, and have a lower breeding probability in a given year, potentially because they are in worse condition.
**P14 alternative 2** There is no correlation between female flexibility and the number of eggs and nestlings per breeding attempt, and breeding probability in a given year, potentially because flexibility is not associated with condition.
###D. METHODS
####**Planned sample**
Great-tailed grackles (n > 200) will be caught in the wild at three field sites across their geographic range: the center of their original range (at a site to be determined in Central America), the middle of the northward expanding edge (Tempe, Arizona USA), and on the northern expanding edge (to be determined). Individuals will be identified using colored leg bands in unique combinations, their data collected (blood, feathers, and biometrics), and then they will be released back to the wild. Some individuals (60-100) will be brought temporarily into aviaries for behavioral testing, and then they will be released back to the wild.
####**Sample size rationale**
We will band as many birds as possible throughout the year, and conduct behavioral tests in aviaries (during the non-breeding seasons approximately September through March) and in the wild (year-round) on as many birds as we can at each field site. The minimum sample size will be 200 banded birds and 60 behavior-tested birds in total, however we expect to be able to sample many more.
####**Data collection stopping rule**
We will stop collecting data in April 2023 when the current funding ends, or after data have been collected at all three field sites, whichever date comes first.
####**Randomization and counterbalancing**
No randomization or counterbalancing is involved in this study.
####**Blinding of conditions during analysis**
No blinding is involved in this study.
####**Dependent variables**
####*P1-P15*
1) Flexibility 1: **Number of trials to reverse** a preference in the last reversal an individual experienced (reversal learning; an individual is considered to have a preference if it chose the rewarded option at least 17 out of the most recent 20 trials, with a minimum of 8 or 9 correct choices out of 10 on the two most recent sets of 10 trials). See behavioral flexibility [preregistration](http://corinalogan.com/Preregistrations/g_flexmanip.html).
2) Flexibility 3: If the number of trials to reverse a preference does not positively correlate with the latency to attempt or solve new loci on the multi-access box (an additional measure of behavioral flexibility), then the **average latency to solve** and the **average latency to attempt** a new option on the multi-access box will be additional dependent variables. See behavioral flexibility [preregistration](http://corinalogan.com/Preregistrations/g_flexmanip.html).
One model will be run per dependent variable.
####*H3.2 and H3.4: neophilia and immunity*
Neophilia: Latency to land on the table next to an object (novel, familiar) (that does not contain food) in a familiar environment (that contains maintenance diet away from the object) - OR - latency to touch an object (novel, familiar) (choose the variable with the most data)
####*P1 alternative 1: stress and dominance*
Dominance rank
####*P7 alternative 1: condition and dominance*
Dominance rank
####*P8 alternative 1: haemosporidian parasites and foods eaten*
Number of different food items eaten
####*P10: assortative mating*
Flexibility of females (flexibility measures 1, 2, and 3)
####*P11: territory-holding males higher fitness than roaming*
Number of offspring sired
####*P11a: territory-holding males more flexible than roaming*
Territory-holding (yes, no)
####*P11b: territory-holding males more flexible than roaming*
Number of offspring per territory-holder
####*P12: female flexibility and offspring survival*
Number of fledglings
Number of offspring surviving past 1 year of age
####*P13: flexibility and adult survival*
Probability of resighting an individual in multiple years
####*P14: female flexibility and eggs, nestlings, breeding probability*
Number of eggs in the nest
Number of nestlings
Breeding probability in a given year
####**Independent variables**
####*P1-P9*
1) P1 stress: serum glucocorticoid concentration
2) P2: testosterone concentration (note: also a measure of condition [P7])
3) P3 and P4 immunity: heterophil counts
4) P3 and P4 immunity: inflammatory gene expression
5) P5 and P6 immunity: total leucocyte counts
6) P5 and P6 immunity: total lymphocyte counts
7) P5 and P6 immunity: anti-inflammatory and Th2 gene expression
8) P7 condition: hematocrit
9) P7 condition: red blood cell counts
10) P7 condition: body weight (wild)
11) P7 condition: tarsus length (average left and right legs)
12) P7 condition: tail length (average left and right central retrices)
13) P7 condition: wing length (average left and right wing chords)
14) P8 parasites: number of parasites (haemosporidian and inetestinal) per grackle
15) P8 parasites: number of parasites species per grackle
16) P9 microbiome: number of microbiome species per grackle
17) Population (as a random effect to examine within population variation)
####*P1 alternative 1: stress and dominance*
1) Serum glucocorticoid concentration
2) Flexibility 1: Number of trials to reverse last preference (see above)
3) Population (as a random effect to examine within population variation)
####*P7 alternative 1: condition and dominance*
1) Condition: body weight (wild)
2) Condition: tarsus length (average left and right legs)
3) Condition: tail length (average left and right central retrices)
4) Condition: wing length (average left and right wing chords)
5) Condition: hematocrit
6) Condition: red blood cell counts
7) Condition: testosterone concentration
8) Flexibility 1: Number of trials to reverse last preference (see above)
9) Population (as a random effect to examine within population variation)
####*P8 alternative 1: parasites and foods eaten*
1) Parasites: number of haemosporidian parasites per sample
2) Parasites: number of haemosporidian parasites species per sample
3) Parasites: number of intestinal parasite eggs and oocysts per sample
4) Flexibility 1: Number of trials to reverse last preference (see above)
5) Population (as a random effect to examine within population variation)
####*P10: assortative mating*
1) Flexibility 1 of mate
2) Flexibility 3 of mate
####*P11: territory-holding males higher fitness than roaming*
1) Territory-holding (yes, no)
####*P11a-P14:*
1) Flexibility 1
2) Flexibility 3
###E. ANALYSIS PLAN
We do not plan to **exclude** any data. When **missing data** occur, the existing data for that individual will be included in the analyses for the tests they completed. Analyses will be conducted in R (current version `r getRversion()`; @rcoreteam). We will analyze data for females and males separately because each sex has a distinct natural history (@johnson2001great).
####*Data checking*
The data will be visually checked to determine whether they are normally distributed via two methods: 1) normality is indicated when the histograms of actual data match those with simulated data (Figure 2), and 2) normality is indicated when the residuals closely fit the dotted line in the Normal Q-Q plot (Figure 3) [@zuur2009].
```{r dist_checkHistQQ, eval=FALSE, warning=FALSE, results='asis', echo=TRUE, fig.cap="**Figure 2.** Part 1. The distribution of the actual data versus what a normal distribution would look like with simulated data. Part 2. Residuals vs fitted: checking for homogeneity, which is satisfied if residuals have an even spread across the x-axis; Normal Q-Q: residuals are normally distributed if they are on the diagonal line; Residuals vs leverage: Cook's distance <1 means no influential observations [@zuur2009]."}
main <- read.csv ("/Users/corina/GTGR/data/data_pop.csv", header=T, sep=",", stringsAsFactors=F)
#Separate the sexes
fem <- main[main$Sex=="f",]
mal <- main[main$Sex=="m",]
#Check the dependent variables for normality: Histograms
#females
op <- par(mfrow=c(2,5), mar=c(4,4,2,0.2))
#This is what the distribution of actual data looks like
hist(fem$TrialsToReverseLast, xlab="Flexibility: Trials to reverse", main="Actual Data (females)")
hist(fem$DominanceRank, xlab="Dominance rank", main="Actual Data (females)")
hist(fem$NumberFoodsEaten, xlab="Number of foods eaten/individual", main="Actual Data (females)")
hist(fem$Neophilia, xlab="Neophilia (latency)", main="Actual Data (females)")
#Given the actual data, this is what a normal distribution would look like
W2 <- rnorm(1281, mean=mean(fem$TrialsToReverseLast), sd=sd(fem$TrialsToReverseLast))
hist(W2, xlab="Flexibility: Trials to reverse (females)", main="Simulated Data")
Y2 <- rnorm(1281, mean=mean(fem$DominanceRank), sd=sd(fem$DominanceRank))
hist(Y2, xlab="Dominance rank (females)", main="Simulated Data")
Z2 <- rnorm(1281, mean=mean(fem$NumberFoodsEaten), sd=sd(fem$NumberFoodsEaten))
hist(Z2, xlab="Number of foods eaten/individual (females)", main="Simulated Data")
V2 <- rnorm(1281, mean=mean(fem$Neophilia), sd=sd(fem$Neophilia))
hist(V2, xlab="Neophilia latency (females)", main="Simulated Data")
#Check the dependent variables for normality: Q-Q plots (females)
op <- par(mfrow=c(4,4), mar=c(4,4,2,0.2))
plot(glm(fem$TrialsToReverseLast~fem$Cort))
plot(glm(fem$DominanceRank~fem$Cort))
plot(glm(fem$NumberFoodsEaten~fem$NumberParasites))
plot(glm(fem$Neophilia~fem$Cort))
#males
op <- par(mfrow=c(2,5), mar=c(4,4,2,0.2))
#This is what the distribution of actual data looks like
hist(mal$TrialsToReverseLast, xlab="Flexibility: Trials to reverse", main="Actual Data (males)")
hist(mal$DominanceRank, xlab="Dominance rank", main="Actual Data (males)")
hist(mal$NumberFoodsEaten, xlab="Number of foods eaten/individual", main="Actual Data (males)")
hist(mal$Neophilia, xlab="Neophilia (latency)", main="Actual Data (males)")
#Given the actual data, this is what a normal distribution would look like
A2 <- rnorm(1281, mean=mean(mal$TrialsToReverseLast), sd=sd(mal$TrialsToReverseLast))
hist(A2, xlab="Flexibility: Trials to reverse (males)", main="Simulated Data")
C2 <- rnorm(1281, mean=mean(mal$DominanceRank), sd=sd(mal$DominanceRank))
hist(C2, xlab="Dominance rank (males)", main="Simulated Data")
D2 <- rnorm(1281, mean=mean(mal$NumberFoodsEaten), sd=sd(mal$NumberFoodsEaten))
hist(D2, xlab="Number of foods eaten/individual (males)", main="Simulated Data")
E2 <- rnorm(1281, mean=mean(mal$Neophilia), sd=sd(mal$Neophilia))
hist(D2, xlab="Neophilia latency (males)", main="Simulated Data")
#Check the dependent variables for normality: Q-Q plots (males)
op <- par(mfrow=c(4,4), mar=c(4,4,2,0.2))
plot(glm(mal$TrialsToReverseLast~mal$Cort))
plot(glm(mal$DominanceRank~mal$Cort))
plot(glm(mal$NumberFoodsEaten~mal$NumberParasites))
plot(glm(mal$Neophilia~mal$Cort))
```
If the data do not appear normally distributed, visually check the residuals. If they are patternless, then assume a normal distribution (Figure 4) [@zuur2009].
```{r dist_checkResid, eval=FALSE, warning=FALSE, results='asis', echo=TRUE, fig.cap="**Figure 4.** Visual check of the residuals."}
#Check the dependent variables for normality: Residuals
main <- read.csv ("/Users/corina/GTGR/data/data_pop.csv", header=T, sep=",", stringsAsFactors=F)
#Separate the sexes
fem <- main[main$Sex=="f",]
mal <- main[main$Sex=="m",]
#Figure 3. Visual check of the residuals
#females
op <- par(mfrow=c(2,2), mar=c(4,4,2,0.2))
plot(residuals(glm(fem$TrialsToReverseLast~fem$Cort)), ylab="Flexibility residuals: trials to reverse ~ cort")
plot(residuals(glm(fem$DominanceRank~fem$Cort)), ylab="Residuals: dominance rank ~ cort")
plot(residuals(glm(fem$NumberFoodsEaten~fem$NumberParasites)), ylab="Residuals: foods eaten ~ number of parasites")
plot(residuals(glm(fem$Neophilia~fem$Cort)), ylab="Residuals: neophilia ~ cort")
#males
op <- par(mfrow=c(2,2), mar=c(4,4,2,0.2))
plot(residuals(glm(mal$TrialsToReverseLast~mal$Cort)), ylab="Flexibility residuals: trials to reverse ~ cort")
plot(residuals(glm(mal$DominanceRank~mal$Cort)), ylab="Residuals: dominance rank ~ cort")
plot(residuals(glm(mal$NumberFoodsEaten~mal$NumberParasites)), ylab="Residuals: foods eaten ~ number of parasites")
plot(residuals(glm(mal$Neophilia~mal$Cort)), ylab="Residuals: neophilia ~ cort")
```
####*P1, P3, P5, P8: flexibility trade offs*
**Analysis:** Because the independent variables could influence each other, we will analyze them in a single model: Generalized Linear Mixed Model (GLMM; MCMCglmm function, MCMCglmm package; [@hadfield2010mcmc]) with a Poisson distribution and log link using 130,000 iterations with a thinning interval of 10, a burnin of 30,000, and minimal priors (V=1, nu=0) [@hadfield2014coursenotes]. We will ensure the GLMM shows acceptable convergence (lag time autocorrelation values <0.01; [@hadfield2010mcmc]), and adjust parameters if necessary to meet this criterion. The contribution of each independent variable will be evaluated using the Estimate in the full model.
To be able to detect trade offs, we need to control for condition, therefore we chose the average tarsus length as the representative measure of condition (a random effect).
```{r p1358, eval=FALSE, warning=FALSE, results='asis', echo=TRUE, include=TRUE}
main <- read.csv ("/Users/corina/GTGR/data/data_pop.csv", header=T, sep=",", stringsAsFactors=F)
#GLMM
library(MCMCglmm)
prior = list(R=list(R1=list(V=1,nu=0),R2=list(V=1,nu=0),R3=list(V=1,nu=0),R4=list(V=1,nu=0),R5=list(V=1,nu=0),R6=list(V=1,nu=0),R7=list(V=1,nu=0),R8=list(V=1,nu=0),R9=list(V=1,nu=0)), G=list(G1=list(V=1,nu=0),G2=list(V=1,nu=0)))
#Separate the sexes
fem <- main[main$Sex=="f",]
mal <- main[main$Sex=="m",]
#GLMM with response variable = trials to reverse the last preference
#females
f1 <- MCMCglmm(TrialsToReverseLast ~ Cort + NumberHeterophil + NumberLymphocytes + InflammatoryGene + NumberLeucocytes + AntiInflammatoryGene + Th2Gene + NumberParasites + NumberParasiteSpecies, random=~Population+AvgTarsusLength, family="poisson", data=fem, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(f1)
#autocorr(f1$Sol) #Did fixed effects converge?
#autocorr(f1$VCV) #Did random effects converge?
#males
m1 <- MCMCglmm(TrialsToReverseLast ~ Cort + NumberHeterophil + NumberLymphocytes + InflammatoryGene + NumberLeucocytes + AntiInflammatoryGene + Th2Gene + NumberParasites + NumberParasiteSpecies, random=~Population+AvgTarsusLength, family="poisson", data=mal, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(m1)
#autocorr(m1$Sol) #Did fixed effects converge?
#autocorr(m1$VCV) #Did random effects converge?
#GLMM with response variable = flexibility ratio
#females
f2 <- MCMCglmm(TrialsToReverseLast ~ Cort + NumberHeterophil + NumberLymphocytes + InflammatoryGene + NumberLeucocytes + AntiInflammatoryGene + Th2Gene + NumberParasites + NumberParasiteSpecies, random=~Population+AvgTarsusLength, family="poisson", data=fem, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(f2)
#autocorr(f2$Sol) #Did fixed effects converge?
#autocorr(f2$VCV) #Did random effects converge?
#males
m2 <- MCMCglmm(TrialsToReverseLast ~ Cort + NumberHeterophil + NumberLymphocytes + InflammatoryGene + NumberLeucocytes + AntiInflammatoryGene + Th2Gene + NumberParasites + NumberParasiteSpecies, random=~Population+AvgTarsusLength, family="poisson", data=mal, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(m2)
#autocorr(m2$Sol) #Did fixed effects converge?
#autocorr(m2$VCV) #Did random effects converge?
```
####*P4 and P6: neophilia and immunity*
**Analysis:** Because the independent variables could influence each other, we will analyze them in a single model: Generalized Linear Mixed Model (GLMM; MCMCglmm function, MCMCglmm package; [@hadfield2010mcmc]) with a Poisson distribution and log link using 130,000 iterations with a thinning interval of 10, a burnin of 30,000, and minimal priors (V=1, nu=0) [@hadfield2014coursenotes]. We will ensure the GLMM shows acceptable convergence (lag time autocorrelation values <0.01; [@hadfield2010mcmc]), and adjust parameters if necessary to meet this criterion. The contribution of each independent variable will be evaluated using the Estimate in the full model.
To be able to detect trade offs, we need to control for condition, therefore we chose the average tarsus length as the representative measure of condition (a random effect).
```{r p46neophilia, eval=FALSE, warning=FALSE, results='asis', echo=TRUE, include=TRUE}
main <- read.csv ("/Users/corina/GTGR/data/data_pop.csv", header=T, sep=",", stringsAsFactors=F)
#GLMM
library(MCMCglmm)
prior = list(R=list(R1=list(V=1,nu=0),R2=list(V=1,nu=0),R3=list(V=1,nu=0),R4=list(V=1,nu=0),R5=list(V=1,nu=0),R6=list(V=1,nu=0)), G=list(G1=list(V=1,nu=0),G2=list(V=1,nu=0)))
#Separate the sexes
fem <- main[main$Sex=="f",]
mal <- main[main$Sex=="m",]
#GLMM with response variable = neophilia (latency)
#females
f1 <- MCMCglmm(Neophilia ~ NumberHeterophil + NumberLymphocytes + InflammatoryGene + NumberLeucocytes + AntiInflammatoryGene + Th2Gene, random=~Population+AvgTarsusLength, family="poisson", data=fem, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(f1)
#autocorr(f1$Sol) #Did fixed effects converge?
#autocorr(f1$VCV) #Did random effects converge?
#males
m1 <- MCMCglmm(Neophilia ~ NumberHeterophil + NumberLymphocytes + InflammatoryGene + NumberLeucocytes + AntiInflammatoryGene + Th2Gene, random=~Population+AvgTarsusLength, family="poisson", data=mal, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(m1)
#autocorr(m1$Sol) #Did fixed effects converge?
#autocorr(m1$VCV) #Did random effects converge?
```
####*P2, P7, P9: flexibility vs testosterone/condition*
**Analysis:** Because the independent variables could influence each other, we will analyze them in a single model: Generalized Linear Mixed Model (GLMM; MCMCglmm function, MCMCglmm package; [@hadfield2010mcmc]) with a Poisson distribution and log link using 130,000 iterations with a thinning interval of 10, a burnin of 30,000, and minimal priors (V=1, nu=0) [@hadfield2014coursenotes]. We will ensure the GLMM shows acceptable convergence (lag time autocorrelation values <0.01; [@hadfield2010mcmc]), and adjust parameters if necessary to meet this criterion. The contribution of each independent variable will be evaluated using the Estimate in the full model.
```{r p279, eval=FALSE, warning=FALSE, results='asis', echo=TRUE, include=TRUE}
main <- read.csv ("/Users/corina/GTGR/data/data_pop.csv", header=T, sep=",", stringsAsFactors=F)
#GLMM
library(MCMCglmm)
prior = list(R=list(R1=list(V=1,nu=0),R2=list(V=1,nu=0),R3=list(V=1,nu=0),R4=list(V=1,nu=0),R5=list(V=1,nu=0),R6=list(V=1,nu=0),R7=list(V=1,nu=0),R8=list(V=1,nu=0)), G=list(G1=list(V=1,nu=0)))
#Separate the sexes
fem <- main[main$Sex=="f",]
mal <- main[main$Sex=="m",]
#GLMM with response variable = trials to reverse the last preference
#females
f1 <- MCMCglmm(TrialsToReverseLast ~ Testosterone + Hematocrit + NumberRedBloodCells + Weight + AvgTarsusLength + AvgTailLength + AvgWingLength + NumberMicrobiomeSpecies, random=~Population, family="poisson", data=fem, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(f1)
#autocorr(f1$Sol) #Did fixed effects converge?
#autocorr(f1$VCV) #Did random effects converge?
#males
m1 <- MCMCglmm(TrialsToReverseLast ~ Testosterone + Hematocrit + NumberRedBloodCells + Weight + AvgTarsusLength + AvgTailLength + AvgWingLength + NumberMicrobiomeSpecies, random=~Population, family="poisson", data=mal, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(m1)
#autocorr(m1$Sol) #Did fixed effects converge?
#autocorr(m1$VCV) #Did random effects converge?
```
####*P1 alternative 1: stress and dominance*
**Analysis:** We will conduct the analysis using a Generalized Linear Mixed Model (GLMM; MCMCglmm function, MCMCglmm package; [@hadfield2010mcmc]) with a Poisson distribution and log link using 130,000 iterations with a thinning interval of 10, a burnin of 30,000, and minimal priors (V=1, nu=0) [@hadfield2014coursenotes]. We will ensure the GLMM shows acceptable convergence (lag time autocorrelation values <0.01; [@hadfield2010mcmc]), and adjust parameters if necessary to meet this criterion. The contribution of each independent variable will be evaluated using the Estimate in the full model.
```{r stressdominance, eval=FALSE, warning=FALSE, results='asis', echo=TRUE, include=TRUE}
main <- read.csv ("/Users/corina/GTGR/data/data_pop.csv", header=T, sep=",", stringsAsFactors=F)
#GLMM
library(MCMCglmm)
prior = list(R=list(R1=list(V=1,nu=0),R2=list(V=1,nu=0),R3=list(V=1,nu=0)), G=list(G1=list(V=1,nu=0)))
#Separate the sexes
fem <- main[main$Sex=="f",]
mal <- main[main$Sex=="m",]
#GLMM
#females
f1 <- MCMCglmm(DominanceRank ~ Cort + TrialsToReverseLast, random=~Population, family="poisson", data=fem, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(f1)
#autocorr(f1$Sol) #Did fixed effects converge?
#autocorr(f1$VCV) #Did random effects converge?
#males
m1 <- MCMCglmm(TrialsToReverseLast ~ Cort + TrialsToReverseLast, random=~Population, family="poisson", data=mal, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(m1)
#autocorr(m1$Sol) #Did fixed effects converge?
#autocorr(m1$VCV) #Did random effects converge?
```
####*P7 alternative 1: condition and dominance*
**Analysis:** We will conduct the analysis using a Generalized Linear Mixed Model (GLMM; MCMCglmm function, MCMCglmm package; [@hadfield2010mcmc]) with a Poisson distribution and log link using 130,000 iterations with a thinning interval of 10, a burnin of 30,000, and minimal priors (V=1, nu=0) [@hadfield2014coursenotes]. We will ensure the GLMM shows acceptable convergence (lag time autocorrelation values <0.01; [@hadfield2010mcmc]), and adjust parameters if necessary to meet this criterion. The contribution of each independent variable will be evaluated using the Estimate in the full model.
```{r conditiondominance, eval=FALSE, warning=FALSE, results='asis', echo=TRUE, include=TRUE}
main <- read.csv ("/Users/corina/GTGR/data/data_pop.csv", header=T, sep=",", stringsAsFactors=F)
#GLMM
library(MCMCglmm)
prior = list(R=list(R1=list(V=1,nu=0),R2=list(V=1,nu=0),R3=list(V=1,nu=0),R4=list(V=1,nu=0),R5=list(V=1,nu=0),R6=list(V=1,nu=0),R7=list(V=1,nu=0),R8=list(V=1,nu=0),R9=list(V=1,nu=0)), G=list(G1=list(V=1,nu=0)))
#Separate the sexes
fem <- main[main$Sex=="f",]
mal <- main[main$Sex=="m",]
#GLMM
#females
f1 <- MCMCglmm(DominanceRank ~ Weight + AvgTarsusLength + AvgTailLength + AvgWingLength + Hematocrit + NumberRedBloodCells + Testosterone + TrialsToReverseLast, random=~Population, family="poisson", data=fem, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(f1)
#autocorr(f1$Sol) #Did fixed effects converge?
#autocorr(f1$VCV) #Did random effects converge?
#males
m1 <- MCMCglmm(DominanceRank ~ Weight + AvgTarsusLength + AvgTailLength + AvgWingLength + TrialsToReverseLast, random=~Population, family="poisson", data=mal, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(m1)
#autocorr(m1$Sol) #Did fixed effects converge?
#autocorr(m1$VCV) #Did random effects converge?
```
####*P8 alternative 1: haemosporidian parasites and foods eaten*
**Analysis:** We will conduct the analysis using a Generalized Linear Mixed Model (GLMM; MCMCglmm function, MCMCglmm package; [@hadfield2010mcmc]) with a Poisson distribution and log link using 130,000 iterations with a thinning interval of 10, a burnin of 30,000, and minimal priors (V=1, nu=0) [@hadfield2014coursenotes]. We will ensure the GLMM shows acceptable convergence (lag time autocorrelation values <0.01; [@hadfield2010mcmc]), and adjust parameters if necessary to meet this criterion. The contribution of each independent variable will be evaluated using the Estimate in the full model.
```{r parasitefoods, eval=FALSE, warning=FALSE, results='asis', echo=TRUE, include=TRUE}
main <- read.csv ("/Users/corina/GTGR/data/data_pop.csv", header=T, sep=",", stringsAsFactors=F)
#GLMM
library(MCMCglmm)
prior = list(R=list(R1=list(V=1,nu=0),R2=list(V=1,nu=0),R3=list(V=1,nu=0),R4=list(V=1,nu=0)), G=list(G1=list(V=1,nu=0)))
#Separate the sexes
fem <- main[main$Sex=="f",]
mal <- main[main$Sex=="m",]
#GLMM
#females
f1 <- MCMCglmm(NumberFoodsEaten ~ NumberParasites + NumberParasiteSpecies + TrialsToReverseLast, random=~Population, family="poisson", data=fem, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(f1)
#autocorr(f1$Sol) #Did fixed effects converge?
#autocorr(f1$VCV) #Did random effects converge?
#males
m1 <- MCMCglmm(NumberFoodsEaten ~ NumberParasites + NumberParasiteSpecies + TrialsToReverseLast, random=~Population, family="poisson", data=mal, verbose=F, prior=prior, nitt=130000, thin=10, burnin=30000)
summary(m1)
#autocorr(m1$Sol) #Did fixed effects converge?
#autocorr(m1$VCV) #Did random effects converge?
```
####*P9 alternative 1: individual variation in microbiome species diversity*
We will visually examine individual variation in the number of microbiome species hosted by each grackle using a scatterplot (Figure 5).
```{r microbiomevariation, eval=FALSE, warning=FALSE, results='asis', echo=TRUE, include=TRUE, fig.cap="**Figure 5.** Visually examining individual variation in the number of microbiome species each grackle hosts."}
main <- read.csv ("/Users/corina/GTGR/data/data_pop.csv", header=T, sep=",", stringsAsFactors=F)
#Separate the sexes
fem <- main[main$Sex=="f",]
mal <- main[main$Sex=="m",]
#Plot
op <- par(mfrow=c(1,2), mar=c(4,4,2,0.2))
plot(fem$ID,fem$NumberMicrobiomeSpecies, xlab="Grackle ID (females)", ylab="Number of species in the microbiome")
plot(mal$ID,mal$NumberMicrobiomeSpecies, xlab="Grackle ID (males)", ylab="Number of species in the microbiome")
```
####*Alternative Analyses*
We will perform network analyses or factor analyses on the gene expression data, however we are still learning about these analyses so we will revise this preregistration to include these new analyses before conducting the analyses above.
We anticipate that we will want to run additional/different analyses after reading @statrethinkingbook. We will revise this preregistration to include these new analyses before conducting the analyses above.
###F. ETHICS
This research is carried out in accordance with permits from the:
1) US Fish and Wildlife Service (scientific collecting permit number MB76700A-0,1,2)
2) US Geological Survey Bird Banding Laboratory (federal bird banding permit number 23872)
3) Arizona Game and Fish Department (scientific collecting license number SP594338 [2017], SP606267 [2018], and SP639866 [2019])
4) Institutional Animal Care and Use Committee at Arizona State University (protocol number 17-1594R)
5) University of Cambridge ethical review process (non-regulated use of animals in scientific procedures: zoo4/17)
###G. AUTHOR CONTRIBUTIONS
**Logan:** Hypothesis development, study design, materials, data collection, data analysis and interpretation, write up, revising/editing, funding.
**Rowney:** Data collection, data interpretation, revising/editing.
**Bergeron:** Data collection, data interpretation, revising/editing.
**McCune:** Data collection, data interpretation, revising/editing.
**MacPherson:** Hypothesis development (hormones), study design (hormones), data collection, data interpretation, revising/editing.
**Bond (testosterone and glucocorticoids):** Method development, sample processing, data analysis and interpretation, revising/editing.
**Blackwell (immune function):** Hypothesis development, materials/lab space, sample processing, data analysis and interpretation, write up, revising/editing.
**Escalante (haemosporidian parasites and microbiome):** Hypothesis development, data analysis and interpretation, write up, revising/editing.
**Pacheco (haemosporidian parasites and microbiome):** Hypothesis development, materials/lab space, sample processing, data analysis and interpretation, write up, revising/editing.
**Lukas (genetics):** Hypothesis development, data analysis and interpretation, write up, revising/editing.
**Wascher (intestinal parasites):** Hypothesis development, data analysis and interpretation, write up, revising/editing.
###H. FUNDING
This research is funded by the Department of Human Behavior, Ecology and Culture at the Max Planck Institute for Evolutionary Anthropology, and in 2017-2018 by a Leverhulme Early Career Research Fellowship to Logan.
###I. ACKNOWLEDGEMENTS
We thank Melissa Wilson Sayres for sponsoring our affiliations at Arizona State University and lending lab equipment; Kevin Langergraber for serving as local PI on the ASU IACUC; Kristine Johnson for technical advice on great-tailed grackles; Jay Taylor for grackle scouting at Arizona State University; Arizona State University School of Life Sciences Department Animal Care and Technologies for providing space for our aviaries and for their excellent support of our daily activities; Julia Cissewski for tirelessly solving problems involving financial transactions and contracts; Richard McElreath for project support; and our research assistants: Aelin Mayer, Nancy Rodriguez, Brianna Thomas, Aldora Messinger, Elysia Mamola, Michael Guillen, Rita Barakat, Adriana Boderash, Olateju Ojekunle, August Sevchik, Justin Huynh, Jennifer Berens, and Amanda Overholt.
###J. REFERENCES