Following this assignment students should be able to:
- connect to a remote database and execute simple queries
- integrate database and R workflow
- export output data from R to database
- tidy data table with redundant fields or overfilled cells
This is a follow up to the Basic Queries filtering problem.
It is clear Dr. Undómiel appreciates your skill working with large databases and she seems to expect you will maintain your benevolence. (Such is a fair expectation of a true wizard). This time though, she’s looking for some extra detail in her queries. She’s curious if desert rodents are dimorphic in size.
- Download a new copy of the Portal database.
- Connect to
- Start by reminding yourself about which tables are in the database using
- Then remind yourself of the fields in the
- Select and print out the average hind foot length and average weight of:
- all Dipodomys spectabilis individuals on the control plots
- male D. spectabilis on the control plots
- female D. spectabilis on the control plots
This is a follow-up to Connect and Query.
Dr. Undómiel agrees with you that the difference in male and female D. spectabilis hind foot length and weight seems pretty small, but wants to have a reference point for comparison. She wants you to find the male and female hind foot length and weight for all species of rodent on all of the plots (not just the controls).
Produce a data frame with
avg_weightfor each species. Your data frame should have two rows for each species, one row for each sex.
You can solve this problem in a variety of ways including usingExpected outputs for Automate Query: 1
GROUP BYin your SQL query, a
forloop, or using
applystatements. Take whichever approach you like best.
Dr. Undómiel has decided to focus on the change in size of a few target rodent species over the course of the experiment(1977-2002). She has chosen , Dipodymys spectabilis, Onychomys torridus, Perymiscus erimicus, Chaetodipus penicillatus.
Write a script that uses R and SQL to:
- Connect to the
- Generate a data frame with
species_id, and the average weight per year (
avg_weight) for each target species.
dbWriteTable()to include your new data frame in the
portal_mammals.sqlite. Call it something informative so that Dr. Undómiel can find it easily.
- Connect to the
The National Ecological Observatory Network has entered into the construction phase of development and they are already making their data available! NEON collects ecological and environmental data for representative regions of the United States at local to continental scales, including, of course!, small mammal box trapping. We’ve retrieved NEON’s existing small mammal data from Ordway-Swisher Biological Station [NEON Data Use Policy].
- Create a SQLite database called
- Download the three data tables (capture, plots, traps) and import them into the SQLite database.
- Connect to the database and familiarize yourself with its tables and structure.
- Write a query to determine the total number of traps that have been disturbed at each plot. Plot a histogram of the results.
- Determine the average hind foot length and weight of each species collected
for each National Landcover Database (
nlcd) class. Plot the average weight of all species with weight measurements from the woody wetlands.
- Write a set of nested queries to determine the total number of disturbed traps and average weight of Podimus floridanus for each sampling event (
- Create a SQLite database called
Estimating the total amount of biomass (the total mass of all individuals) in forests is important for understanding the global carbon budget and how the earth will respond to increases in carbon dioxide emissions. Measuring the mass of whole trees is a major effort and requires destructive harvest of the tree. Fortunately, we can estimate the mass of a tree based on its diameter.
There are lots of equations for estimating the mass of a tree from its diameter, but one good option is the equation:
Mass = 0.124 * Diameter2.53
We’re going to estimate the total tree biomass for trees in a 96 hectare area of the Western Ghats in India. The raw data. Unfortunately, the data is stored in a poor database structure and using all of the tree stems would be difficult without first tidying up the data.
gather()the raw data into rows for each measured stem.
- Write a function that takes a vector of tree diameters as an argument and
returns a vector of tree masses.
- Stems are measured in girth (or circumference) rather than diameter. Write a function that takes a vector of circumferences as an argument and returns a vector of diameters (circumference = pi * diameter).
- Use the two functions you’ve written to estimate the total biomass (i.e., the sum of the masses) of trees in this dataset and print the result to the screen.
SpEpCodeand estimate the total biomass per genus in a table. Technically the four letter code doesn’t uniquely identify all of the genera in the dataset, but we’ll assume it does for the purpose of this exercise.