Title: | Statistical Object Oriented Data Analysis of RDP-Based Taxonomic Trees from Human Microbiome Data |
---|---|
Description: | Tools to model, compare, and visualize populations of taxonomic tree objects. |
Authors: | Patricio S. La Rosa, Elena Deych, Berkley Shands, William D. Shannon |
Maintainer: | Berkley Shands <[email protected]> |
License: | Apache License (== 2.0) |
Version: | 1.4 |
Built: | 2024-11-29 08:59:39 UTC |
Source: | CRAN |
Object Oriented Data Analysis (OODA) methods to analyze Human Microbiome taxonomic trees directly. We provide tools to model, compare, and visualize populations of taxonomic trees.
HMP metagenomic sequences in a sample can be represented as a rooted taxonomic tree. Using supervised taxonomic methods a sequence is matched to a
hierarchical taxa or taxonomy bins defined in a bacterial-taxonomy library such as, for example, the Ribosomal Database Project (RDP) (Cole, 2005). The
supervised taxonomic analysis allows us to represent each sample (set of sequences) by a rooted taxonomic tree where the root corresponds to taxon at the
Kingdom level, i.e., bacteria, and the leaves correspond to the taxa at the Genus level, and the width of the edges (paths) between taxonomic levels correspond
to the 'abundances' of the descending taxon.
In particular, we combine RDP matches by adding RDP values of common taxon, which allows us to provide a measure
of taxa abundance weighting on the confidence of each taxa assignment. The resulting taxonomic trees satisfy the following conditions: i) branches closer to
the root have higher 'abundance' values than branches closer to leaves, and ii) the sum of the 'abundances' of all descending taxa under a common parent taxon
cannot be larger than the 'abundance' of the corresponding parent taxon.
It is important to note that due to how the ape
package works the following naming conventions apply to taxa names:
Colons cannot be used in the taxa names at all.
Each taxa name must be unique - you cannot have two seperate branches both have a child named 'unclassified' for example . (We took the parent name and added a 'U' to the end to signify an unclassified in our data sets)
There can only be one top level node. (Bacteria and Archaea cannot both exist unless there is an additional single level above them for example)
Patricio S. La Rosa, Elena Deych, Berkley Shands, William D. Shannon
Cole JR, Chai B, Farris RJ, Wang Q, Kulam SA, McGarrell DM, Garrity GM, Tiedje JM. The Ribosomal Database Project (RDP-II): sequences and tools for high-throughput rRNA analysis. Nucleic Acids Research 2005; 33: D294-D296.
P. S. La Rosa, Berkley Shands, Elena Deych, Yanjiao Zhou, Erica Sodergren, George Weinstock, and William D. Shannon, "Object data analysis of taxonomic trees from human microbiome data,"PLoS ONE 7(11): e48996. doi:10.1371/journal.pone.0048996. Nov. 2012.
Banks D, Constantine GM. Metric Models for Random Graphs. Journal of Classification 1998; 15: 199-223.
Shannon WD, Banks D. Combining classification trees using MLE. Stat Med 1999; 18: 727-740.
This function goes through every node in the tree and for each node it checks that the sum of that nodes children are less than or equal to the value of that node.
checkTreeValidity(data, samples = NULL, epsilon = 0.0001, split = ".")
checkTreeValidity(data, samples = NULL, epsilon = 0.0001, split = ".")
data |
A data frame in which each column contains the rdp read counts for every taxa given in the row names. |
samples |
Deprecated. Only send the columns in data to create. |
epsilon |
This value allows for rounding problems or other such small errors in the data such that the (parent + epsilon > sum(children)). |
split |
This is the character that separates the taxa levels in the row names. |
A boolean vector that indicates the validity of every tree tested.
Berkley Shands, Patricio S. La Rosa, Elena Deych, William D. Shannon
data(saliva) validTree <- checkTreeValidity(saliva[,1, drop=FALSE]) validTree
data(saliva) validTree <- checkTreeValidity(saliva[,1, drop=FALSE]) validTree
This functions compares the distribution of two sets of RDP-based taxonomic trees using Likelihood-Ratio-Test statistics and a p-value is computed using permutations.
compareTwoDataSets(data1, data2, numPerms = 1000, parallel = FALSE, cores = 3, maxSteps=50, delta=10^(-6), numBootStraps = NULL, enableMC = NULL)
compareTwoDataSets(data1, data2, numPerms = 1000, parallel = FALSE, cores = 3, maxSteps=50, delta=10^(-6), numBootStraps = NULL, enableMC = NULL)
data1 , data2
|
Data frames in which each column contains the rdp read counts for every taxa given in the row names. |
numPerms |
The number of permutation tests to run. |
parallel |
When this is 'TRUE' it allows for parallel calculation of the permutations. Requires the package |
cores |
The number of parallel processes to run if enableMC is 'TRUE'. |
maxSteps |
The maximum number of times to iterate though for the MLE. |
delta |
The minimum threshold of change in f to stop the search for the MLE. |
numBootStraps |
Deprecated. Replaced with numPerms. |
enableMC |
Deprecated. Replaced with parallel. |
Note: Both data sets should be standardized to the same number of reads.
We are interested in assessing whether the distributions from two metagenomic populations are the same or different, which is equivalent to evaluating whether their respective parameters are the same or different. The corresponding hypothesis is given as follows:
where is the unknown common parameter vector. To evaluate this hypothesis we use the likelihood-ratio test (LRT) which is given by,
where and
are the sets containing
and
random samples of trees from each metagenomic population, respectively.
We assume that the model parameters are unknown under both the null and alternative hypothesis, therefore, we estimate these using the MLE procedure proposed
in La Rosa et al (see reference 2), and compute the corresponding p-value using non-parametric bootstrap.
A p-value for the similarity of the two data sets based on the permutation test.
Patricio S. La Rosa, Elena Deych, Berkley Shands, William D. Shannon
data(saliva) data(stool) ### We use 1 for the number of permutations for computation time ### This value should be at least 1000 for an accurate result numPerms <- 1 pval <- compareTwoDataSets(saliva, stool, numPerms) pval
data(saliva) data(stool) ### We use 1 for the number of permutations for computation time ### This value should be at least 1000 for an accurate result numPerms <- 1 pval <- compareTwoDataSets(saliva, stool, numPerms) pval
This function combines the createTrees and plotTree functions to create and plot a set of trees.
createAndPlot(data, samples = NULL, level = "genus", colors = NULL, divisions = NULL, main = NULL, sub = "", showTipLabel = TRUE, showNodeLabel = FALSE, displayLegend = TRUE, onePerPage = FALSE, split = ".")
createAndPlot(data, samples = NULL, level = "genus", colors = NULL, divisions = NULL, main = NULL, sub = "", showTipLabel = TRUE, showNodeLabel = FALSE, displayLegend = TRUE, onePerPage = FALSE, split = ".")
data |
A data frame in which each column contains the rdp read counts for every taxa given in the row names. |
samples |
Deprecated. Only send the columns in data to plot. |
level |
The depth the tree creation will go down to (kingdom, phylum, class, order, family, genus, species, subspecies). |
colors |
A vector of colors to be applied to the branches in the plot. |
divisions |
A vector of numbers to be used as break points to assign different colors. |
main |
A custom title(s) for the plot(s). |
sub |
A custom subtitle for the plot. |
showTipLabel |
Hides the tip labels if 'FALSE' otherwise it shows all non-zero tip labels. |
showNodeLabel |
Hides the interior node labels if 'FALSE' otherwise it shows all non-zero node labels. |
displayLegend |
Enables the display of a legend of the branch colors and divisions when 'TRUE'. |
onePerPage |
If 'TRUE' one tree will be plotted per page, if 'FALSE' four will be displayed per page. |
split |
This is the character that separates the taxa levels in the row names. |
Notes:
For 'level' k, p, c, o, f, g, s and ss can be used in place of kingdom, phylum, class, order, family, genus, species and subspecies respectively.
The values for division should directly relate to the values of your data, i.e. if your data ranges from 0 to 50000 reads you should adjust the divisions to fit your data.
A plot of the tree(s).
Berkley Shands, Patricio S. La Rosa, Elena Deych, William D. Shannon
data(saliva) ### Plots the trees in column 2 and 3 in 'Saliva' createAndPlot(saliva[,2:3])
data(saliva) ### Plots the trees in column 2 and 3 in 'Saliva' createAndPlot(saliva[,2:3])
This function creates a list tree objects of type 'phylo' for use in plotting the trees.
createTrees(data, samples = NULL, level = "genus", split = ".")
createTrees(data, samples = NULL, level = "genus", split = ".")
data |
A data frame in which each column contains the rdp read counts for every taxa given in the row names. |
samples |
Deprecated. Only send the columns in data to create. |
level |
The depth the tree creation will go down to (kingdom, phylum, class, order, family, genus, species, subspecies). |
split |
This is the character that separates the taxa levels in the row names. |
For 'level' k, p, c, o, f, g, s and ss can be used in place of kingdom, phylum, class, order, family, genus, species and subspecies respectively.
A list of 'phylo' objects that can be passed to plotTree to plot them.
Berkley Shands, Patricio S. La Rosa, Elena Deych, William D. Shannon
data(saliva) ### Creates a tree for the 4th sample in 'Saliva' salivaTree <- createTrees(saliva[,4, drop=FALSE])
data(saliva) ### Creates a tree for the 4th sample in 'Saliva' salivaTree <- createTrees(saliva[,4, drop=FALSE])
This function displays a legend that shows the tree branch sizes/colors divisions.
displayLegend(colors = NULL, divisions = NULL, title = "Confidence Value")
displayLegend(colors = NULL, divisions = NULL, title = "Confidence Value")
colors |
A vector of colors to be used in the plot from lowest ranking to highest ranking. |
divisions |
A vector of numbers from lowest to highest to separate the tree branches into the color ranking. |
title |
The title for the legend. |
The values for division should directly relate to the values of your data, i.e. if your data ranges from 0 to 50000 reads you should adjust the divisions to fit your data.
A blank plot that contains a legend.
Berkley Shands, Patricio S. La Rosa, Elena Deych, William D. Shannon
displayLegend(c("red", "orange", "blue"), c(.1, 100, 10000))
displayLegend(c("red", "orange", "blue"), c(.1, 100, 10000))
This function will take a data set and format it by removing low count trees, and/or normalizing counts.
formatData(data, countThreshold = 1000, normalizeThreshold = 10000)
formatData(data, countThreshold = 1000, normalizeThreshold = 10000)
data |
A data frame in which each column contains the rdp read counts for every taxa given in the row names. |
countThreshold |
A cut off threshold for reads - all trees with fewer than this number of reads will be removed. |
normalizeThreshold |
All the trees that are not removed will be normalized to this many reads. |
When removing trees with too few reads, the cuts off is based on the value of the top level node, not the sum of all the reads in a sample.
A new data set that is trimmed and standardized based on the specified parameters. The new data is also reordered alphabetically according to row labels.
Patricio S. La Rosa, Elena Deych, Berkley Shands, William D. Shannon
data(saliva) saliva2 <- formatData(saliva, 1000, 10000)
data(saliva) saliva2 <- formatData(saliva, 1000, 10000)
This function will take several initial trees and will randomly populate new trees based on the originals.
generateTree(data, numReadsPerSamp, theta = NULL, level = "genus", split = ".")
generateTree(data, numReadsPerSamp, theta = NULL, level = "genus", split = ".")
data |
A data frame in which each column contains the rdp read counts for every taxa given in the row names. |
numReadsPerSamp |
A vector specifying the number of reads or sequence depth for each sample. |
theta |
When theta is not NULL the base tree is generated by using the |
level |
The depth the tree will go down to (kingdom, phylum, class, order, family, genus, species, subspecies). |
split |
This is the character that separates the taxa levels in the row names. |
A data frame containing the generated tree(s).
Patricio S. La Rosa, Elena Deych, Berkley Shands, William D. Shannon
data(saliva) ### Generate a the number of reads per sample ### The first number is the number of reads and the second is the number of subjects nrs <- rep(10000, 2) gendata <- generateTree(saliva, nrs)
data(saliva) ### Generate a the number of reads per sample ### The first number is the number of reads and the second is the number of subjects nrs <- rep(10000, 2) gendata <- generateTree(saliva, nrs)
This function takes a data set and computes the MLE and its Log-Likelihood value.
getMLEandLoglike(data, maxSteps = 50, weightCols = NULL, delta = 10^(-6), weight = NULL)
getMLEandLoglike(data, maxSteps = 50, weightCols = NULL, delta = 10^(-6), weight = NULL)
data |
A data frame in which each column contains the rdp read counts for every taxa given in the row names. |
maxSteps |
The maximum number of times to iterate though for the MLE. |
weightCols |
A vector of weights for the subjects. |
delta |
The minimum threshold of change in f to stop the search for the MLE. |
weight |
Deprecated, use weightCols instead |
A unimodal probability model for graph-valued random objects has been derived and applied previously to several types of graphs
(cluster trees, digraphs, and classification and regression trees) (For example, Banks and Constantine, 1998; Shannon and Banks, 1999).
Here we apply this model to HMP trees constructed from RDP matches. Let be the finite set of taxonomic trees with elements
, and
an arbitrary metric of distance on
. We have the probability measure
defined by
where is the modal or central tree,
is a concentration parameter, and
is the normalization constant.
The distance measure between two trees is the Euclidean norm of the difference between their corresponding adjacency-vectors. To estimate the parameters
, we use the maximum likelihood estimate (MLE) procedure described in La Rosa et al. (see reference 2)
A list containing the MLE, log-likelihood, tau, the number of iterations it took to run, and some intermediate values
Patricio S. La Rosa, Elena Deych, Berkley Shands, William D. Shannon
data(saliva) ### We use 1 for the maximum number of steps for computation time ### This value should be much higher to ensure an accurate result numSteps <- 1 mle <- getMLEandLoglike(saliva, numSteps)$mleTree
data(saliva) ### We use 1 for the maximum number of steps for computation time ### This value should be much higher to ensure an accurate result numSteps <- 1 mle <- getMLEandLoglike(saliva, numSteps)$mleTree
This function can take any number of data sets, calculate their individual and combined MLEs and then merge them.
mergeDataSets(dataList, calcMLE = FALSE, uniqueNames = FALSE, data = NULL)
mergeDataSets(dataList, calcMLE = FALSE, uniqueNames = FALSE, data = NULL)
dataList |
A list of data frames in which each column contains the rdp read counts for every taxa given in the row names. |
calcMLE |
If 'FALSE' the MLEs for the data sets will not be calculated, otherwise they are added to the end. |
uniqueNames |
If 'TRUE' the column names in the combined data set will be appended to insure uniqueness, otherwise the column names
will follow the naming process from the |
data |
Deprecated. Replaced with dataList. |
Although not required, all data sets should be standardized to the same number of reads before merging.
A single data set containing all the data from the input data sets, in addition to their individual MLEs and a combined MLE if requested.
Berkley Shands, Patricio S. La Rosa, Elena Deych, William D. Shannon
data(saliva) data(stool) dataComb <- mergeDataSets(list(saliva, stool))
data(saliva) data(stool) dataComb <- mergeDataSets(list(saliva, stool))
This functions compares the distribution of two paired sets of RDP-based taxonomic trees using Likelihood-Ratio-Test statistics and a p-value is computed using permutation.
pairedCompareTwoDataSets(data1, data2, numPerms = 1000, parallel = FALSE, cores = 3, maxSteps=50, delta=10^(-6))
pairedCompareTwoDataSets(data1, data2, numPerms = 1000, parallel = FALSE, cores = 3, maxSteps=50, delta=10^(-6))
data1 , data2
|
Data frames in which each column contains the rdp read counts for every taxa given in the row names. |
numPerms |
Number of permutations. In practice this should be at least 1,000. |
parallel |
When this is 'TRUE' it allows for parallel calculation of the permutations. Requires the package |
cores |
The number of parallel processes to run if parallel is 'TRUE'. |
maxSteps |
The maximum number of times to iterate though for the MLE. |
delta |
The minimum threshold of change in f to stop the search for the MLE. |
Note: Both data sets should be standardized to the same number of reads.
A p-value for the similarity of the two data sets based on the permutation test.
Patricio S. La Rosa, Elena Deych, Berkley Shands, William D. Shannon
data(saliva) data(stool) ### We use 1 for the number of permutations for computation time ### This value should be at least 1000 for an accurate result numPerms <- 1 pval <- pairedCompareTwoDataSets(saliva, stool, numPerms) pval
data(saliva) data(stool) ### We use 1 for the number of permutations for computation time ### This value should be at least 1000 for an accurate result numPerms <- 1 pval <- pairedCompareTwoDataSets(saliva, stool, numPerms) pval
This function takes one or more 'phylo' objects and plots them.
plotTree(treeList, colors = NULL, divisions = NULL, main = NULL, sub = "", showTipLabel = TRUE, showNodeLabel = FALSE, displayLegend = TRUE, trees = NULL)
plotTree(treeList, colors = NULL, divisions = NULL, main = NULL, sub = "", showTipLabel = TRUE, showNodeLabel = FALSE, displayLegend = TRUE, trees = NULL)
treeList |
A list that contains at least one tree of type 'phylo'. |
colors |
A vector of colors to be applied to the branches in the plot. |
divisions |
A vector of numbers to be used as break points to assign different colors. |
main |
A custom title(s) for the plot(s). |
sub |
A custom subtitle for the plot. |
showTipLabel |
Hides the tip labels if 'FALSE' otherwise it shows all non-zero tip labels. |
showNodeLabel |
Hides the interior node labels if 'FALSE' otherwise it shows all non-zero node labels. |
displayLegend |
Enables the display of a legend of the branch colors and divisions when 'TRUE'. |
trees |
Deprecated. Replaced with treeList. |
Notes:
The phylo
type is a product of the ape
package and the createTrees
function in this package
produces a list of phylo
type objects for use with this function.
The values for division should directly relate to the values of your data, i.e. if your data ranges from 0 to 50000 reads you should adjust the divisions to fit your data.
A plot of the tree(s).
Berkley Shands, Patricio S. La Rosa, Elena Deych, William D. Shannon
data(saliva) ### Creates a tree for the 4th sample in 'Saliva' then plots it salivaTree <- createTrees(saliva[,4, drop=FALSE]) plotTree(salivaTree, displayLegend=FALSE)
data(saliva) ### Creates a tree for the 4th sample in 'Saliva' then plots it salivaTree <- createTrees(saliva[,4, drop=FALSE]) plotTree(salivaTree, displayLegend=FALSE)
This function can take any number of data sets and plots them on an MDS plot to show relative closeness to one another.
plotTreeDataMDS(dataList, main = "Tree MDS Comparisons", calcMLE = TRUE, mleTitles = NULL, dotColors = NULL, dotSizes = NULL, showNames = FALSE, returnCoords = FALSE, data = NULL)
plotTreeDataMDS(dataList, main = "Tree MDS Comparisons", calcMLE = TRUE, mleTitles = NULL, dotColors = NULL, dotSizes = NULL, showNames = FALSE, returnCoords = FALSE, data = NULL)
dataList |
A list of a data frames in which each column contains the rdp read counts for every taxa given in the row names. |
main |
A title for the MDS plot. |
calcMLE |
If 'FALSE' the MLEs for the data sets will not be calculated and plotted. |
mleTitles |
Deprecated. Replaced with the names in 'dataList'. |
dotColors |
The colors to be used when plotting the points and MLE points on the MDS plot. |
dotSizes |
A vector in which the first value is the data points CEX and the second value is the MLEs CEX. |
showNames |
When 'TRUE' the column name will be plotted above each corresponding point. |
returnCoords |
When 'TRUE' this function will return the x and y coordinates for every plotted point. |
data |
Deprecated. Replaced with dataList. |
A MDS plot of the data.
Berkley Shands, Patricio S. La Rosa, Elena Deych, William D. Shannon
data(saliva) data(stool) plotTreeDataMDS(list(Saliva=saliva, Stool=stool))
data(saliva) data(stool) plotTreeDataMDS(list(Saliva=saliva, Stool=stool))
A data set containing all taxa from 24 subjects.
data(saliva)
data(saliva)
The format is a data frame of 454 rows by 24 columns, with each column being a separate subject and each row being a different taxa denoted by the row names. The taxanomical levels are separated by a '.' in their names (Bacteria.Phylum.Class....). The values in each column are the sum of values that each taxa had in an RDP file. It should also be noted that the samples are normalized to 7000 reads and any level that ends with a U was unclassified in the RDP file.
A data set containing all taxa from 24 subjects.
data(stool)
data(stool)
The format is a data frame of 371 rows by 24 columns, with each column being a separate subject and each row being a different taxa denoted by the row names. The taxanomical levels are separated by a '.' in their names (Bacteria.Phylum.Class....). The values in each column are the sum of values that each taxa had in an RDP file. It should also be noted that the samples are normalized to 7000 reads and any level that ends with a U was unclassified in the RDP file.
A data set containing all taxa from 22 subjects.
data(throat)
data(throat)
The format is a data frame of 529 rows by 22 columns, with each column being a separate subject and each row being a different taxa denoted by the row names. The taxanomical levels are separated by a '.' in their names (Bacteria.Phylum.Class....). The values in each column are the sum of values that each taxa had in an RDP file. It should also be noted that the samples have not been normalized and should be used with 'formatData'. Also any level that ends with a U was unclassified in the RDP file.
This function will take a tree and either remove all nodes lower than the given level or will remove all nodes not of the given level.
trimToTaxaLevel(data, level = "genus", eliminateParentNodes = FALSE, trimBelow = NULL, split = ".")
trimToTaxaLevel(data, level = "genus", eliminateParentNodes = FALSE, trimBelow = NULL, split = ".")
data |
A data frame in which each column contains the rdp read counts for every taxa given in the row names. |
level |
The depth the tree will go down to (kingdom, phylum, class, order, family, genus, species, subspecies). |
eliminateParentNodes |
If 'TRUE' the data set returned will only contain rows at the level specified by 'myTaxaLevel'. If 'FALSE' the data set returned will contain all the nodes up to the level specified by 'myTaxaLevel'. |
trimBelow |
If 'NULL' the function will pull out only the data at the level specified by 'myTaxaLevel'. If 'TRUE' the function will remove all the levels below the specified level. If 'FALSE' the function will remove all the levels above the specified level. |
split |
This is the character that separates the taxa levels in the row names. |
Notes:
For 'level' k, p, c, o, f, g, s and ss can be used in place of kingdom, phylum, class, order, family, genus, species and subspecies respectively.
Numbers can also be used for 'level', with no maximum limit.
The option to 'eliminateParentNodes' only works when 'trimBelow' is NULL.
A new data set that has been trimmed to the level selected.
Berkley Shands, Patricio S. La Rosa, Elena Deych, William D. Shannon
data(saliva) ### Trims saliva to only contain the class level salivaClass <- trimToTaxaLevel(saliva, "class", TRUE)
data(saliva) ### Trims saliva to only contain the class level salivaClass <- trimToTaxaLevel(saliva, "class", TRUE)