Title: | Probability Theory for Selecting Candidates in Plant Breeding |
---|---|
Description: | Use probability theory under the Bayesian framework for calculating the risk of selecting candidates in a multi-environment context. Contained are functions used to fit a Bayesian multi-environment model (based on the available presets), extract posterior values and maximum posterior values, compute the variance components, check the model’s convergence, and calculate the probabilities. For both across and within-environments scopes, the package computes the probability of superior performance and the pairwise probability of superior performance. Furthermore, the probability of superior stability and the pairwise probability of superior stability across environments is estimated. A joint probability of superior performance and stability is also provided. |
Authors: | Saulo Chaves [aut, cre] , Kaio Dias [aut, cph] , Matheus Krause [aut] |
Maintainer: | Saulo Chaves <[email protected]> |
License: | AGPL (>= 3) |
Version: | 1.0.4.4 |
Built: | 2024-12-11 07:30:49 UTC |
Source: | CRAN |
Fits a Bayesian multi-environment model using rstan
, the R
interface to Stan
.
bayes_met( data, gen, loc, repl, trait, reg = NULL, year = NULL, res.het = FALSE, iter = 2000, cores = 1, chains = 4, pars = NA, warmup = floor(iter/2), thin = 1, seed = sample.int(.Machine$integer.max, 1), init = "random", verbose = FALSE, algorithm = c("NUTS", "HMC", "Fixed_param"), control = NULL, include = TRUE, show_messages = TRUE, ... )
bayes_met( data, gen, loc, repl, trait, reg = NULL, year = NULL, res.het = FALSE, iter = 2000, cores = 1, chains = 4, pars = NA, warmup = floor(iter/2), thin = 1, seed = sample.int(.Machine$integer.max, 1), init = "random", verbose = FALSE, algorithm = c("NUTS", "HMC", "Fixed_param"), control = NULL, include = TRUE, show_messages = TRUE, ... )
data |
A data frame in which to interpret the variables declared in the other arguments. |
gen , loc
|
A string. The name of the columns that contain the evaluated candidates and locations (or environments, if you are working with factor combinations), respectively. |
repl |
A string, a vector, or |
trait |
A string. The analysed variable. Currently, only single-trait models are fitted. |
reg |
A string or NULL. The name of the column that contain information on
regions or mega-environments. |
year |
A string or NULL. The name of the column that contain information on
years (or seasons). |
res.het |
Should the model consider heterogeneous residual variances?
Defaults for |
iter |
A positive integer specifying the number of iterations for each chain (including warmup). The default is 2000. |
cores |
Number of cores to use when executing the chains in parallel,
which defaults to 1 but we recommend setting the |
chains |
A positive integer specifying the number of Markov chains. The default is 4. |
pars |
A vector of character strings specifying parameters of interest.
The default is |
warmup |
A positive integer specifying the number of warmup (aka burnin)
iterations per chain. If step-size adaptation is on (which it is by default),
this also controls the number of iterations for which adaptation is run (and
hence these warmup samples should not be used for inference). The number of
warmup iterations should be smaller than |
thin |
A positive integer specifying the period for saving samples. The default is 1, which is usually the recommended value. |
seed |
The seed for random number generation. The default is generated
from 1 to the maximum integer supported by R on the machine. Even if
multiple chains are used, only one seed is needed, with other chains having
seeds derived from that of the first chain to avoid dependent samples.
When a seed is specified by a number, |
init |
Initial values specification. See the detailed documentation for
the init argument in |
verbose |
|
algorithm |
One of sampling algorithms that are implemented in Stan.
Current options are |
control |
A named |
include |
Logical scalar defaulting to |
show_messages |
Either a logical scalar (defaulting to |
... |
Additional arguments can be |
The function has nine available models, which will be fitted according to the options set in the arguments:
Entry-mean model : fitted when repl = NULL
, reg = NULL
and year = NULL
:
Where is the phenotype,
is the intercept,
is the genotypic
effect,
is the location (or environment) effect, and
is
the error (which contains the genotype-by-location interaction, in this case).
Randomized complete blocks design : fitted when repl
is a single string.
It will fit different models depending if reg
and year
are NULL
:
reg = NULL
and year = NULL
:
where is the genotype-by-location effect, and
is the replicate effect.
reg = "reg"
and year = NULL
:
where is the region effect, and
is the genotype-by-region effect.
reg = NULL
and year = "year"
:
where is the year effect, and
is the genotype-by-year effect.
reg = "reg"
and year = "year"
:
Incomplete blocks design : fitted when repl
is a string vector of size 2.
It will fit different models depending if reg
and year
are NULL
:
reg = NULL
and year = NULL
:
where is the block within replicates effect.
reg = "reg"
and year = NULL
:
reg = NULL
and year = "year"
:
reg = "reg"
and year = "year"
:
The models described above have predefined priors:
where can be any effect but the error, and
is the standard
deviation of the likelihood. If
res.het = TRUE
, then .
The hyperpriors are set as follows:
where is the known global hyperparameter defined such as
.
More details about the usage of bayes_met
and other functions of
the ProbBreed
package can be found at https://saulo-chaves.github.io/ProbBreed_site/.
Solutions to convergence or mixing issues can be found at
https://mc-stan.org/misc/warnings.html.
An object of S4 class stanfit
representing
the fitted results. Slot mode
for this object
indicates if the sampling is done or not.
sampling
signature(object = "stanmodel")
Call a sampler (NUTS, HMC, or Fixed_param depending on parameters)
to draw samples from the model defined by S4 class stanmodel
given the data, initial values, etc.
rstan::sampling, rstan::stan, rstan::stanfit
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4)
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4)
stanfit
objects obtained from bayes_met
Extracts outputs of the Bayesian model fitted
using bayes_met()
, and provides some diagnostics.
extr_outs(model, probs = c(0.025, 0.975), verbose = FALSE)
extr_outs(model, probs = c(0.025, 0.975), verbose = FALSE)
model |
An object of class |
probs |
A vector with two elements representing the probabilities (in decimal scale) that will be considered for computing the quantiles. |
verbose |
A logical value. If |
More details about the usage of extr_outs
and other functions of
the ProbBreed
package can be found at https://saulo-chaves.github.io/ProbBreed_site/.
The function returns an object of class extr
, which is a list with:
variances
: a data frame containing the variance components of
the model effects, their standard deviation, naive standard error and highest
posterior density interval.
post
: a list with the posterior of the effects, and the data
generated by the model.
map
: a list with the maximum posterior values of each effect
ppcheck
: a matrix containing the p-values of maximum, minimum,
median, mean and standard deviation; effective number of parameters, WAIC2
value, Rhat and effective sample size.
rstan::stan_diag, ggplot2::ggplot, rstan::check_hmc_diagnostics, plot.extr
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4) outs = extr_outs(model = mod, probs = c(0.05, 0.95), verbose = TRUE)
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4) outs = extr_outs(model = mod, probs = c(0.05, 0.95), verbose = TRUE)
This dataset belongs to value of cultivation and use maize trials of Embrapa Maize and Sorghum, and was used by Dias et al. (2022). It contains the grain yield of 32 single-cross hybrids and four commercial checks (36 genotypes in total) evaluated in 16 locations across five regions or mega-environments. These trials were laid out in incomplete blocks design, using a block size of 6 and two replications per trial.
maize
maize
maize
A data frame with 823 rows and 6 columns:
16 locations
5 regions
2 replicates
6 blocks
36 genotypes
Grain yield (phenotypes)
Dias, K. O. G, Santos J. P. R., Krause, M. D., Piepho H. -P., Guimarães, L. J. M., Pastina, M. M., and Garcia, A. A. F. (2022). Leveraging probability concepts for cultivar recommendation in multi-environment trials. Theoretical and Applied Genetics, 133(2):443-455. doi:10.1007/s00122-022-04041-y
extr
objectBuild plots using the outputs stored in the extr
object.
## S3 method for class 'extr' plot(x, ..., category = "ppdensity")
## S3 method for class 'extr' plot(x, ..., category = "ppdensity")
x |
An object of class |
... |
Passed to ggplot2::geom_histogram, when |
category |
A string indicating which plot to build. See options in the Details section. |
The available options are:
ppdensity
: Density plots of the empirical and sampled data, useful to assess the
model's convergence.
density
: Density plots of the model's effects.
histogram
: Histograms of the model's effects.
traceplot
: Trace plot showing the changes in the effects' values across iterations and chains.
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4) outs = extr_outs(model = mod, probs = c(0.05, 0.95), verbose = TRUE) plot(outs, category = "ppdensity") plot(outs, category = "density") plot(outs, category = "histogram") plot(outs, category = "traceplot")
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4) outs = extr_outs(model = mod, probs = c(0.05, 0.95), verbose = TRUE) plot(outs, category = "ppdensity") plot(outs, category = "density") plot(outs, category = "histogram") plot(outs, category = "traceplot")
probsup
objectBuild plots using the outputs stored in the probsup
object.
## S3 method for class 'probsup' plot(x, ..., category = "perfo", level = "across")
## S3 method for class 'probsup' plot(x, ..., category = "perfo", level = "across")
x |
An object of class |
... |
currently not used |
category |
A string indicating which plot to build. See options in the Details section. |
level |
A string indicating the information level to be used for building
the plots. Options are |
The available options are:
hpd
: a caterpillar plot representing the marginal genotypic value of
each genotype, and their respective highest posterior density interval (95% represented by the
thick line, and 97.5% represented by the thin line). Available only if level = "across"
.
perfo
: if level = "across"
, a lollipop plot illustrating the probabilities of superior performance.
If level = "within"
, a heatmap with the probabilities of superior performance within
environments. If a model with reg
and/or year
is fitted, multiple plots are produced.
stabi
: a lollipop plot with the probabilities of superior stability.
If a model with reg
and/or year
is fitted, multiple plots are produced.
Available only if level = "across"
. Unavailable if an entry-mean model was used in bayes_met
.
pair_perfo
: if level = "across"
, a heatmap representing the pairwise probability of superior
performance (the probability of genotypes at the x-axis being superior.
to those on the y-axis). If level = "within"
, a list of heatmaps representing the pairwise probability of superior
performance within environments. If a model with reg
and/or year
is fitted, multiple plots (and multiple lists) are produced.
Should this option is set, it is mandatory to store the outputs in an object.
(e.g., pl <- plot(obj, category = "pair_perfo", level = "within")
) so they can be visualized one at a time.
The option level = "within"
is unavailable if an entry-mean model was used in bayes_met
.
pair_stabi
: a heatmap with the pairwise probabilities of superior stability
(the probability of genotypes at the x-axis being more stable than those on the y-axis).
If a model with reg
and/or year
is fitted, multiple plots are produced. Available only if level = "across"
.
Unavailable if an entry-mean model was used in bayes_met
.
joint
: a lollipop plot with the joint probabilities of superior performance and stability. Unavailable if an entry-mean model was used in bayes_met
.
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4) outs = extr_outs(model = mod, probs = c(0.05, 0.95), verbose = TRUE) results = prob_sup(extr = outs, int = .2, increase = TRUE, save.df = FALSE, verbose = FALSE) plot(results, category = "hpd") plot(results, category = "perfo", level = "across") plot(results, category = "perfo", level = "within") plot(results, category = "stabi") plot(results, category = "pair_perfo", level = "across") plwithin = plot(results, category = "pair_perfo", level = "within") plot(results, category = "pair_stabi") plot(results, category = "joint")
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4) outs = extr_outs(model = mod, probs = c(0.05, 0.95), verbose = TRUE) results = prob_sup(extr = outs, int = .2, increase = TRUE, save.df = FALSE, verbose = FALSE) plot(results, category = "hpd") plot(results, category = "perfo", level = "across") plot(results, category = "perfo", level = "within") plot(results, category = "stabi") plot(results, category = "pair_perfo", level = "across") plwithin = plot(results, category = "pair_perfo", level = "within") plot(results, category = "pair_stabi") plot(results, category = "joint")
extr
Print a extr
object in R console
## S3 method for class 'extr' print(x, ...)
## S3 method for class 'extr' print(x, ...)
x |
An object of class |
... |
currently not used |
probsup
Print a probsup
object in R console
## S3 method for class 'probsup' print(x, ...)
## S3 method for class 'probsup' print(x, ...)
x |
An object of class |
... |
currently not used |
This function estimates the probabilities of superior performance and stability across environments, and probabilities of superior performance within environments.
prob_sup(extr, int, increase = TRUE, save.df = FALSE, verbose = FALSE)
prob_sup(extr, int, increase = TRUE, save.df = FALSE, verbose = FALSE)
extr |
An object of class |
int |
A numeric representing the selection intensity (between 0 and 1) |
increase |
Logical. |
save.df |
Logical. Should the data frames be saved in the work directory?
|
verbose |
A logical value. If |
Probabilities provide the risk of recommending a selection candidate for a target
population of environments or for a specific environment. prob_sup
computes the probabilities of superior performance and the probabilities of superior stability:
Probability of superior performance
Let represent the subset of selected genotypes based on their
performance across environments. A given genotype
will belong to
if its genotypic marginal value (
) is high or low enough compared to
its peers.
prob_sup
leverages the Monte Carlo discretized sampling
from the posterior distribution to emulate the occurrence of trials. Then,
the probability of the
genotype belonging to
is the
ratio of success (
) events and the total number of sampled events,
as follows:
where is the total number of samples
,
and
is an indicator variable that can assume
two values: (1) if
in the
sample,
and (0) otherwise.
is conditioned to the number of iterations and chains
previously set at bayes_met.
Similarly, the within-environment probability of superior performance can be applied to
individual environments. Let represent the subset of superior
genotypes in the
environment, so that the probability of the
can calculated as follows:
where is an indicator variable
mapping success (1) if
exists in
, and
failure (0) otherwise, and
.
Note that when computing within-environment probabilities, we are accounting for
the interaction of the
genotype with the
environment.
The pairwise probabilities of superior performance can also be calculated across
or within environments. This metric assesses the probability of the
genotype being superior to another experimental genotype or a commercial check.
The calculations are as follows, across and within environments, respectively:
or
These equations are set for when the selection direction is positive. If
increase = FALSE
, is simply switched by
.
Probability of superior stability
This probability makes a direct analogy with the
method of Shukla (1972): a stable genotype is the one that has a low
genotype-by-environment interaction variance .
Using the same probability principles previously described, the probability
of superior stability is given as follows:
where indicates if
exists in
(1) or not (0).
Pairwise probabilities of superior stability are also possible in this context:
Note that will be superior to
if it has a lower
variance of the genotype-by-environment interaction effect. This is true regardless
if
increase
is set to TRUE
or FALSE
.
The joint probability independent events is the product of the individual probabilities. The estimated genotypic main effects and the variances of GEI effects are independent by design, thus the joint probability of superior performance and stability as follows:
The estimation of these probabilities are strictly related to some key questions that constantly arises in plant breeding:
What is the risk of recommending a selection candidate for a target population of environments?
What is the probability of a given selection candidate having good performance if recommended to a target population of environments? And for a specific environment?
What is the probability of a given selection candidate having better performance than a cultivar check in the target population of environments? And in specific environments?
How probable is it that a given selection candidate performs similarly across environments?
What are the chances that a given selection candidate is more stable than a cultivar check in the target population of environments?
What is the probability that a given selection candidate having a superior and invariable performance across environments?
More details about the usage of prob_sup
, as well as the other function of
the ProbBreed
package can be found at https://saulo-chaves.github.io/ProbBreed_site/.
The function returns an object of class probsup
, which contains two lists,
one with the across
-environments probabilities, and another with the within
-environments probabilities.
If an entry-mean model was used in ProbBreed::bayes_met
, only the across
list will be available.
The across
list has the following elements:
g_hpd
: Highest posterior density (HPD) of the posterior genotypic main effects.
perfo
: the probabilities of superior performance.
pair_perfo
: the pairwise probabilities of superior performance.
stabi
: a list with the probabilities of superior stability. It contains the data frames gl
,
gm
(when reg
is not NULL
) and gt
(when year
is not NULL
). Unavailable if an entry-mean model was used in bayes_met
.
pair_stabi
: a list with the pairwise probabilities of superior stability. It contains the data frames gl
,
gm
(when reg
is not NULL
) and gt
(when year
is not NULL
). Unavailable if an entry-mean model was used in bayes_met
.
joint_prob
: the joint probabilities of superior performance and stability. Unavailable if an entry-mean model was used in bayes_met
.
The within
list has the following elements:
perfo
: a list of data frames containing the probabilities of superior performance
within locations (gl
), regions (gm
) and years (gt
).
pair_perfo
: lists with the pairwise probabilities of superior performance
within locations (gl
), regions (gm
) and years (gt
).
Dias, K. O. G, Santos J. P. R., Krause, M. D., Piepho H. -P., Guimarães, L. J. M., Pastina, M. M., and Garcia, A. A. F. (2022). Leveraging probability concepts for cultivar recommendation in multi-environment trials. Theoretical and Applied Genetics, 133(2):443-455. doi:10.1007/s00122-022-04041-y
Shukla, G. K. (1972) Some statistical aspects of partioning genotype environmental componentes of variability. Heredity, 29:237-245. doi:10.1038/hdy.1972.87
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4) outs = extr_outs(model = mod, probs = c(0.05, 0.95), verbose = TRUE) results = prob_sup(extr = outs, int = .2, increase = TRUE, save.df = FALSE, verbose = FALSE)
mod = bayes_met(data = maize, gen = "Hybrid", loc = "Location", repl = c("Rep","Block"), trait = "GY", reg = "Region", year = NULL, res.het = TRUE, iter = 2000, cores = 2, chain = 4) outs = extr_outs(model = mod, probs = c(0.05, 0.95), verbose = TRUE) results = prob_sup(extr = outs, int = .2, increase = TRUE, save.df = FALSE, verbose = FALSE)
This dataset belongs to the USDA Northern Region Uniform Soybean Tests,
and it is a subset of the data used by Krause et al. (2023). It contains the
empirical best linear unbiased estimates of genotypic means of the seed yield
from 39 experimental genotypes evaluated in 14 locations. The original data, available at the package
SoyURT
, has 4,257 experimental genotypes evaluated at 63 locations and
31 years resulting in 591 location-year combinations (environments) with
39,006 yield values.
soy
soy
soy
A data frame with 823 rows and 3 columns:
14 locations
39 experimental genotypes
435 EBLUEs (phenotypes)
Krause MD, Dias KOG, Singh AK, Beavis WD. 2023. Using soybean historical field trial data to study genotype by environment variation and identify mega-environments with the integration of genetic and non-genetic factors. bioRxiv : the preprint server for biology. doi: https://doi.org/10.1101/2022.04.11.487885