Summaries from the same study
Summaries that one study computed from the same delays are
correlated, so they are fitted jointly. Two summaries are fitted
together when they agree on every field other than the summary itself,
so a linear predictor cannot vary within the group. A summary supplied
with its own standard error is fitted on its own.
A mean and a standard deviation from one study are given the
asymptotic bivariate normal of the pair, \[
\begin{pmatrix} y_{m} \\ y_{\sigma} \end{pmatrix} \sim
\text{Normal}\left(
\begin{pmatrix} m_1 \\ \sigma \end{pmatrix}, \;
\frac{1}{n}\begin{pmatrix}
\sigma^2 & \mu_3 / (2 \sigma) \\
\mu_3 / (2 \sigma) & \sigma^2 (\kappa - 1) / 4
\end{pmatrix}
\right), (\#eq:meta-moment-pair)
\] whose off diagonal is \(\text{Cov}(\bar{x}, s^2) = \mu_3 / n\)
carried onto the standard deviation scale by the delta method (Cramér 1946). The
correlation is \(\gamma_1 / \sqrt{\kappa -
1}\) with \(\gamma_1 = \mu_3 /
\sigma^3\) the skewness, which every distribution keeps inside
\([-1, 1]\). Moments taken from a grid
or quadrature can sit just outside, so the correlation is clipped.
Several quantiles from one study at probabilities \(p_1 < \dots < p_k\) with values \(y_1 \le \dots \le y_k\) cut the delay axis
into \(k + 1\) cells, and the counts in
them are multinomial, \[
(c_1, \dots, c_{k+1}) \sim \text{Multinomial}\left(n, \; \left(G(y_1),
\; G(y_2) - G(y_1), \; \dots, \; 1 - G(y_k)\right)\right),
(\#eq:meta-quantile-set)
\] with \(c_j = \text{round}(n p_j) -
\text{round}(n p_{j-1})\) and \(c_{k+1}
= n - \text{round}(n p_k)\). A single quantile reduces this to
the binomial of which Equation @ref(eq:meta-quantile-lik) is the normal
approximation. Two quantiles reported at the same value are merged into
one cell. A cell whose probability underflows to zero while the study
saw delays in it is floored at \(10^{-300}\).
A single quantile of integer day delays is a discrete statistic. “The
median is 5 days” says that the empirical distribution function crossed
one half between 4 and 5 days, that is \(N_{\le y - w_s} < \lceil n p \rceil \le N_{\le
y}\) with \(N_{\le y}\) the
number of delays at or below \(y\). It
is fitted as the probability of that event, \[
P(N_{\le y} \ge k) - P(N_{\le y - w_s} \ge k), \quad k = \lceil n p
\rceil, \quad N_{\le y} \sim \text{Binomial}\left(n, G_0(y)\right),
(\#eq:meta-quantile-crossing)
\] where \(w_s\) is the
reporting resolution and \(G_0\) the
step distribution function of the discrete estimand of Section
@ref(the-biased-estimands), before continuity correction. The
information this carries saturates as \(n\) grows.
Several quantiles of integer day delays from one study are fitted as
the joint probability of the crossings they stand for. The counts \(N_{e_1} \le N_{e_2} \le \dots \le N_{e_m}\)
at the integer edges the reported quantiles name, the day below each and
the day itself, form a Markov chain of binomial steps, \[
N_{e_1} \sim \text{Binomial}\left(n, \; G_0(e_1)\right), \quad
N_{e_{i+1}} \mid N_{e_i} \sim N_{e_i} + \text{Binomial}\left(n -
N_{e_i}, \; \frac{G_0(e_{i+1}) - G_0(e_i)}{1 - G_0(e_i)}\right),
(\#eq:meta-quantile-chain)
\] and a quantile reported at \(p\) landing on day \(y\) puts the box \(N_{\le y - w_s} \le \lceil n p \rceil - 1\)
and \(N_{\le y} \ge \lceil n p \rceil\)
on two of them. The likelihood is the probability that every count fell
in its box, \[
P\left(l_i \le N_{e_i} \le u_i, \; i = 1, \dots, m\right),
(\#eq:meta-quantile-box)
\] computed by a forward pass over the counts \(0, \dots, n\) on the log scale, one
binomial step per edge. The pass is kept to a band of counts around the
most likely path of the constrained chain, six standard deviations and a
few counts wide, so its cost grows like \(m
n^{3/2}\) rather than \(m n^2\)
and it is exact to well within a millionth. Two quantiles reported at
the same value are two constraints at one edge, and a single quantile
reduces Equation @ref(eq:meta-quantile-box) to Equation
@ref(eq:meta-quantile-crossing). The multinomial of Equation
@ref(eq:meta-quantile-set) on the continuity corrected \(G\) treats each reported quantile as a
continuous cut point, so its curvature grows like \(n\) and it claims a standard error five
times too small at a thousand delays, where Equation
@ref(eq:meta-quantile-box) is close to an indicator of the parameters
that put the population quantiles in the reported cells. That is a box
rather than a peak, so the posterior of such a study is described by its
bounds rather than a standard error, and the sampler explores the
box.
A study with a continuous estimand, codes 1, 2 and 4 of Section
@ref(the-biased-estimands), that reports a mean or a standard deviation
alongside quantiles has all of them fitted as one multivariate normal,
\[
\begin{pmatrix} y_m \\ y_\sigma \\ y_{p_1} \\ \vdots \\ y_{p_k}
\end{pmatrix} \sim
\text{Normal}\left(
\begin{pmatrix} m_1 \\ \sigma \\ Q_{p_1} \\ \vdots \\ Q_{p_k}
\end{pmatrix}, \;
\frac{1}{n} \Sigma
\right), (\#eq:meta-joint-study)
\] whose mean and standard deviation block is that of Equation
@ref(eq:meta-moment-pair). The rest follows from the Bahadur
representation of a sample quantile, \(\hat{Q}_p - Q_p \approx -(\hat{G}(Q_p) - p) /
g(Q_p)\) with \(g\) the density
of \(G\) (Bahadur 1966), \[
\Sigma_{q_i q_j} = \frac{p_i (1 - p_j)}{g(Q_{p_i}) \, g(Q_{p_j})}, \quad
p_i \le p_j, \qquad
\Sigma_{m q_i} = -\frac{\int_L^{Q_{p_i}} (x - m_1) \,
\text{d}G(x)}{g(Q_{p_i})}, \qquad
\Sigma_{\sigma q_i} = -\frac{\int_L^{Q_{p_i}} \left((x - m_1)^2 -
\sigma^2\right) \text{d}G(x)}{2 \sigma \, g(Q_{p_i})},
(\#eq:meta-joint-cov)
\] with \(L\) the smallest delay
the study counted, and the last entry carried from the sample variance
to the standard deviation by the delta method. The partial moments are
integrated by parts over the nodes on which \(G\) is evaluated, and \(g(Q_p)\) is the closed form density of the
estimand where its quantile is refined and the slope of \(G\) between the bracketing nodes where it
is not, see Section @ref(quantiles-of-the-estimands). Against 4000
simulated lognormal studies of 200 delays the derived standard errors
are within 3% and the correlations within 0.02 of their sampling values.
Fitting the two kinds separately counts a study reporting a mean, a
standard deviation and quartiles about twice for the location and 1.4
times for the spread, and a mean with a median 1.5 times at \(n = 100\) and 3 times at \(n = 30\). A continuous estimand reporting
only a mean and a standard deviation, or only quantiles, keeps Equation
@ref(eq:meta-moment-pair) or @ref(eq:meta-quantile-set), which the joint
normal reduces to and which is exact for a single quantile. On the grid
of codes 0 and 3 the quantiles are discrete statistics fitted by
Equations @ref(eq:meta-quantile-crossing) and
@ref(eq:meta-quantile-box), so the mean and standard deviation of such a
study are fitted separately from its quantiles, and a study reporting
both kinds is over weighted in the same way. Keep its mean and standard
deviation and drop its quantiles. The normal approximations degrade for
small study sample sizes.
Reported distribution parameters
A study that published the parameters of a fitted distribution \(\hat{F}\) has them converted to summaries
by epidist_estimates_parameters(), so the family it fitted
need not match the family fitted to it. The summaries are taken over the
range of delays the study could have seen, conditioning \(\hat{F}\) on \((L, D]\), \[
\hat{F}_{L,D}(y) = \frac{\hat{F}(y) - \hat{F}(L)}{\hat{F}(D) -
\hat{F}(L)}, \quad L < y \le D, (\#eq:meta-reported-cond)
\] with \(L\) the smallest delay
it counted and \(D\) its observation
time, or \(D = \infty\) for a study
that adjusted for right truncation. Without this a study that did not
correct for right truncation is charged with tail spread its data never
had, which can reach tens of percent on a standard deviation. Reported
parameter standard errors are carried onto the summaries by the delta
method, as \(J V J^\top\) with \(V\) the diagonal matrix of squared standard
errors and \(J\) the Jacobian of the
map from parameters to summaries, and fitted jointly through Equation
@ref(eq:meta-mvn). For \(k\) summaries
of a \(k\) parameter fit this gives
back the curvature \(V^{-1}\), where
fitting each with its own standard error would claim standard errors 1.4
to 1.5 times too wide for a lognormal mean and standard deviation. A
full parameter covariance is better passed as draws to
as_epidist_multivariate(). A study with no parameter
uncertainty falls back to the sample size likelihoods above, and any
number of its summaries may be reported. This route assumes the reported
distribution has the shape of the study’s estimand, which holds only
approximately where a continuous family was fitted to integer date
differences. There, quantiles in the body of the distribution are more
reliable than a standard deviation, which depends on a tail the study
never saw.